Jul 21 16:21:53.997574 ip-10-0-130-171 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 16:21:53.997590 ip-10-0-130-171 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 16:21:53.997599 ip-10-0-130-171 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 16:21:53.997927 ip-10-0-130-171 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 16:22:04.222644 ip-10-0-130-171 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 16:22:04.222659 ip-10-0-130-171 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d76a7f00e5fd44b1aaa5cc5e30db0ff1 --
Jul 21 16:23:40.936907 ip-10-0-130-171 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 16:23:41.390764 ip-10-0-130-171 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:23:41.390764 ip-10-0-130-171 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 16:23:41.390764 ip-10-0-130-171 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:23:41.390764 ip-10-0-130-171 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 16:23:41.390764 ip-10-0-130-171 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:23:41.390764 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.350161    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 16:23:41.390764 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.353964    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:23:41.390764 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.353976    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:23:41.390764 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.353979    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:23:41.390764 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.353982    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:23:41.390764 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.353985    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:23:41.390764 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.353988    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:23:41.390764 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.353991    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:23:41.390764 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.353994    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.353996    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.353999    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354001    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354004    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354007    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354009    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354013    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354020    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354023    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354026    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354029    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354031    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354036    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354039    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354043    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354046    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354049    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354052    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354055    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:23:41.664599 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354057    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:23:41.427303 ip-10-0-130-171 systemd[1]: Started Kubernetes Kubelet.
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354060    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354063    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354065    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354068    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354072    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354075    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354078    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354081    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354084    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354087    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354090    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354093    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354096    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354098    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354101    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354103    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354106    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354109    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:23:41.672774 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354111    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354114    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354116    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354119    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354122    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354124    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354127    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354130    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354133    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354136    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354139    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354142    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354144    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354147    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354150    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354152    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354155    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354159    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354162    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354165    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:23:41.673942 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354168    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354171    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354174    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354177    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354179    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354183    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354186    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354188    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354191    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354195    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354198    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354201    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354204    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354206    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354209    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354211    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354214    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354216    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354219    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354221    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:23:41.674913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354224    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354226    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354229    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354232    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354235    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354237    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354240    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354242    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354244    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354247    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354249    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354252    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354254    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354944    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354951    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354954    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354956    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354960    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354963    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354966    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:23:41.675746 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354969    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354971    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354974    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354976    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354979    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354982    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354984    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354987    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354989    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354991    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354994    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.354997    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355002    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355005    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355009    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355012    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355015    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355018    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355021    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:23:41.676528 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355024    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355027    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355030    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355033    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355036    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355039    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355041    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355046    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355049    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355052    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355055    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355057    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355061    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355063    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355067    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355069    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355072    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355074    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355077    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:23:41.677384 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355079    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355082    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355084    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355087    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355089    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355092    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355095    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355099    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355103    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355106    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355109    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355112    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355115    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355117    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355120    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355122    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355134    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355137    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355139    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355142    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:23:41.678039 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355145    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355148    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355151    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355153    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355156    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355158    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355162    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355165    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355168    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355170    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355173    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355175    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355178    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355180    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355183    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355185    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355188    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355191    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355193    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355196    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:23:41.678724 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355198    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355201    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355203    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355206    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355209    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355212    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355214    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355217    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355220    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355223    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355225    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355228    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355230    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355233    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355586    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355591    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355594    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355596    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355600    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:23:41.679346 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355602    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355605    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355608    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355610    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355613    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355616    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355618    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355621    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355623    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355627    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355629    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355632    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355649    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355652    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355654    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355657    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355663    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355666    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355669    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355671    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:23:41.680000 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355674    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355676    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355679    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355682    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355684    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355687    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355689    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355692    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355695    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355697    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355700    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355702    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355705    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355708    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355711    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355713    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355716    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355718    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355721    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355723    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:23:41.680791 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355726    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355728    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355733    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355736    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355739    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355742    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355745    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355747    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355753    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355755    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355758    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355760    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355763    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355766    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355768    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355771    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355773    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355776    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355779    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:23:41.681402 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355782    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355785    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355787    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355790    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355792    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355795    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355798    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355801    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355803    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355806    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355808    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355811    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355814    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355816    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355818    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355821    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355824    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355826    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355829    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355832    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:23:41.682073 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355834    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355839    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355843    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355846    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355849    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355851    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355854    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355857    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355859    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355862    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355866    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355869    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355872    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355876    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.355879    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.355962    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.355980    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.355989    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.355996    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356002    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 16:23:41.682881 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356006    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356010    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356014    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356017    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356021    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356024    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356027    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356031    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356033    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356036    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356039    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356042    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356045    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356051    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356054    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356057    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356060    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356064    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356067    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356070    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356073    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356077    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356080    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356083    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 16:23:41.683483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356086    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356089    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356092    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356096    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356099    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356102    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356104    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356107    2578 flags.go:64] FLAG: --enable-server="true"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356111    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356116    2578 flags.go:64] FLAG: --event-burst="100"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356119    2578 flags.go:64] FLAG: --event-qps="50"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356122    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356125    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356127    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356131    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356134    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356137    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356139    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356142    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356145    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356148    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356153    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356156    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356159    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356162    2578 flags.go:64] FLAG: --feature-gates=""
Jul 21 16:23:41.684197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356165    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356168    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356172    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356175    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356178    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356181    2578 flags.go:64] FLAG: --help="false"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356184    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-130-171.ec2.internal"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356187    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356190    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356193    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356197    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356200    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356203    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356206    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356209    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356212    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356215    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356218    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356221    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356224    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356227    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356230    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356233    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356236    2578 flags.go:64] FLAG: --lock-file=""
Jul 21 16:23:41.684914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356238    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356241    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356244    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356250    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356255    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356257    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356260    2578 flags.go:64] FLAG: --logging-format="text"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356263    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356266    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356269    2578 flags.go:64] FLAG: --manifest-url=""
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356272    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356276    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356279    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356284    2578 flags.go:64] FLAG: --max-pods="110"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356286    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356289    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356292    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356295    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356298    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356301    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356304    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356311    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356314    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356318    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 16:23:41.685587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356321    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356324    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356329    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356332    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356335    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356338    2578 flags.go:64] FLAG: --port="10250"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356341    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356344    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a4268636cd208ca4"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356347    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356350    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356353    2578 flags.go:64] FLAG: --register-node="true"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356356    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356360    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356365    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356368    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356371    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356374    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356377    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356380    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356383    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356386    2578 flags.go:64] FLAG: --runonce="false"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356389    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356392    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356395    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356398    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 16:23:41.686762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356401    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356404    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356407    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356410    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356412    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356415    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356418    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356421    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356424    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356427    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356430    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356435    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356438    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356441    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356444    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356447    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356450    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356452    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356455    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356459    2578 flags.go:64] FLAG: --v="2"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356464    2578 flags.go:64] FLAG: --version="false"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356468    2578 flags.go:64] FLAG: --vmodule=""
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356471    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.356475    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356595    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:23:41.690934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356599    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356602    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356606    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356609    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356611    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356614    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356616    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356619    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356621    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356624    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356626    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356629    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356632    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356647    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356650    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356653    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356656    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356660    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356662    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:23:41.691771 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356665    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356667    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356670    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356673    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356675    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356678    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356681    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356684    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356688    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356691    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356694    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356696    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356699    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356701    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356704    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356706    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356709    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356712    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356714    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356717    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:23:41.842922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356719    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356722    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356724    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356727    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356729    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356732    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356734    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356737    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356740    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356742    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356744    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356747    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356750    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356754    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356758    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356761    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356763    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356766    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356768    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356773    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:23:41.843934 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356776    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356779    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356782    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356784    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356787    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356790    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356792    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356795    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356797    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356800    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356803    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356807    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356811    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356814    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356817    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356819    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356822    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356824    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356827    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:23:41.844495 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356830    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356832    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356835    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356838    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356840    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356843    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356846    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356849    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356852    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356854    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356857    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356859    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356864    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356869    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356872    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356875    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356878    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356881    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356883    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:23:41.845090 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.356886    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.357410    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.364522    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.364538    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.365353    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.365360    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365432    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365437    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365441    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365444    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365447    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365450    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365453    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365455    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365458    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:23:41.845595 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365461    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365463    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365466    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365468    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365471    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365473    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365476    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365478    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365481    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365483    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365486    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365488    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365493    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365497    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365500    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365503    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365506    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365509    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365512    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365514    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:23:41.846124 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365526    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365529    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365531    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365534    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365536    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365539    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365542    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365544    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365547    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365550    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365552    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365555    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365557    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365560    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365564    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365567    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365569    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365572    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365574    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:23:41.846659 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365577    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365580    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365582    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365585    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365587    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365590    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365593    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365595    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365598    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365601    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365604    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365606    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365609    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365612    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365620    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365623    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365625    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365628    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365630    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365633    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:23:41.847217 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365650    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365655    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365667    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365670    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365673    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365676    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365678    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365681    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365683    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365686    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365688    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365691    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365693    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365696    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365698    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365701    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365703    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365706    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365709    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365712    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:23:41.847751 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365714    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:23:41.848322 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365717    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:23:41.848322 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365720    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:23:41.848322 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365724    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:23:41.848322 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365727    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:23:41.848322 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365730    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:23:41.848322 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365733    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:23:41.848322 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365742    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:23:41.848322 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365745    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:23:41.848322 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365748    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:23:41.848322 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365751    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:23:41.848322 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.365756    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:23:41.848322 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365929    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:23:41.848322 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365934    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:23:41.848322 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365937    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365940    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365943    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365946    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365951    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365954    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365956    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365959    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365962    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365965    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365967    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365970    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365972    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365975    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365977    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365980    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365983    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365985    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365989    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:23:41.848759 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365992    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.365995    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366000    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366003    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366005    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366008    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366010    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366019    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366022    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366025    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366027    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366030    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366033    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366035    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366038    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366040    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366043    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366047    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366050    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366053    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:23:41.849303 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366055    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366058    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366060    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366063    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366066    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366068    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366071    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366073    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366076    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366078    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366080    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366083    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366086    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366088    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366093    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366095    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366098    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366101    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366103    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366106    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:23:41.849867 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366115    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366118    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366121    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366123    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366126    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366128    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366131    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366133    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366136    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366140    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366142    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366145    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366148    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366150    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366152    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366155    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366158    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366160    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366163    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366165    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:23:41.850427 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366168    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366170    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366173    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366176    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366178    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366180    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366184    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366187    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366189    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366192    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366194    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366197    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366199    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366207    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366210    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366213    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366217    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:23:41.850964 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:41.366220    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:23:41.853866 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.366225    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:23:41.853866 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.366352    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 16:23:41.853866 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.369259    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 16:23:41.853866 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.370505    2578 server.go:1019] "Starting client certificate rotation"
Jul 21 16:23:41.853866 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.370602    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 16:23:41.853866 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.370630    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 16:23:41.853866 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.373358    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 16:23:41.853866 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.379832    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 16:23:41.853866 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.394523    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 21 16:23:41.853866 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.397490    2578 log.go:25] "Validated CRI v1 image API"
Jul 21 16:23:41.853866 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.398330    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 16:23:41.853866 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.400565    2578 fs.go:135] Filesystem UUIDs: map[25ef7549-e9ce-472e-aeaa-cc19f4452058:/dev/nvme0n1p3 28c82d43-e2ea-4b6f-ab12-2cc7415de52d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 21 16:23:41.854259 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.400578    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 16:23:41.854259 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.401666    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.406061    2578 manager.go:216] Machine: {Timestamp:2026-07-21 16:23:41.40461219 +0000 UTC m=+0.342920633 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3077711 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ff49d18d3a8ae48b4778380060db7 SystemUUID:ec2ff49d-18d3-a8ae-48b4-778380060db7 BootID:d76a7f00-e5fd-44b1-aaa5-cc5e30db0ff1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:15:a1:d7:79:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:15:a1:d7:79:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:d2:a4:87:e0:6c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.406196    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.406290    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.409029    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.409059    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-171.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.410136    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.410145    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.410152    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.410809    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.412523    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.415419    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.415542    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.415569    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.415582    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.415598    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.415610    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.415622    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 16:23:41.854669 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.415969    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.415985    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.418081    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.420504    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.420546    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.421624    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.421658    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.421669    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.421674    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.421685    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.421692    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.421701    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.421706    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.421714    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.421720    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.421739    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.421746    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.422618    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.422625    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.423957    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2mzwj"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.425310    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-171.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.425451    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-171.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.425451    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.426448    2578 server.go:1268] "Started kubelet"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.426514    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.426692    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.426771    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.428198    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.431714    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.431763    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2mzwj"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.432318    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.434431    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-171.ec2.internal.18c45aa60428dbf6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-171.ec2.internal,UID:ip-10-0-130-171.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-171.ec2.internal,},FirstTimestamp:2026-07-21 16:23:41.42641663 +0000 UTC m=+0.364725069,LastTimestamp:2026-07-21 16:23:41.42641663 +0000 UTC m=+0.364725069,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-171.ec2.internal,}"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.439880    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.440003    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.440010    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.440593    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.440610    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.440802    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.440897    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.440907    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 16:23:41.855239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.442476    2578 factory.go:55] Registering systemd factory
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.442488    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.442693    2578 factory.go:153] Registering CRI-O factory
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.442704    2578 factory.go:223] Registration of the crio container factory successfully
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.442742    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.442771    2578 factory.go:103] Registering Raw factory
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.442787    2578 manager.go:1196] Started watching for new ooms in manager
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.443134    2578 manager.go:349] Starting recovery of all containers
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.454822    2578 manager.go:354] Recovery completed
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.455990    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.460182    2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-171.ec2.internal\" not found" node="ip-10-0-130-171.ec2.internal"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.460876    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.462492    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.462523    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.462537    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.463042    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.463053    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.463071    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.463043    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.463797    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.463822    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.463832    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.464213    2578 policy_none.go:49] "None policy: Start"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.464223    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.464232    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.465529    2578 policy_none.go:47] "Start"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.523291    2578 manager.go:337] "Starting Device Plugin manager"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.523318    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.523335    2578 server.go:87] "Starting device plugin registration server"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.523596    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.523608    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.523695    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.523772    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.523781    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.524252    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.524296    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-171.ec2.internal\" not found"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.574832    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.576035    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.576073    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.576096    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.576133    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.578863    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.624224    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.625058    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.625091    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.625103    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.625127    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-171.ec2.internal"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.632038    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-171.ec2.internal"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.632055    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-171.ec2.internal\": node \"ip-10-0-130-171.ec2.internal\" not found"
Jul 21 16:23:41.856547 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.648899    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.676632    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal"]
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.676728    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.678144    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.678170    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.678181    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.679445    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.679553    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.679581    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.680603    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.680622    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.680631    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.680699    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.680717    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.680726    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.681945    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.681966    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.682714    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.682744    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.682758    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.718260    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-171.ec2.internal\" not found" node="ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.722546    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-171.ec2.internal\" not found" node="ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.743398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/adf8b0f8519398aa8893cd3ca93d26bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal\" (UID: \"adf8b0f8519398aa8893cd3ca93d26bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.743420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/adf8b0f8519398aa8893cd3ca93d26bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal\" (UID: \"adf8b0f8519398aa8893cd3ca93d26bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.743438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27f23970c7fcce5fec0df5f62c34e32e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-171.ec2.internal\" (UID: \"27f23970c7fcce5fec0df5f62c34e32e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.749348    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.843981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/adf8b0f8519398aa8893cd3ca93d26bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal\" (UID: \"adf8b0f8519398aa8893cd3ca93d26bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.844021    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/adf8b0f8519398aa8893cd3ca93d26bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal\" (UID: \"adf8b0f8519398aa8893cd3ca93d26bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.056154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.844048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27f23970c7fcce5fec0df5f62c34e32e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-171.ec2.internal\" (UID: \"27f23970c7fcce5fec0df5f62c34e32e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.059443 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.844054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/adf8b0f8519398aa8893cd3ca93d26bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal\" (UID: \"adf8b0f8519398aa8893cd3ca93d26bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.059443 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.844019    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/adf8b0f8519398aa8893cd3ca93d26bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal\" (UID: \"adf8b0f8519398aa8893cd3ca93d26bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.059443 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:41.844084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27f23970c7fcce5fec0df5f62c34e32e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-171.ec2.internal\" (UID: \"27f23970c7fcce5fec0df5f62c34e32e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.059443 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.849448    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Jul 21 16:23:42.059443 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:41.950349    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Jul 21 16:23:42.059443 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.021526    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.059443 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.025231    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.059443 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:42.051363    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Jul 21 16:23:42.257242 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:42.152445    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Jul 21 16:23:42.257242 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:42.252880    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Jul 21 16:23:42.436611 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.350337    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:23:42.436611 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:42.353711    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Jul 21 16:23:42.436611 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.369845    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 16:23:42.436611 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.369950    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 16:23:42.436611 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.369992    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 16:23:42.436611 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.369998    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 16:23:42.437738 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.437005    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 16:18:41 +0000 UTC" deadline="2028-04-29 06:09:14.082069368 +0000 UTC"
Jul 21 16:23:42.437738 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.437040    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15541h45m31.645033943s"
Jul 21 16:23:42.626588 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:42.453922    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Jul 21 16:23:42.626588 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.497346    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:23:42.626588 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.541512    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.626588 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.555169    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 16:23:42.626588 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.556611    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal"
Jul 21 16:23:42.626588 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.564727    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 16:23:42.628913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:42.628163    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf8b0f8519398aa8893cd3ca93d26bc.slice/crio-2eb074e65846807583d4c36f69c86b48ca8753467a2600b3a1f803591e89a97f WatchSource:0}: Error finding container 2eb074e65846807583d4c36f69c86b48ca8753467a2600b3a1f803591e89a97f: Status 404 returned error can't find the container with id 2eb074e65846807583d4c36f69c86b48ca8753467a2600b3a1f803591e89a97f
Jul 21 16:23:42.628913 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:42.628670    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f23970c7fcce5fec0df5f62c34e32e.slice/crio-695e38660e2ec3342e7c8fbbcceddb9cc08a9e319b074a1883e3e9d15977e8dc WatchSource:0}: Error finding container 695e38660e2ec3342e7c8fbbcceddb9cc08a9e319b074a1883e3e9d15977e8dc: Status 404 returned error can't find the container with id 695e38660e2ec3342e7c8fbbcceddb9cc08a9e319b074a1883e3e9d15977e8dc
Jul 21 16:23:42.834915 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:42.635407    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:23:43.398667 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.360885    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:23:43.418658 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.418008    2578 apiserver.go:52] "Watching apiserver"
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.424218    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.424657    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hmkpw","kube-system/konnectivity-agent-n4pk5","kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal","openshift-cluster-node-tuning-operator/tuned-rf2pk","openshift-dns/node-resolver-p9cm5","openshift-image-registry/node-ca-jkq4v","openshift-multus/multus-additional-cni-plugins-fvkdn","openshift-multus/multus-dnjbm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal","openshift-multus/network-metrics-daemon-k5rhr","openshift-network-diagnostics/network-check-target-qjfjw","openshift-network-operator/iptables-alerter-d5hwr","openshift-ovn-kubernetes/ovnkube-node-rlhd8"]
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.426339    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.427984    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d5hwr"
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.428955    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.429250    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.429690    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.429980    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vtq4z\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.430266    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.430529    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.430755    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.430779    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.430900    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.430942    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.430975    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-26twc\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.431002    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.433187    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.434402    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bwb8c\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.434534    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.434734    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n2228\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.437045    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.437445    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.437679    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.437740    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.438075    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.438547    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p9cm5"
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.438645    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.439604    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jkq4v"
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.441158    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.441385    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7tqsh\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.441418    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.441548    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.442623    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.498463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.443593    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.443941    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.444080    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.444164    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t2lbc\""
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.445472    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:43.445545    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.446347    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.446436    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.446554    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pbb5w\""
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.446885    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n4pk5"
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.447435    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.449061    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.449481    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.449667    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zhqk6\""
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.450668    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.451826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:43.451909    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.452666    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.452776    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8hjnw\""
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.453781    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:43.453844    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454285    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-host\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454313    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-system-cni-dir\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-cni-binary-copy\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lgcn\" (UniqueName: \"kubernetes.io/projected/6b6bf757-0749-4e3c-bbab-3af15a0cf5ea-kube-api-access-9lgcn\") pod \"node-resolver-p9cm5\" (UID: \"6b6bf757-0749-4e3c-bbab-3af15a0cf5ea\") " pod="openshift-dns/node-resolver-p9cm5"
Jul 21 16:23:43.501262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-log-socket\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454426    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-lib-modules\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-cni-netd\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b6bf757-0749-4e3c-bbab-3af15a0cf5ea-tmp-dir\") pod \"node-resolver-p9cm5\" (UID: \"6b6bf757-0749-4e3c-bbab-3af15a0cf5ea\") " pod="openshift-dns/node-resolver-p9cm5"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-run-systemd\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454514    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67587045-0312-4b05-9d5c-9a66a2d6c6ee-ovnkube-script-lib\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-tuned\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454595    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/449f52bf-433c-402e-ba3b-5dd3179bd1a7-serviceca\") pod \"node-ca-jkq4v\" (UID: \"449f52bf-433c-402e-ba3b-5dd3179bd1a7\") " pod="openshift-image-registry/node-ca-jkq4v"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67587045-0312-4b05-9d5c-9a66a2d6c6ee-ovn-node-metrics-cert\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nljnv\" (UniqueName: \"kubernetes.io/projected/67587045-0312-4b05-9d5c-9a66a2d6c6ee-kube-api-access-nljnv\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-modprobe-d\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6dz9\" (UniqueName: \"kubernetes.io/projected/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-kube-api-access-k6dz9\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.502598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454793    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-var-lib-openvswitch\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454825    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-etc-openvswitch\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454846    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-sysctl-conf\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-sys\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-tmp\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzrw6\" (UniqueName: \"kubernetes.io/projected/449f52bf-433c-402e-ba3b-5dd3179bd1a7-kube-api-access-rzrw6\") pod \"node-ca-jkq4v\" (UID: \"449f52bf-433c-402e-ba3b-5dd3179bd1a7\") " pod="openshift-image-registry/node-ca-jkq4v"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-os-release\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-kubelet\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.454989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-run-openvswitch\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455018    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-kubernetes\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-slash\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-run-netns\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b6bf757-0749-4e3c-bbab-3af15a0cf5ea-hosts-file\") pod \"node-resolver-p9cm5\" (UID: \"6b6bf757-0749-4e3c-bbab-3af15a0cf5ea\") " pod="openshift-dns/node-resolver-p9cm5"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455106    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-sysctl-d\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455138    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-run-ovn\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-systemd\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/449f52bf-433c-402e-ba3b-5dd3179bd1a7-host\") pod \"node-ca-jkq4v\" (UID: \"449f52bf-433c-402e-ba3b-5dd3179bd1a7\") " pod="openshift-image-registry/node-ca-jkq4v"
Jul 21 16:23:43.504031 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455202    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-sysconfig\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-run\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-node-log\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455270    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdrdz\" (UniqueName: \"kubernetes.io/projected/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-kube-api-access-zdrdz\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455297    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7jdz\" (UniqueName: \"kubernetes.io/projected/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-kube-api-access-q7jdz\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qjg2\" (UniqueName: \"kubernetes.io/projected/82a6ee03-dce6-4e10-9421-35a60eb69066-kube-api-access-9qjg2\") pod \"iptables-alerter-d5hwr\" (UID: \"82a6ee03-dce6-4e10-9421-35a60eb69066\") " pod="openshift-network-operator/iptables-alerter-d5hwr"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82a6ee03-dce6-4e10-9421-35a60eb69066-iptables-alerter-script\") pod \"iptables-alerter-d5hwr\" (UID: \"82a6ee03-dce6-4e10-9421-35a60eb69066\") " pod="openshift-network-operator/iptables-alerter-d5hwr"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82a6ee03-dce6-4e10-9421-35a60eb69066-host-slash\") pod \"iptables-alerter-d5hwr\" (UID: \"82a6ee03-dce6-4e10-9421-35a60eb69066\") " pod="openshift-network-operator/iptables-alerter-d5hwr"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455402    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-socket-dir\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67587045-0312-4b05-9d5c-9a66a2d6c6ee-ovnkube-config\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-var-lib-kubelet\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-registration-dir\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455524    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67587045-0312-4b05-9d5c-9a66a2d6c6ee-env-overrides\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-cnibin\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.508973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455610    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-device-dir\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.513421 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.513421 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455658    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-systemd-units\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.513421 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455680    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-sys-fs\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.513421 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.455705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-cni-bin\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.513421 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.456312    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 16:23:43.513421 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.459616    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:23:43.513421 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.479992    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rp67g"
Jul 21 16:23:43.513421 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.491122    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rp67g"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.542641    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556241    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556392    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4678365-f754-41cd-8612-f9a45b1d35bc-konnectivity-ca\") pod \"konnectivity-agent-n4pk5\" (UID: \"c4678365-f754-41cd-8612-f9a45b1d35bc\") " pod="kube-system/konnectivity-agent-n4pk5"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-log-socket\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-lib-modules\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e7475db-35a1-407c-818d-b31ecf085e31-kubelet-config\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556557    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-run-multus-certs\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556592    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-cni-netd\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b6bf757-0749-4e3c-bbab-3af15a0cf5ea-tmp-dir\") pod \"node-resolver-p9cm5\" (UID: \"6b6bf757-0749-4e3c-bbab-3af15a0cf5ea\") " pod="openshift-dns/node-resolver-p9cm5"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-run-systemd\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556728    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-log-socket\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67587045-0312-4b05-9d5c-9a66a2d6c6ee-ovnkube-script-lib\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556865    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-lib-modules\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.647963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-cni-netd\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.556935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-run-systemd\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.557062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-tuned\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.557091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/449f52bf-433c-402e-ba3b-5dd3179bd1a7-serviceca\") pod \"node-ca-jkq4v\" (UID: \"449f52bf-433c-402e-ba3b-5dd3179bd1a7\") " pod="openshift-image-registry/node-ca-jkq4v"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.557122    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-multus-conf-dir\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.557223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.557253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.557286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67587045-0312-4b05-9d5c-9a66a2d6c6ee-ovn-node-metrics-cert\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.558996    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nljnv\" (UniqueName: \"kubernetes.io/projected/67587045-0312-4b05-9d5c-9a66a2d6c6ee-kube-api-access-nljnv\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-modprobe-d\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6dz9\" (UniqueName: \"kubernetes.io/projected/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-kube-api-access-k6dz9\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561291    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e7475db-35a1-407c-818d-b31ecf085e31-dbus\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-cnibin\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-var-lib-openvswitch\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-etc-openvswitch\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.649434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-sysctl-conf\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561532    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-sys\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561624    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-sys\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561815    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-modprobe-d\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561865    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-tmp\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b6bf757-0749-4e3c-bbab-3af15a0cf5ea-tmp-dir\") pod \"node-resolver-p9cm5\" (UID: \"6b6bf757-0749-4e3c-bbab-3af15a0cf5ea\") " pod="openshift-dns/node-resolver-p9cm5"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.561919    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzrw6\" (UniqueName: \"kubernetes.io/projected/449f52bf-433c-402e-ba3b-5dd3179bd1a7-kube-api-access-rzrw6\") pod \"node-ca-jkq4v\" (UID: \"449f52bf-433c-402e-ba3b-5dd3179bd1a7\") " pod="openshift-image-registry/node-ca-jkq4v"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.562174    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-var-lib-openvswitch\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.562180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-os-release\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.562230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-run-k8s-cni-cncf-io\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.562253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-os-release\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.562275    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-kubelet\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.562282    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/449f52bf-433c-402e-ba3b-5dd3179bd1a7-serviceca\") pod \"node-ca-jkq4v\" (UID: \"449f52bf-433c-402e-ba3b-5dd3179bd1a7\") " pod="openshift-image-registry/node-ca-jkq4v"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.562425    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-etc-openvswitch\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.562471    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-run-openvswitch\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.650423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.562545    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67587045-0312-4b05-9d5c-9a66a2d6c6ee-ovnkube-script-lib\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.562615    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4678365-f754-41cd-8612-f9a45b1d35bc-agent-certs\") pod \"konnectivity-agent-n4pk5\" (UID: \"c4678365-f754-41cd-8612-f9a45b1d35bc\") " pod="kube-system/konnectivity-agent-n4pk5"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.562680    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-sysctl-conf\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.562729    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-kubelet\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.562784    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-run-openvswitch\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.562989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-hostroot\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-kubernetes\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563188    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-kubernetes\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-slash\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-run-netns\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563298    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-run-netns\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b6bf757-0749-4e3c-bbab-3af15a0cf5ea-hosts-file\") pod \"node-resolver-p9cm5\" (UID: \"6b6bf757-0749-4e3c-bbab-3af15a0cf5ea\") " pod="openshift-dns/node-resolver-p9cm5"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-slash\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-multus-cni-dir\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c485314-da7c-4620-9269-882e8072c509-cni-binary-copy\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b6bf757-0749-4e3c-bbab-3af15a0cf5ea-hosts-file\") pod \"node-resolver-p9cm5\" (UID: \"6b6bf757-0749-4e3c-bbab-3af15a0cf5ea\") " pod="openshift-dns/node-resolver-p9cm5"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563475    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-run-netns\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrjtx\" (UniqueName: \"kubernetes.io/projected/3c485314-da7c-4620-9269-882e8072c509-kube-api-access-hrjtx\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.651394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-sysctl-d\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563726    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-run-ovn\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563607    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-run-ovn\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-systemd\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-sysctl-d\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/449f52bf-433c-402e-ba3b-5dd3179bd1a7-host\") pod \"node-ca-jkq4v\" (UID: \"449f52bf-433c-402e-ba3b-5dd3179bd1a7\") " pod="openshift-image-registry/node-ca-jkq4v"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-os-release\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563901    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-systemd\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-var-lib-cni-multus\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3c485314-da7c-4620-9269-882e8072c509-multus-daemon-config\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.563998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-sysconfig\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-run\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-system-cni-dir\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/449f52bf-433c-402e-ba3b-5dd3179bd1a7-host\") pod \"node-ca-jkq4v\" (UID: \"449f52bf-433c-402e-ba3b-5dd3179bd1a7\") " pod="openshift-image-registry/node-ca-jkq4v"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-node-log\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdrdz\" (UniqueName: \"kubernetes.io/projected/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-kube-api-access-zdrdz\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7jdz\" (UniqueName: \"kubernetes.io/projected/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-kube-api-access-q7jdz\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564169    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-sysconfig\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.652931 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qjg2\" (UniqueName: \"kubernetes.io/projected/82a6ee03-dce6-4e10-9421-35a60eb69066-kube-api-access-9qjg2\") pod \"iptables-alerter-d5hwr\" (UID: \"82a6ee03-dce6-4e10-9421-35a60eb69066\") " pod="openshift-network-operator/iptables-alerter-d5hwr"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-node-log\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82a6ee03-dce6-4e10-9421-35a60eb69066-iptables-alerter-script\") pod \"iptables-alerter-d5hwr\" (UID: \"82a6ee03-dce6-4e10-9421-35a60eb69066\") " pod="openshift-network-operator/iptables-alerter-d5hwr"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82a6ee03-dce6-4e10-9421-35a60eb69066-host-slash\") pod \"iptables-alerter-d5hwr\" (UID: \"82a6ee03-dce6-4e10-9421-35a60eb69066\") " pod="openshift-network-operator/iptables-alerter-d5hwr"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564348    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-socket-dir\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67587045-0312-4b05-9d5c-9a66a2d6c6ee-ovnkube-config\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-var-lib-kubelet\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-registration-dir\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-run\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564563    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82a6ee03-dce6-4e10-9421-35a60eb69066-host-slash\") pod \"iptables-alerter-d5hwr\" (UID: \"82a6ee03-dce6-4e10-9421-35a60eb69066\") " pod="openshift-network-operator/iptables-alerter-d5hwr"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67587045-0312-4b05-9d5c-9a66a2d6c6ee-env-overrides\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-registration-dir\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-cnibin\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564682    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-cnibin\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564718    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-device-dir\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.653905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-device-dir\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.564915    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-socket-dir\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.565166    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82a6ee03-dce6-4e10-9421-35a60eb69066-iptables-alerter-script\") pod \"iptables-alerter-d5hwr\" (UID: \"82a6ee03-dce6-4e10-9421-35a60eb69066\") " pod="openshift-network-operator/iptables-alerter-d5hwr"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.565193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67587045-0312-4b05-9d5c-9a66a2d6c6ee-env-overrides\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.565247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-var-lib-kubelet\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.565251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.565256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.565338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvgfw\" (UniqueName: \"kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw\") pod \"network-check-target-qjfjw\" (UID: \"8de47073-6673-4e99-8d86-9149a51a344c\") " pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.565378    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.565384    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-var-lib-kubelet\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.565448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-systemd-units\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.565599    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-systemd-units\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.566695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-sys-fs\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.566795    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-sys-fs\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.566860    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddrws\" (UniqueName: \"kubernetes.io/projected/46a4fa95-e3f4-4b04-a202-4347da90724d-kube-api-access-ddrws\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.566890    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-var-lib-cni-bin\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.654782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.566980    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-etc-kubernetes\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.566978    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67587045-0312-4b05-9d5c-9a66a2d6c6ee-ovnkube-config\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.567027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-cni-bin\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.567060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-multus-socket-dir-parent\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.567068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67587045-0312-4b05-9d5c-9a66a2d6c6ee-host-cni-bin\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.567090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-host\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.567115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-system-cni-dir\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.567129    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-host\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.567140    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-cni-binary-copy\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.567164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lgcn\" (UniqueName: \"kubernetes.io/projected/6b6bf757-0749-4e3c-bbab-3af15a0cf5ea-kube-api-access-9lgcn\") pod \"node-resolver-p9cm5\" (UID: \"6b6bf757-0749-4e3c-bbab-3af15a0cf5ea\") " pod="openshift-dns/node-resolver-p9cm5"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.567168    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-system-cni-dir\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.567790    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-cni-binary-copy\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.567796    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67587045-0312-4b05-9d5c-9a66a2d6c6ee-ovn-node-metrics-cert\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.568216    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-tmp\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.568631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-etc-tuned\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.573843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nljnv\" (UniqueName: \"kubernetes.io/projected/67587045-0312-4b05-9d5c-9a66a2d6c6ee-kube-api-access-nljnv\") pod \"ovnkube-node-rlhd8\" (UID: \"67587045-0312-4b05-9d5c-9a66a2d6c6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.573889    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qjg2\" (UniqueName: \"kubernetes.io/projected/82a6ee03-dce6-4e10-9421-35a60eb69066-kube-api-access-9qjg2\") pod \"iptables-alerter-d5hwr\" (UID: \"82a6ee03-dce6-4e10-9421-35a60eb69066\") " pod="openshift-network-operator/iptables-alerter-d5hwr"
Jul 21 16:23:43.655945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.574354    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdrdz\" (UniqueName: \"kubernetes.io/projected/42ab280b-2f9c-47c6-9cbb-1369eee55ab5-kube-api-access-zdrdz\") pod \"tuned-rf2pk\" (UID: \"42ab280b-2f9c-47c6-9cbb-1369eee55ab5\") " pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.656846 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.575425    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6dz9\" (UniqueName: \"kubernetes.io/projected/cce4b2cc-cb6c-4f9b-b1d4-327094153be1-kube-api-access-k6dz9\") pod \"aws-ebs-csi-driver-node-2fh2t\" (UID: \"cce4b2cc-cb6c-4f9b-b1d4-327094153be1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.656846 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.577393    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7jdz\" (UniqueName: \"kubernetes.io/projected/5af8a8e0-2cf0-4b3d-9f60-b8dd59662990-kube-api-access-q7jdz\") pod \"multus-additional-cni-plugins-fvkdn\" (UID: \"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990\") " pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.656846 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.579307    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzrw6\" (UniqueName: \"kubernetes.io/projected/449f52bf-433c-402e-ba3b-5dd3179bd1a7-kube-api-access-rzrw6\") pod \"node-ca-jkq4v\" (UID: \"449f52bf-433c-402e-ba3b-5dd3179bd1a7\") " pod="openshift-image-registry/node-ca-jkq4v"
Jul 21 16:23:43.656846 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.579342    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lgcn\" (UniqueName: \"kubernetes.io/projected/6b6bf757-0749-4e3c-bbab-3af15a0cf5ea-kube-api-access-9lgcn\") pod \"node-resolver-p9cm5\" (UID: \"6b6bf757-0749-4e3c-bbab-3af15a0cf5ea\") " pod="openshift-dns/node-resolver-p9cm5"
Jul 21 16:23:43.656846 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.592350    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal" event={"ID":"27f23970c7fcce5fec0df5f62c34e32e","Type":"ContainerStarted","Data":"695e38660e2ec3342e7c8fbbcceddb9cc08a9e319b074a1883e3e9d15977e8dc"}
Jul 21 16:23:43.656846 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.598602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal" event={"ID":"adf8b0f8519398aa8893cd3ca93d26bc","Type":"ContainerStarted","Data":"2eb074e65846807583d4c36f69c86b48ca8753467a2600b3a1f803591e89a97f"}
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-multus-conf-dir\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e7475db-35a1-407c-818d-b31ecf085e31-dbus\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-cnibin\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-run-k8s-cni-cncf-io\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4678365-f754-41cd-8612-f9a45b1d35bc-agent-certs\") pod \"konnectivity-agent-n4pk5\" (UID: \"c4678365-f754-41cd-8612-f9a45b1d35bc\") " pod="kube-system/konnectivity-agent-n4pk5"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-hostroot\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-multus-cni-dir\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c485314-da7c-4620-9269-882e8072c509-cni-binary-copy\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-run-k8s-cni-cncf-io\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-run-netns\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrjtx\" (UniqueName: \"kubernetes.io/projected/3c485314-da7c-4620-9269-882e8072c509-kube-api-access-hrjtx\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-os-release\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667788    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-cnibin\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667791    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-var-lib-cni-multus\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e7475db-35a1-407c-818d-b31ecf085e31-dbus\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3c485314-da7c-4620-9269-882e8072c509-multus-daemon-config\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667837    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-var-lib-cni-multus\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.761337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-run-netns\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667914    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-hostroot\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.667980    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-multus-cni-dir\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-multus-conf-dir\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668078    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-os-release\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-system-cni-dir\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvgfw\" (UniqueName: \"kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw\") pod \"network-check-target-qjfjw\" (UID: \"8de47073-6673-4e99-8d86-9149a51a344c\") " pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668183    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-var-lib-kubelet\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddrws\" (UniqueName: \"kubernetes.io/projected/46a4fa95-e3f4-4b04-a202-4347da90724d-kube-api-access-ddrws\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-var-lib-cni-bin\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-etc-kubernetes\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-multus-socket-dir-parent\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668330    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668355    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-var-lib-kubelet\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-var-lib-cni-bin\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668414    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c485314-da7c-4620-9269-882e8072c509-cni-binary-copy\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668452    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3c485314-da7c-4620-9269-882e8072c509-multus-daemon-config\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668465    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-etc-kubernetes\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.762672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668492    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-multus-socket-dir-parent\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668546    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-system-cni-dir\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:43.668551    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4678365-f754-41cd-8612-f9a45b1d35bc-konnectivity-ca\") pod \"konnectivity-agent-n4pk5\" (UID: \"c4678365-f754-41cd-8612-f9a45b1d35bc\") " pod="kube-system/konnectivity-agent-n4pk5"
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e7475db-35a1-407c-818d-b31ecf085e31-kubelet-config\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:43.668616    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret podName:7e7475db-35a1-407c-818d-b31ecf085e31 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:44.168594821 +0000 UTC m=+3.106903257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret") pod "global-pull-secret-syncer-hmkpw" (UID: "7e7475db-35a1-407c-818d-b31ecf085e31") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e7475db-35a1-407c-818d-b31ecf085e31-kubelet-config\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-run-multus-certs\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:43.668795    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.668794    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3c485314-da7c-4620-9269-882e8072c509-host-run-multus-certs\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:43.668849    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs podName:46a4fa95-e3f4-4b04-a202-4347da90724d nodeName:}" failed. No retries permitted until 2026-07-21 16:23:44.168832761 +0000 UTC m=+3.107141194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs") pod "network-metrics-daemon-k5rhr" (UID: "46a4fa95-e3f4-4b04-a202-4347da90724d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.669771    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4678365-f754-41cd-8612-f9a45b1d35bc-konnectivity-ca\") pod \"konnectivity-agent-n4pk5\" (UID: \"c4678365-f754-41cd-8612-f9a45b1d35bc\") " pod="kube-system/konnectivity-agent-n4pk5"
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.671485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4678365-f754-41cd-8612-f9a45b1d35bc-agent-certs\") pod \"konnectivity-agent-n4pk5\" (UID: \"c4678365-f754-41cd-8612-f9a45b1d35bc\") " pod="kube-system/konnectivity-agent-n4pk5"
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.680013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrjtx\" (UniqueName: \"kubernetes.io/projected/3c485314-da7c-4620-9269-882e8072c509-kube-api-access-hrjtx\") pod \"multus-dnjbm\" (UID: \"3c485314-da7c-4620-9269-882e8072c509\") " pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:43.683203    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:43.683225    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:43.683239    2578 projected.go:196] Error preparing data for projected volume kube-api-access-cvgfw for pod openshift-network-diagnostics/network-check-target-qjfjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:43.764045 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.683294    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddrws\" (UniqueName: \"kubernetes.io/projected/46a4fa95-e3f4-4b04-a202-4347da90724d-kube-api-access-ddrws\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:43.768615 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:43.683301    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw podName:8de47073-6673-4e99-8d86-9149a51a344c nodeName:}" failed. No retries permitted until 2026-07-21 16:23:44.183285025 +0000 UTC m=+3.121593474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cvgfw" (UniqueName: "kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw") pod "network-check-target-qjfjw" (UID: "8de47073-6673-4e99-8d86-9149a51a344c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:43.768615 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.747899    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fvkdn"
Jul 21 16:23:43.768615 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.764821    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d5hwr"
Jul 21 16:23:43.863189 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:43.772430    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af8a8e0_2cf0_4b3d_9f60_b8dd59662990.slice/crio-05a34c0201ab6c8984b18d7303183dd849e52eec36508fd021858decc37aaeca WatchSource:0}: Error finding container 05a34c0201ab6c8984b18d7303183dd849e52eec36508fd021858decc37aaeca: Status 404 returned error can't find the container with id 05a34c0201ab6c8984b18d7303183dd849e52eec36508fd021858decc37aaeca
Jul 21 16:23:43.863189 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.775520    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rf2pk"
Jul 21 16:23:43.863189 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:43.775940    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a6ee03_dce6_4e10_9421_35a60eb69066.slice/crio-24f519d6b44ccba3d8327edb03f24aa6253996d03c5e707f94129bedc890b85b WatchSource:0}: Error finding container 24f519d6b44ccba3d8327edb03f24aa6253996d03c5e707f94129bedc890b85b: Status 404 returned error can't find the container with id 24f519d6b44ccba3d8327edb03f24aa6253996d03c5e707f94129bedc890b85b
Jul 21 16:23:43.863189 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.783891    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:23:43.863189 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.791901    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p9cm5"
Jul 21 16:23:43.863189 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:43.792242    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67587045_0312_4b05_9d5c_9a66a2d6c6ee.slice/crio-c57c436e68f60834035a233f494e4e36e1805126854c2c971a40ffbf8ba0f1d6 WatchSource:0}: Error finding container c57c436e68f60834035a233f494e4e36e1805126854c2c971a40ffbf8ba0f1d6: Status 404 returned error can't find the container with id c57c436e68f60834035a233f494e4e36e1805126854c2c971a40ffbf8ba0f1d6
Jul 21 16:23:43.863189 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.802146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jkq4v"
Jul 21 16:23:43.863189 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:43.804654    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6bf757_0749_4e3c_bbab_3af15a0cf5ea.slice/crio-49dca7fcbe86e13067b58b47be1c752bf962e4770b1e7d8715b5e7dcc1380591 WatchSource:0}: Error finding container 49dca7fcbe86e13067b58b47be1c752bf962e4770b1e7d8715b5e7dcc1380591: Status 404 returned error can't find the container with id 49dca7fcbe86e13067b58b47be1c752bf962e4770b1e7d8715b5e7dcc1380591
Jul 21 16:23:43.863189 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:43.810128    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449f52bf_433c_402e_ba3b_5dd3179bd1a7.slice/crio-474523fa3438f4ec2e1da3169ecbc7b5f187e048a459093e04ab153ff4edb445 WatchSource:0}: Error finding container 474523fa3438f4ec2e1da3169ecbc7b5f187e048a459093e04ab153ff4edb445: Status 404 returned error can't find the container with id 474523fa3438f4ec2e1da3169ecbc7b5f187e048a459093e04ab153ff4edb445
Jul 21 16:23:43.863189 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.812040    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t"
Jul 21 16:23:43.863189 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.821122    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n4pk5"
Jul 21 16:23:43.863189 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:43.828033    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dnjbm"
Jul 21 16:23:44.172285 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:44.172186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:44.172285 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:44.172236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:44.172511 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:44.172331    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:44.172511 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:44.172394    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:44.172511 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:44.172410    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret podName:7e7475db-35a1-407c-818d-b31ecf085e31 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:45.172388347 +0000 UTC m=+4.110696782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret") pod "global-pull-secret-syncer-hmkpw" (UID: "7e7475db-35a1-407c-818d-b31ecf085e31") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:44.172511 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:44.172449    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs podName:46a4fa95-e3f4-4b04-a202-4347da90724d nodeName:}" failed. No retries permitted until 2026-07-21 16:23:45.172435683 +0000 UTC m=+4.110744112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs") pod "network-metrics-daemon-k5rhr" (UID: "46a4fa95-e3f4-4b04-a202-4347da90724d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:44.273130 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:44.273090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvgfw\" (UniqueName: \"kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw\") pod \"network-check-target-qjfjw\" (UID: \"8de47073-6673-4e99-8d86-9149a51a344c\") " pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:44.273313 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:44.273289    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:23:44.273433 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:44.273314    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:23:44.273433 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:44.273329    2578 projected.go:196] Error preparing data for projected volume kube-api-access-cvgfw for pod openshift-network-diagnostics/network-check-target-qjfjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:44.273433 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:44.273405    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw podName:8de47073-6673-4e99-8d86-9149a51a344c nodeName:}" failed. No retries permitted until 2026-07-21 16:23:45.273383183 +0000 UTC m=+4.211691625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cvgfw" (UniqueName: "kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw") pod "network-check-target-qjfjw" (UID: "8de47073-6673-4e99-8d86-9149a51a344c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:44.493587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:44.493461    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:18:43 +0000 UTC" deadline="2028-01-12 04:19:14.191710967 +0000 UTC"
Jul 21 16:23:44.493587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:44.493528    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12947h55m29.698186999s"
Jul 21 16:23:44.576444 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:44.576413    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:44.577191 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:44.576583    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:23:44.601835 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:44.601781    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jkq4v" event={"ID":"449f52bf-433c-402e-ba3b-5dd3179bd1a7","Type":"ContainerStarted","Data":"474523fa3438f4ec2e1da3169ecbc7b5f187e048a459093e04ab153ff4edb445"}
Jul 21 16:23:44.603150 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:44.603121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p9cm5" event={"ID":"6b6bf757-0749-4e3c-bbab-3af15a0cf5ea","Type":"ContainerStarted","Data":"49dca7fcbe86e13067b58b47be1c752bf962e4770b1e7d8715b5e7dcc1380591"}
Jul 21 16:23:44.604639 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:44.604544    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8" event={"ID":"67587045-0312-4b05-9d5c-9a66a2d6c6ee","Type":"ContainerStarted","Data":"c57c436e68f60834035a233f494e4e36e1805126854c2c971a40ffbf8ba0f1d6"}
Jul 21 16:23:44.606021 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:44.605952    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rf2pk" event={"ID":"42ab280b-2f9c-47c6-9cbb-1369eee55ab5","Type":"ContainerStarted","Data":"a036f6f721da258eaeee018f0c23844f1115ea8c7916475bf2a2ef3d05e5d2c5"}
Jul 21 16:23:44.607424 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:44.607396    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d5hwr" event={"ID":"82a6ee03-dce6-4e10-9421-35a60eb69066","Type":"ContainerStarted","Data":"24f519d6b44ccba3d8327edb03f24aa6253996d03c5e707f94129bedc890b85b"}
Jul 21 16:23:44.608679 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:44.608653    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvkdn" event={"ID":"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990","Type":"ContainerStarted","Data":"05a34c0201ab6c8984b18d7303183dd849e52eec36508fd021858decc37aaeca"}
Jul 21 16:23:45.163708 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:23:45.162157    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce4b2cc_cb6c_4f9b_b1d4_327094153be1.slice/crio-ad64ed280c6fb78da95e3f8260959f13543b233dff549ce360d28971ccfa9e47 WatchSource:0}: Error finding container ad64ed280c6fb78da95e3f8260959f13543b233dff549ce360d28971ccfa9e47: Status 404 returned error can't find the container with id ad64ed280c6fb78da95e3f8260959f13543b233dff549ce360d28971ccfa9e47
Jul 21 16:23:45.180185 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:45.180117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:45.180277 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:45.180216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:45.180372 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:45.180353    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:45.180463 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:45.180450    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs podName:46a4fa95-e3f4-4b04-a202-4347da90724d nodeName:}" failed. No retries permitted until 2026-07-21 16:23:47.180426791 +0000 UTC m=+6.118735221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs") pod "network-metrics-daemon-k5rhr" (UID: "46a4fa95-e3f4-4b04-a202-4347da90724d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:45.180581 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:45.180562    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:45.180665 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:45.180613    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret podName:7e7475db-35a1-407c-818d-b31ecf085e31 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:47.180599725 +0000 UTC m=+6.118908153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret") pod "global-pull-secret-syncer-hmkpw" (UID: "7e7475db-35a1-407c-818d-b31ecf085e31") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:45.281158 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:45.280877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvgfw\" (UniqueName: \"kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw\") pod \"network-check-target-qjfjw\" (UID: \"8de47073-6673-4e99-8d86-9149a51a344c\") " pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:45.281158 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:45.281027    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:23:45.281158 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:45.281051    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:23:45.281158 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:45.281064    2578 projected.go:196] Error preparing data for projected volume kube-api-access-cvgfw for pod openshift-network-diagnostics/network-check-target-qjfjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:45.281158 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:45.281114    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw podName:8de47073-6673-4e99-8d86-9149a51a344c nodeName:}" failed. No retries permitted until 2026-07-21 16:23:47.281095599 +0000 UTC m=+6.219404032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cvgfw" (UniqueName: "kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw") pod "network-check-target-qjfjw" (UID: "8de47073-6673-4e99-8d86-9149a51a344c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:45.376485 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:45.376450    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:23:45.494877 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:45.494512    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:18:43 +0000 UTC" deadline="2028-02-17 05:19:53.378396229 +0000 UTC"
Jul 21 16:23:45.494877 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:45.494834    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13812h56m7.883573997s"
Jul 21 16:23:45.579914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:45.579179    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:45.579914 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:45.579313    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:23:45.579914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:45.579754    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:45.579914 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:45.579852    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:23:45.619957 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:45.619920    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n4pk5" event={"ID":"c4678365-f754-41cd-8612-f9a45b1d35bc","Type":"ContainerStarted","Data":"8dc86ba257409d071b7d153790b0dfc34a4e4112c5891d36444af9679a379d33"}
Jul 21 16:23:45.628286 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:45.627531    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal" event={"ID":"27f23970c7fcce5fec0df5f62c34e32e","Type":"ContainerStarted","Data":"ce4587eb8a1398d992001fe46e4ebecd8c037885896a61d3cd35f7f643d843bf"}
Jul 21 16:23:45.630992 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:45.630963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dnjbm" event={"ID":"3c485314-da7c-4620-9269-882e8072c509","Type":"ContainerStarted","Data":"dccd2a71969168c1f277e0518f5d40c92e29ff183f4e6f9646ca6efc6a613c13"}
Jul 21 16:23:45.634986 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:45.634902    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t" event={"ID":"cce4b2cc-cb6c-4f9b-b1d4-327094153be1","Type":"ContainerStarted","Data":"ad64ed280c6fb78da95e3f8260959f13543b233dff549ce360d28971ccfa9e47"}
Jul 21 16:23:46.577416 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:46.577236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:46.577416 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:46.577400    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:23:46.645864 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:46.645781    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal" event={"ID":"adf8b0f8519398aa8893cd3ca93d26bc","Type":"ContainerStarted","Data":"281e179c2d8aaa86a378658411fb531bef91c8006621d49b92479e0c560cc974"}
Jul 21 16:23:46.662901 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:46.661735    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal" podStartSLOduration=3.661716858 podStartE2EDuration="3.661716858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:23:45.644888355 +0000 UTC m=+4.583196808" watchObservedRunningTime="2026-07-21 16:23:46.661716858 +0000 UTC m=+5.600025310"
Jul 21 16:23:47.198174 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:47.197260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:47.198174 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:47.197316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:47.198174 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:47.197492    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:47.198174 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:47.197554    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs podName:46a4fa95-e3f4-4b04-a202-4347da90724d nodeName:}" failed. No retries permitted until 2026-07-21 16:23:51.197535231 +0000 UTC m=+10.135843665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs") pod "network-metrics-daemon-k5rhr" (UID: "46a4fa95-e3f4-4b04-a202-4347da90724d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:47.198174 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:47.198078    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:47.198174 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:47.198134    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret podName:7e7475db-35a1-407c-818d-b31ecf085e31 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:51.19811684 +0000 UTC m=+10.136425283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret") pod "global-pull-secret-syncer-hmkpw" (UID: "7e7475db-35a1-407c-818d-b31ecf085e31") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:47.298820 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:47.298072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvgfw\" (UniqueName: \"kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw\") pod \"network-check-target-qjfjw\" (UID: \"8de47073-6673-4e99-8d86-9149a51a344c\") " pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:47.298820 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:47.298283    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:23:47.298820 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:47.298308    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:23:47.298820 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:47.298322    2578 projected.go:196] Error preparing data for projected volume kube-api-access-cvgfw for pod openshift-network-diagnostics/network-check-target-qjfjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:47.298820 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:47.298382    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw podName:8de47073-6673-4e99-8d86-9149a51a344c nodeName:}" failed. No retries permitted until 2026-07-21 16:23:51.298364353 +0000 UTC m=+10.236672797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cvgfw" (UniqueName: "kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw") pod "network-check-target-qjfjw" (UID: "8de47073-6673-4e99-8d86-9149a51a344c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:47.578682 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:47.577196    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:47.578682 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:47.577314    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:23:47.578682 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:47.577365    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:47.578682 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:47.577476    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:23:48.576870 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:48.576837    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:48.577362 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:48.576970    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:23:48.652249 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:48.652176    2578 generic.go:356] "Generic (PLEG): container finished" podID="adf8b0f8519398aa8893cd3ca93d26bc" containerID="281e179c2d8aaa86a378658411fb531bef91c8006621d49b92479e0c560cc974" exitCode=0
Jul 21 16:23:48.652249 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:48.652234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal" event={"ID":"adf8b0f8519398aa8893cd3ca93d26bc","Type":"ContainerDied","Data":"281e179c2d8aaa86a378658411fb531bef91c8006621d49b92479e0c560cc974"}
Jul 21 16:23:49.577246 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:49.577210    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:49.577737 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:49.577342    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:23:49.577737 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:49.577209    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:49.577737 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:49.577447    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:23:50.576769 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:50.576691    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:50.576924 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:50.576839    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:23:51.232477 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:51.232425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:51.233000 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:51.232539    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:51.233000 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:51.232677    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:51.233000 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:51.232744    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:51.233000 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:51.232803    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs podName:46a4fa95-e3f4-4b04-a202-4347da90724d nodeName:}" failed. No retries permitted until 2026-07-21 16:23:59.232783079 +0000 UTC m=+18.171091508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs") pod "network-metrics-daemon-k5rhr" (UID: "46a4fa95-e3f4-4b04-a202-4347da90724d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:51.233184 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:51.233035    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret podName:7e7475db-35a1-407c-818d-b31ecf085e31 nodeName:}" failed. No retries permitted until 2026-07-21 16:23:59.233009991 +0000 UTC m=+18.171318433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret") pod "global-pull-secret-syncer-hmkpw" (UID: "7e7475db-35a1-407c-818d-b31ecf085e31") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:51.334445 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:51.333760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvgfw\" (UniqueName: \"kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw\") pod \"network-check-target-qjfjw\" (UID: \"8de47073-6673-4e99-8d86-9149a51a344c\") " pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:51.334445 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:51.333967    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:23:51.334445 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:51.333987    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:23:51.334445 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:51.334000    2578 projected.go:196] Error preparing data for projected volume kube-api-access-cvgfw for pod openshift-network-diagnostics/network-check-target-qjfjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:51.334445 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:51.334082    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw podName:8de47073-6673-4e99-8d86-9149a51a344c nodeName:}" failed. No retries permitted until 2026-07-21 16:23:59.334040702 +0000 UTC m=+18.272349133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cvgfw" (UniqueName: "kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw") pod "network-check-target-qjfjw" (UID: "8de47073-6673-4e99-8d86-9149a51a344c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:51.577075 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:51.577002    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:51.577075 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:51.577004    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:51.578194 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:51.578160    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:23:51.578300 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:51.578279    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:23:52.576657 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:52.576611    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:52.577086 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:52.576754    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:23:53.577106 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:53.577070    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:53.577608 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:53.577211    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:23:53.577608 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:53.577392    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:53.577608 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:53.577481    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:23:54.576955 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:54.576925    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:54.577126 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:54.577047    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:23:55.576951 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:55.576869    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:55.577362 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:55.577018    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:23:55.577362 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:55.577062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:55.577362 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:55.577181    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:23:56.576843 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:56.576811    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:56.576998 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:56.576935    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:23:57.576414 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:57.576381    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:57.576414 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:57.576399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:57.576661 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:57.576509    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:23:57.576661 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:57.576633    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:23:58.577044 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:58.577012    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:58.577466 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:58.577129    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:23:59.296772 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:59.296684    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:59.296772 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:59.296729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:23:59.296983 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:59.296847    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:59.296983 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:59.296850    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:59.296983 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:59.296907    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs podName:46a4fa95-e3f4-4b04-a202-4347da90724d nodeName:}" failed. No retries permitted until 2026-07-21 16:24:15.296889484 +0000 UTC m=+34.235197925 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs") pod "network-metrics-daemon-k5rhr" (UID: "46a4fa95-e3f4-4b04-a202-4347da90724d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:23:59.296983 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:59.296925    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret podName:7e7475db-35a1-407c-818d-b31ecf085e31 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:15.296915642 +0000 UTC m=+34.235224070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret") pod "global-pull-secret-syncer-hmkpw" (UID: "7e7475db-35a1-407c-818d-b31ecf085e31") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:23:59.397852 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:59.397823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvgfw\" (UniqueName: \"kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw\") pod \"network-check-target-qjfjw\" (UID: \"8de47073-6673-4e99-8d86-9149a51a344c\") " pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:59.398028 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:59.398010    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:23:59.398087 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:59.398034    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:23:59.398087 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:59.398043    2578 projected.go:196] Error preparing data for projected volume kube-api-access-cvgfw for pod openshift-network-diagnostics/network-check-target-qjfjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:59.398194 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:59.398090    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw podName:8de47073-6673-4e99-8d86-9149a51a344c nodeName:}" failed. No retries permitted until 2026-07-21 16:24:15.398075297 +0000 UTC m=+34.336383722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cvgfw" (UniqueName: "kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw") pod "network-check-target-qjfjw" (UID: "8de47073-6673-4e99-8d86-9149a51a344c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:23:59.576695 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:59.576602    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:23:59.576695 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:23:59.576651    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:23:59.576906 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:59.576728    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:23:59.576906 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:23:59.576859    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:24:00.577293 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:00.577257    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:24:00.577838 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:00.577400    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:24:01.577315 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:01.577285    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:24:01.577749 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:01.577373    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:24:01.577749 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:01.577492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:24:01.577749 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:01.577588    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:24:02.577259 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:02.577224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:24:02.577426 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:02.577346    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:24:03.585653 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:03.583622    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:24:03.585653 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:03.583953    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:24:03.585653 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:03.583729    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:24:03.585653 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:03.584059    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:24:03.682489 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:03.682427    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p9cm5" event={"ID":"6b6bf757-0749-4e3c-bbab-3af15a0cf5ea","Type":"ContainerStarted","Data":"ca933128476316a41cdcb27414f82b714c72bb697986b658f79b13eb156e8e26"}
Jul 21 16:24:03.684099 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:03.684002    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8" event={"ID":"67587045-0312-4b05-9d5c-9a66a2d6c6ee","Type":"ContainerStarted","Data":"70401eb6ab47a638a5042932d3bf9868dde0200e1d322bfbd5c83eabb16a5eb9"}
Jul 21 16:24:03.687262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:03.687233    2578 generic.go:356] "Generic (PLEG): container finished" podID="5af8a8e0-2cf0-4b3d-9f60-b8dd59662990" containerID="c32d79130e5a473afbc03330c5d0d5f4548c3ae5fe2779b7b34aae7541f88deb" exitCode=0
Jul 21 16:24:03.687343 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:03.687308    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvkdn" event={"ID":"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990","Type":"ContainerDied","Data":"c32d79130e5a473afbc03330c5d0d5f4548c3ae5fe2779b7b34aae7541f88deb"}
Jul 21 16:24:03.689259 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:03.689234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n4pk5" event={"ID":"c4678365-f754-41cd-8612-f9a45b1d35bc","Type":"ContainerStarted","Data":"375bd71a1411f206ca1c618d0b4146979ed68a90da971ffffcdf035ec9f22961"}
Jul 21 16:24:03.691109 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:03.691087    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal" event={"ID":"adf8b0f8519398aa8893cd3ca93d26bc","Type":"ContainerStarted","Data":"f4e28d336bb8d722abd5452d229e09514bb963d92635f313ddca50de9247108a"}
Jul 21 16:24:03.697049 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:03.697007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rf2pk" event={"ID":"42ab280b-2f9c-47c6-9cbb-1369eee55ab5","Type":"ContainerStarted","Data":"3f6791e8835f4fdadf14c90689139323c1b18061c20ca188c9512a3b05f59800"}
Jul 21 16:24:03.699388 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:03.699365    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t" event={"ID":"cce4b2cc-cb6c-4f9b-b1d4-327094153be1","Type":"ContainerStarted","Data":"d90af3af44f5d7a7e17bbe5e1b419547641ddb2e77a9f5fa0a9adeee41eabb9d"}
Jul 21 16:24:03.711561 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:03.711513    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p9cm5" podStartSLOduration=2.157237935 podStartE2EDuration="21.711499661s" totalImagesPullingTime="19.554261726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:03.70978581 +0000 UTC m=+22.648094265" watchObservedRunningTime="2026-07-21 16:24:03.711499661 +0000 UTC m=+22.649808108"
Jul 21 16:24:03.744528 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:03.744489    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal" podStartSLOduration=20.744473857 podStartE2EDuration="20.744473857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:03.74447432 +0000 UTC m=+22.682782767" watchObservedRunningTime="2026-07-21 16:24:03.744473857 +0000 UTC m=+22.682782299"
Jul 21 16:24:03.744884 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:03.744836    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n4pk5" podStartSLOduration=3.5136660170000003 podStartE2EDuration="21.744829178s" totalImagesPullingTime="18.231163161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:03.728659915 +0000 UTC m=+22.666968355" watchObservedRunningTime="2026-07-21 16:24:03.744829178 +0000 UTC m=+22.683137625"
Jul 21 16:24:03.791305 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:03.791260    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rf2pk" podStartSLOduration=2.169099177 podStartE2EDuration="21.791245188s" totalImagesPullingTime="19.622146011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:03.790921576 +0000 UTC m=+22.729230023" watchObservedRunningTime="2026-07-21 16:24:03.791245188 +0000 UTC m=+22.729553636"
Jul 21 16:24:04.576690 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:04.576661    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:24:04.576856 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:04.576768    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:24:04.703176 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:04.703144    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jkq4v" event={"ID":"449f52bf-433c-402e-ba3b-5dd3179bd1a7","Type":"ContainerStarted","Data":"d45fca8e8173bb72f73e76d1da86f175f5fccbdcee62a1e7561d7dcab7dbd794"}
Jul 21 16:24:04.705743 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:04.705244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dnjbm" event={"ID":"3c485314-da7c-4620-9269-882e8072c509","Type":"ContainerStarted","Data":"7fa8a012c33be0ca7d9e32365ff11571e3d6b777b6d689c1f233f19c9b9a2d82"}
Jul 21 16:24:04.713998 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:04.713968    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8" event={"ID":"67587045-0312-4b05-9d5c-9a66a2d6c6ee","Type":"ContainerStarted","Data":"b1e7d5d162ac80ba9da6ed5952e92294b726f68fa54b6e8e618bce3618285f13"}
Jul 21 16:24:04.714084 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:04.714073    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8" event={"ID":"67587045-0312-4b05-9d5c-9a66a2d6c6ee","Type":"ContainerStarted","Data":"446eb1d633b7aafb2e01eaeb026213364cc6bb74d31ee9aaf42375ac4a8c001b"}
Jul 21 16:24:04.714160 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:04.714115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8" event={"ID":"67587045-0312-4b05-9d5c-9a66a2d6c6ee","Type":"ContainerStarted","Data":"40c47aef544bd3fa5e3affaee9b72c7a49a21917f72d80bd523de556f8590e39"}
Jul 21 16:24:04.714160 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:04.714155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8" event={"ID":"67587045-0312-4b05-9d5c-9a66a2d6c6ee","Type":"ContainerStarted","Data":"81ea708b393942e8f2ee063c2b800c4662f8a2ca661baa850b871cec0294fd4e"}
Jul 21 16:24:04.714267 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:04.714193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8" event={"ID":"67587045-0312-4b05-9d5c-9a66a2d6c6ee","Type":"ContainerStarted","Data":"cde333f0a9745f86bb5f83888e32c39892602580224c734cd3ee2e8e2b32f0c9"}
Jul 21 16:24:04.715653 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:04.715608    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d5hwr" event={"ID":"82a6ee03-dce6-4e10-9421-35a60eb69066","Type":"ContainerStarted","Data":"c5bb9d4a6002ddf231fb7980b475ee7014ecaa005de569f513738161bd8b1e63"}
Jul 21 16:24:04.719554 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:04.719517    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jkq4v" podStartSLOduration=3.121391526 podStartE2EDuration="22.719505408s" totalImagesPullingTime="19.598113882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:04.719229889 +0000 UTC m=+23.657538338" watchObservedRunningTime="2026-07-21 16:24:04.719505408 +0000 UTC m=+23.657813856"
Jul 21 16:24:04.755429 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:04.755380    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dnjbm" podStartSLOduration=4.3423528860000005 podStartE2EDuration="22.75535998s" totalImagesPullingTime="18.413007094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:04.755081236 +0000 UTC m=+23.693389684" watchObservedRunningTime="2026-07-21 16:24:04.75535998 +0000 UTC m=+23.693668430"
Jul 21 16:24:04.755804 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:04.755775    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d5hwr" podStartSLOduration=3.1224372049999998 podStartE2EDuration="22.755768646s" totalImagesPullingTime="19.633331441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:04.733625246 +0000 UTC m=+23.671933694" watchObservedRunningTime="2026-07-21 16:24:04.755768646 +0000 UTC m=+23.694077093"
Jul 21 16:24:04.816154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:04.816127    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 16:24:05.317153 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:05.317122    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n4pk5"
Jul 21 16:24:05.317913 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:05.317889    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n4pk5"
Jul 21 16:24:05.538395 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:05.538279    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T16:24:04.816151056Z","UUID":"afcee9a0-2ca0-4990-8b0c-f8c8575cc381","Handler":null,"Name":"","Endpoint":""}
Jul 21 16:24:05.539770 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:05.539736    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 16:24:05.539884 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:05.539782    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 16:24:05.577203 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:05.577134    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:24:05.577203 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:05.577159    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:24:05.577382 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:05.577262    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:24:05.577435 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:05.577386    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:24:05.720149 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:05.720110    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t" event={"ID":"cce4b2cc-cb6c-4f9b-b1d4-327094153be1","Type":"ContainerStarted","Data":"bc926cb2ac9a3af0316d6d488a600540d195c85d56be05223cc47b1307ab8857"}
Jul 21 16:24:05.720720 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:05.720695    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n4pk5"
Jul 21 16:24:05.721049 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:05.721031    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n4pk5"
Jul 21 16:24:06.576848 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:06.576780    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:24:06.576998 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:06.576900    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:24:06.725073 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:06.725033    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t" event={"ID":"cce4b2cc-cb6c-4f9b-b1d4-327094153be1","Type":"ContainerStarted","Data":"ff81465fa6aa82be38bf771e52493695f09a2c2e2e9df18eec49549088ce5a06"}
Jul 21 16:24:06.731936 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:06.731908    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8" event={"ID":"67587045-0312-4b05-9d5c-9a66a2d6c6ee","Type":"ContainerStarted","Data":"dd4da2e241260a6a8d7577c1184d11901b3b2a53d9c552ab7cb3e3f2ba591115"}
Jul 21 16:24:06.743469 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:06.743422    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fh2t" podStartSLOduration=4.506164435 podStartE2EDuration="24.743404035s" totalImagesPullingTime="20.2372396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:06.742897805 +0000 UTC m=+25.681206254" watchObservedRunningTime="2026-07-21 16:24:06.743404035 +0000 UTC m=+25.681712483"
Jul 21 16:24:07.577334 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:07.577114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:24:07.577523 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:07.577155    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:24:07.577523 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:07.577446    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:24:07.577523 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:07.577491    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:24:08.576433 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:08.576411    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:24:08.576921 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:08.576530    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:24:08.738307 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:08.738269    2578 generic.go:356] "Generic (PLEG): container finished" podID="5af8a8e0-2cf0-4b3d-9f60-b8dd59662990" containerID="0ecd10efac5e7de2efd50cef8f7c8e4c77d5010ebb5d79c8fef641bd60924901" exitCode=0
Jul 21 16:24:08.738447 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:08.738357    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvkdn" event={"ID":"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990","Type":"ContainerDied","Data":"0ecd10efac5e7de2efd50cef8f7c8e4c77d5010ebb5d79c8fef641bd60924901"}
Jul 21 16:24:08.742141 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:08.742115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8" event={"ID":"67587045-0312-4b05-9d5c-9a66a2d6c6ee","Type":"ContainerStarted","Data":"6e7963f760f4366c9937bc02ce6353eccaf9f8953d6d429f453ed571bf804ebe"}
Jul 21 16:24:08.742577 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:08.742532    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:24:08.742707 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:08.742609    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:24:08.742707 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:08.742673    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:24:08.758081 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:08.757890    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:24:08.758342 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:08.758326    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:24:08.793033 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:08.792992    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8" podStartSLOduration=7.10450743 podStartE2EDuration="26.792978083s" totalImagesPullingTime="19.688470653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:08.791531536 +0000 UTC m=+27.729839974" watchObservedRunningTime="2026-07-21 16:24:08.792978083 +0000 UTC m=+27.731286531"
Jul 21 16:24:09.576764 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:09.576733    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:24:09.577354 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:09.576834    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:24:09.577354 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:09.576862    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:24:09.577354 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:09.576916    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:24:10.502503 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:10.502414    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hmkpw"]
Jul 21 16:24:10.502708 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:10.502521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:24:10.502708 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:10.502609    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:24:10.505230 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:10.505203    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qjfjw"]
Jul 21 16:24:10.505330 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:10.505297    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:24:10.505397 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:10.505380    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:24:10.513743 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:10.513720    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k5rhr"]
Jul 21 16:24:10.513857 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:10.513821    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:24:10.513942 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:10.513925    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:24:10.748296 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:10.748262    2578 generic.go:356] "Generic (PLEG): container finished" podID="5af8a8e0-2cf0-4b3d-9f60-b8dd59662990" containerID="dc98af80f281fd99ce334711a5954f17fe45f6489c18ed28d79173adb0335bc0" exitCode=0
Jul 21 16:24:10.748777 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:10.748339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvkdn" event={"ID":"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990","Type":"ContainerDied","Data":"dc98af80f281fd99ce334711a5954f17fe45f6489c18ed28d79173adb0335bc0"}
Jul 21 16:24:12.576423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:12.576236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:24:12.576822 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:12.576292    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:24:12.576822 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:12.576520    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:24:12.576822 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:12.576572    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:24:12.576822 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:12.576292    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:24:12.576822 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:12.576692    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:24:12.754693 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:12.754664    2578 generic.go:356] "Generic (PLEG): container finished" podID="5af8a8e0-2cf0-4b3d-9f60-b8dd59662990" containerID="3f47c70410eb77fb775d1c7e1d8aba5d630bd34862526cc0a603ed445f19d197" exitCode=0
Jul 21 16:24:12.754840 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:12.754706    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvkdn" event={"ID":"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990","Type":"ContainerDied","Data":"3f47c70410eb77fb775d1c7e1d8aba5d630bd34862526cc0a603ed445f19d197"}
Jul 21 16:24:14.577149 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:14.577112    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:24:14.577805 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:14.577222    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:24:14.577805 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:14.577224    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjfjw" podUID="8de47073-6673-4e99-8d86-9149a51a344c"
Jul 21 16:24:14.577805 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:14.577231    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:24:14.577805 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:14.577351    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:24:14.577805 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:14.577432    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmkpw" podUID="7e7475db-35a1-407c-818d-b31ecf085e31"
Jul 21 16:24:15.309844 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:15.309813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:24:15.310019 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:15.309913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:24:15.310019 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:15.309996    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:24:15.310019 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:15.309996    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:24:15.310148 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:15.310057    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret podName:7e7475db-35a1-407c-818d-b31ecf085e31 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:47.31004372 +0000 UTC m=+66.248352146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret") pod "global-pull-secret-syncer-hmkpw" (UID: "7e7475db-35a1-407c-818d-b31ecf085e31") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:24:15.310148 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:15.310072    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs podName:46a4fa95-e3f4-4b04-a202-4347da90724d nodeName:}" failed. No retries permitted until 2026-07-21 16:24:47.310065829 +0000 UTC m=+66.248374254 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs") pod "network-metrics-daemon-k5rhr" (UID: "46a4fa95-e3f4-4b04-a202-4347da90724d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:24:15.410384 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:15.410347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvgfw\" (UniqueName: \"kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw\") pod \"network-check-target-qjfjw\" (UID: \"8de47073-6673-4e99-8d86-9149a51a344c\") " pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:24:15.410573 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:15.410534    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:24:15.410573 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:15.410557    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:24:15.410573 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:15.410571    2578 projected.go:196] Error preparing data for projected volume kube-api-access-cvgfw for pod openshift-network-diagnostics/network-check-target-qjfjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:24:15.410762 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:15.410655    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw podName:8de47073-6673-4e99-8d86-9149a51a344c nodeName:}" failed. No retries permitted until 2026-07-21 16:24:47.410618139 +0000 UTC m=+66.348926582 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cvgfw" (UniqueName: "kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw") pod "network-check-target-qjfjw" (UID: "8de47073-6673-4e99-8d86-9149a51a344c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:24:16.336092 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.336017    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeReady"
Jul 21 16:24:16.336664 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.336174    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 16:24:16.377088 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.377058    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kwf4m"]
Jul 21 16:24:16.409004 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.408976    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6xqhs"]
Jul 21 16:24:16.409169 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.409109    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:16.411485 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.411445    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kwsf5\""
Jul 21 16:24:16.411625 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.411454    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 16:24:16.411625 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.411453    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 16:24:16.433059 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.433035    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kwf4m"]
Jul 21 16:24:16.433167 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.433065    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6xqhs"]
Jul 21 16:24:16.433222 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.433162    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6xqhs"
Jul 21 16:24:16.435446 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.435424    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 16:24:16.435548 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.435473    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 16:24:16.435548 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.435486    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 16:24:16.435741 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.435717    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4tvjl\""
Jul 21 16:24:16.521714 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.521683    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87pkj\" (UniqueName: \"kubernetes.io/projected/036bafe7-16e7-414a-ba6b-743635dd7852-kube-api-access-87pkj\") pod \"ingress-canary-6xqhs\" (UID: \"036bafe7-16e7-414a-ba6b-743635dd7852\") " pod="openshift-ingress-canary/ingress-canary-6xqhs"
Jul 21 16:24:16.521898 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.521738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-tmp-dir\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:16.521898 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.521777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgppg\" (UniqueName: \"kubernetes.io/projected/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-kube-api-access-bgppg\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:16.521898 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.521847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-config-volume\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:16.521898 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.521878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:16.522106 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.521900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/036bafe7-16e7-414a-ba6b-743635dd7852-cert\") pod \"ingress-canary-6xqhs\" (UID: \"036bafe7-16e7-414a-ba6b-743635dd7852\") " pod="openshift-ingress-canary/ingress-canary-6xqhs"
Jul 21 16:24:16.576758 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.576726    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:24:16.576919 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.576726    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:24:16.576919 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.576725    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:24:16.579520 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.579490    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mwzzh\""
Jul 21 16:24:16.579678 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.579536    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 16:24:16.579678 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.579606    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 16:24:16.579678 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.579609    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 16:24:16.579841 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.579780    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 16:24:16.580020 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.580004    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxwcv\""
Jul 21 16:24:16.622959 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.622932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgppg\" (UniqueName: \"kubernetes.io/projected/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-kube-api-access-bgppg\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:16.623095 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.622974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-config-volume\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:16.623095 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.622992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:16.623095 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.623008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/036bafe7-16e7-414a-ba6b-743635dd7852-cert\") pod \"ingress-canary-6xqhs\" (UID: \"036bafe7-16e7-414a-ba6b-743635dd7852\") " pod="openshift-ingress-canary/ingress-canary-6xqhs"
Jul 21 16:24:16.623095 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.623049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87pkj\" (UniqueName: \"kubernetes.io/projected/036bafe7-16e7-414a-ba6b-743635dd7852-kube-api-access-87pkj\") pod \"ingress-canary-6xqhs\" (UID: \"036bafe7-16e7-414a-ba6b-743635dd7852\") " pod="openshift-ingress-canary/ingress-canary-6xqhs"
Jul 21 16:24:16.623295 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.623100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-tmp-dir\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:16.623295 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:16.623107    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:24:16.623295 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:16.623170    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls podName:31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:17.123150312 +0000 UTC m=+36.061458743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls") pod "dns-default-kwf4m" (UID: "31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3") : secret "dns-default-metrics-tls" not found
Jul 21 16:24:16.623437 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.623391    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-tmp-dir\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:16.623677 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.623655    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-config-volume\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:16.627856 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.627834    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/036bafe7-16e7-414a-ba6b-743635dd7852-cert\") pod \"ingress-canary-6xqhs\" (UID: \"036bafe7-16e7-414a-ba6b-743635dd7852\") " pod="openshift-ingress-canary/ingress-canary-6xqhs"
Jul 21 16:24:16.631007 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.630985    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgppg\" (UniqueName: \"kubernetes.io/projected/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-kube-api-access-bgppg\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:16.631113 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.630989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87pkj\" (UniqueName: \"kubernetes.io/projected/036bafe7-16e7-414a-ba6b-743635dd7852-kube-api-access-87pkj\") pod \"ingress-canary-6xqhs\" (UID: \"036bafe7-16e7-414a-ba6b-743635dd7852\") " pod="openshift-ingress-canary/ingress-canary-6xqhs"
Jul 21 16:24:16.742685 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.742653    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6xqhs"
Jul 21 16:24:16.961928 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:16.961896    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6xqhs"]
Jul 21 16:24:16.991656 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:24:16.991604    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod036bafe7_16e7_414a_ba6b_743635dd7852.slice/crio-b0a08b58daae0a11eb9a110e5031ee3fdd6a0ba9e7d76eff4254383a840cdd65 WatchSource:0}: Error finding container b0a08b58daae0a11eb9a110e5031ee3fdd6a0ba9e7d76eff4254383a840cdd65: Status 404 returned error can't find the container with id b0a08b58daae0a11eb9a110e5031ee3fdd6a0ba9e7d76eff4254383a840cdd65
Jul 21 16:24:17.129431 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:17.126715    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:17.129431 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:17.126937    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:24:17.129431 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:17.127058    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls podName:31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:18.127022477 +0000 UTC m=+37.065330926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls") pod "dns-default-kwf4m" (UID: "31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3") : secret "dns-default-metrics-tls" not found
Jul 21 16:24:17.768460 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:17.768417    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6xqhs" event={"ID":"036bafe7-16e7-414a-ba6b-743635dd7852","Type":"ContainerStarted","Data":"b0a08b58daae0a11eb9a110e5031ee3fdd6a0ba9e7d76eff4254383a840cdd65"}
Jul 21 16:24:17.771542 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:17.771514    2578 generic.go:356] "Generic (PLEG): container finished" podID="5af8a8e0-2cf0-4b3d-9f60-b8dd59662990" containerID="859c4dc5e773b288dd93d7f8bcc82825875ad21acf06706bfe9dfe221707161c" exitCode=0
Jul 21 16:24:17.771691 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:17.771556    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvkdn" event={"ID":"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990","Type":"ContainerDied","Data":"859c4dc5e773b288dd93d7f8bcc82825875ad21acf06706bfe9dfe221707161c"}
Jul 21 16:24:18.135427 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:18.135392    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:18.135606 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:18.135534    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:24:18.135700 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:18.135623    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls podName:31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:20.135603154 +0000 UTC m=+39.073911597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls") pod "dns-default-kwf4m" (UID: "31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3") : secret "dns-default-metrics-tls" not found
Jul 21 16:24:18.777885 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:18.777839    2578 generic.go:356] "Generic (PLEG): container finished" podID="5af8a8e0-2cf0-4b3d-9f60-b8dd59662990" containerID="68e796492856076c03b35beb55bd8e2eef33f46b4ebebac9ca2176de0cee2e9f" exitCode=0
Jul 21 16:24:18.777885 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:18.777886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvkdn" event={"ID":"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990","Type":"ContainerDied","Data":"68e796492856076c03b35beb55bd8e2eef33f46b4ebebac9ca2176de0cee2e9f"}
Jul 21 16:24:19.782160 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:19.781907    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6xqhs" event={"ID":"036bafe7-16e7-414a-ba6b-743635dd7852","Type":"ContainerStarted","Data":"e673027e9984fe36279403390a1aec9503966b1afb2e10183f4cb390ea88735a"}
Jul 21 16:24:19.784896 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:19.784869    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvkdn" event={"ID":"5af8a8e0-2cf0-4b3d-9f60-b8dd59662990","Type":"ContainerStarted","Data":"636e805bacffd31737838e3e55433a9686decd7c2173007e6cf36c143b538753"}
Jul 21 16:24:19.797888 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:19.797832    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6xqhs" podStartSLOduration=1.647374649 podStartE2EDuration="3.797813961s" totalImagesPullingTime="2.150439312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:19.797503804 +0000 UTC m=+38.735812251" watchObservedRunningTime="2026-07-21 16:24:19.797813961 +0000 UTC m=+38.736122410"
Jul 21 16:24:19.829571 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:19.829529    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fvkdn" podStartSLOduration=11.75171416 podStartE2EDuration="37.829513922s" totalImagesPullingTime="26.077799762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:19.827482983 +0000 UTC m=+38.765791433" watchObservedRunningTime="2026-07-21 16:24:19.829513922 +0000 UTC m=+38.767822371"
Jul 21 16:24:20.150458 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:20.150419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:20.150582 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:20.150489    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:24:20.150582 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:20.150571    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls podName:31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:24.150553031 +0000 UTC m=+43.088861475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls") pod "dns-default-kwf4m" (UID: "31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3") : secret "dns-default-metrics-tls" not found
Jul 21 16:24:24.181399 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:24.181365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:24.181794 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:24.181503    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:24:24.181794 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:24.181571    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls podName:31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:32.181555698 +0000 UTC m=+51.119864124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls") pod "dns-default-kwf4m" (UID: "31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3") : secret "dns-default-metrics-tls" not found
Jul 21 16:24:32.230549 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:32.230515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:32.231024 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:32.230632    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:24:32.231024 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:32.230696    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls podName:31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:48.230682069 +0000 UTC m=+67.168990495 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls") pod "dns-default-kwf4m" (UID: "31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3") : secret "dns-default-metrics-tls" not found
Jul 21 16:24:40.759692 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:40.759658    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rlhd8"
Jul 21 16:24:47.333256 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.333201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:24:47.333256 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.333256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:24:47.335678 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.335656    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 16:24:47.335726 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.335659    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 16:24:47.343646 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:47.343616    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 16:24:47.343692 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:47.343684    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs podName:46a4fa95-e3f4-4b04-a202-4347da90724d nodeName:}" failed. No retries permitted until 2026-07-21 16:25:51.343669976 +0000 UTC m=+130.281978405 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs") pod "network-metrics-daemon-k5rhr" (UID: "46a4fa95-e3f4-4b04-a202-4347da90724d") : secret "metrics-daemon-secret" not found
Jul 21 16:24:47.347357 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.347341    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e7475db-35a1-407c-818d-b31ecf085e31-original-pull-secret\") pod \"global-pull-secret-syncer-hmkpw\" (UID: \"7e7475db-35a1-407c-818d-b31ecf085e31\") " pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:24:47.434184 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.434127    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvgfw\" (UniqueName: \"kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw\") pod \"network-check-target-qjfjw\" (UID: \"8de47073-6673-4e99-8d86-9149a51a344c\") " pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:24:47.436768 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.436752    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 16:24:47.446762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.446743    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 16:24:47.456851 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.456831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvgfw\" (UniqueName: \"kubernetes.io/projected/8de47073-6673-4e99-8d86-9149a51a344c-kube-api-access-cvgfw\") pod \"network-check-target-qjfjw\" (UID: \"8de47073-6673-4e99-8d86-9149a51a344c\") " pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:24:47.496890 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.496868    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxwcv\""
Jul 21 16:24:47.500579 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.500566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmkpw"
Jul 21 16:24:47.505516 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.505496    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:24:47.646490 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.646452    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hmkpw"]
Jul 21 16:24:47.649675 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:24:47.649633    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e7475db_35a1_407c_818d_b31ecf085e31.slice/crio-25de567acf28523671cd945fa469f34b3b8a5798e9b34773442703dbb268005c WatchSource:0}: Error finding container 25de567acf28523671cd945fa469f34b3b8a5798e9b34773442703dbb268005c: Status 404 returned error can't find the container with id 25de567acf28523671cd945fa469f34b3b8a5798e9b34773442703dbb268005c
Jul 21 16:24:47.663346 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.663323    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qjfjw"]
Jul 21 16:24:47.666075 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:24:47.666054    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de47073_6673_4e99_8d86_9149a51a344c.slice/crio-86ca5ef61a4213af1479dbcafceda456fb8282404cdf196b6bd6e43845b06c97 WatchSource:0}: Error finding container 86ca5ef61a4213af1479dbcafceda456fb8282404cdf196b6bd6e43845b06c97: Status 404 returned error can't find the container with id 86ca5ef61a4213af1479dbcafceda456fb8282404cdf196b6bd6e43845b06c97
Jul 21 16:24:47.849135 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.849094    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qjfjw" event={"ID":"8de47073-6673-4e99-8d86-9149a51a344c","Type":"ContainerStarted","Data":"86ca5ef61a4213af1479dbcafceda456fb8282404cdf196b6bd6e43845b06c97"}
Jul 21 16:24:47.850125 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:47.850103    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hmkpw" event={"ID":"7e7475db-35a1-407c-818d-b31ecf085e31","Type":"ContainerStarted","Data":"25de567acf28523671cd945fa469f34b3b8a5798e9b34773442703dbb268005c"}
Jul 21 16:24:48.239587 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:48.239554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:24:48.239767 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:48.239692    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:24:48.239767 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:24:48.239750    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls podName:31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:20.239731656 +0000 UTC m=+99.178040087 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls") pod "dns-default-kwf4m" (UID: "31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3") : secret "dns-default-metrics-tls" not found
Jul 21 16:24:52.864328 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:52.864296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qjfjw" event={"ID":"8de47073-6673-4e99-8d86-9149a51a344c","Type":"ContainerStarted","Data":"949bb76c1ea6b7387d196899aa5a26393f694b601938428a610b1f0d0e61d0d7"}
Jul 21 16:24:52.864732 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:52.864394    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:24:52.865941 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:52.865915    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hmkpw" event={"ID":"7e7475db-35a1-407c-818d-b31ecf085e31","Type":"ContainerStarted","Data":"a4852ac60371487d6562d26d6c0f26314199e7293d4a6cdf2d3edf1b27d409d9"}
Jul 21 16:24:52.879830 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:52.879787    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qjfjw" podStartSLOduration=65.835237226 podStartE2EDuration="1m10.879774948s" totalImagesPullingTime="5.044537722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:52.879308422 +0000 UTC m=+71.817616871" watchObservedRunningTime="2026-07-21 16:24:52.879774948 +0000 UTC m=+71.818083387"
Jul 21 16:24:53.884141 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:53.884087    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hmkpw" podStartSLOduration=66.812087895 podStartE2EDuration="1m11.884067487s" totalImagesPullingTime="5.071979592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:53.882851682 +0000 UTC m=+72.821160133" watchObservedRunningTime="2026-07-21 16:24:53.884067487 +0000 UTC m=+72.822375935"
Jul 21 16:24:56.997658 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:56.997615    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d"]
Jul 21 16:24:56.999501 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:56.999484    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d"
Jul 21 16:24:57.002408 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.002384    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 16:24:57.003005 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.002977    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 16:24:57.003105 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.002977    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mg5xs\""
Jul 21 16:24:57.003105 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.003056    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 21 16:24:57.003213 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.002982    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 16:24:57.010343 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.010321    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d"]
Jul 21 16:24:57.017312 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.017291    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"]
Jul 21 16:24:57.019114 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.019099    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:24:57.021341 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.021324    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 21 16:24:57.031923 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.031901    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"]
Jul 21 16:24:57.097856 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.097821    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6abe2e3f-3125-40fd-a35c-7cc5de9e5334-tmp\") pod \"klusterlet-addon-workmgr-577d695579-bxftd\" (UID: \"6abe2e3f-3125-40fd-a35c-7cc5de9e5334\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:24:57.098025 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.097866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9313f4a-156f-425e-ae9e-43856c6a1f5e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8fd455556-tk78d\" (UID: \"e9313f4a-156f-425e-ae9e-43856c6a1f5e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d"
Jul 21 16:24:57.098025 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.097933    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxrnt\" (UniqueName: \"kubernetes.io/projected/6abe2e3f-3125-40fd-a35c-7cc5de9e5334-kube-api-access-sxrnt\") pod \"klusterlet-addon-workmgr-577d695579-bxftd\" (UID: \"6abe2e3f-3125-40fd-a35c-7cc5de9e5334\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:24:57.098025 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.097969    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6abe2e3f-3125-40fd-a35c-7cc5de9e5334-klusterlet-config\") pod \"klusterlet-addon-workmgr-577d695579-bxftd\" (UID: \"6abe2e3f-3125-40fd-a35c-7cc5de9e5334\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:24:57.098025 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.097987    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcrh7\" (UniqueName: \"kubernetes.io/projected/e9313f4a-156f-425e-ae9e-43856c6a1f5e-kube-api-access-tcrh7\") pod \"managed-serviceaccount-addon-agent-8fd455556-tk78d\" (UID: \"e9313f4a-156f-425e-ae9e-43856c6a1f5e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d"
Jul 21 16:24:57.199170 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.199135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9313f4a-156f-425e-ae9e-43856c6a1f5e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8fd455556-tk78d\" (UID: \"e9313f4a-156f-425e-ae9e-43856c6a1f5e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d"
Jul 21 16:24:57.199278 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.199193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxrnt\" (UniqueName: \"kubernetes.io/projected/6abe2e3f-3125-40fd-a35c-7cc5de9e5334-kube-api-access-sxrnt\") pod \"klusterlet-addon-workmgr-577d695579-bxftd\" (UID: \"6abe2e3f-3125-40fd-a35c-7cc5de9e5334\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:24:57.199278 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.199219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6abe2e3f-3125-40fd-a35c-7cc5de9e5334-klusterlet-config\") pod \"klusterlet-addon-workmgr-577d695579-bxftd\" (UID: \"6abe2e3f-3125-40fd-a35c-7cc5de9e5334\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:24:57.199278 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.199246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcrh7\" (UniqueName: \"kubernetes.io/projected/e9313f4a-156f-425e-ae9e-43856c6a1f5e-kube-api-access-tcrh7\") pod \"managed-serviceaccount-addon-agent-8fd455556-tk78d\" (UID: \"e9313f4a-156f-425e-ae9e-43856c6a1f5e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d"
Jul 21 16:24:57.199418 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.199326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6abe2e3f-3125-40fd-a35c-7cc5de9e5334-tmp\") pod \"klusterlet-addon-workmgr-577d695579-bxftd\" (UID: \"6abe2e3f-3125-40fd-a35c-7cc5de9e5334\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:24:57.199731 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.199711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6abe2e3f-3125-40fd-a35c-7cc5de9e5334-tmp\") pod \"klusterlet-addon-workmgr-577d695579-bxftd\" (UID: \"6abe2e3f-3125-40fd-a35c-7cc5de9e5334\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:24:57.201673 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.201632    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9313f4a-156f-425e-ae9e-43856c6a1f5e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8fd455556-tk78d\" (UID: \"e9313f4a-156f-425e-ae9e-43856c6a1f5e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d"
Jul 21 16:24:57.201757 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.201687    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6abe2e3f-3125-40fd-a35c-7cc5de9e5334-klusterlet-config\") pod \"klusterlet-addon-workmgr-577d695579-bxftd\" (UID: \"6abe2e3f-3125-40fd-a35c-7cc5de9e5334\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:24:57.207127 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.207100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcrh7\" (UniqueName: \"kubernetes.io/projected/e9313f4a-156f-425e-ae9e-43856c6a1f5e-kube-api-access-tcrh7\") pod \"managed-serviceaccount-addon-agent-8fd455556-tk78d\" (UID: \"e9313f4a-156f-425e-ae9e-43856c6a1f5e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d"
Jul 21 16:24:57.207475 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.207455    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxrnt\" (UniqueName: \"kubernetes.io/projected/6abe2e3f-3125-40fd-a35c-7cc5de9e5334-kube-api-access-sxrnt\") pod \"klusterlet-addon-workmgr-577d695579-bxftd\" (UID: \"6abe2e3f-3125-40fd-a35c-7cc5de9e5334\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:24:57.331246 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.331165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d"
Jul 21 16:24:57.338203 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.338170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:24:57.454843 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.454814    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d"]
Jul 21 16:24:57.460740 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:24:57.459913    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9313f4a_156f_425e_ae9e_43856c6a1f5e.slice/crio-36e815460f1aa310f7c01583ae01ea2e60fb1c100a655070a558fc7ff402896d WatchSource:0}: Error finding container 36e815460f1aa310f7c01583ae01ea2e60fb1c100a655070a558fc7ff402896d: Status 404 returned error can't find the container with id 36e815460f1aa310f7c01583ae01ea2e60fb1c100a655070a558fc7ff402896d
Jul 21 16:24:57.469841 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.469816    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"]
Jul 21 16:24:57.473359 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:24:57.473334    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6abe2e3f_3125_40fd_a35c_7cc5de9e5334.slice/crio-a70e906914c14786748a77d8155cddd255820fd5bfdbfc70bbc003f68a1277ce WatchSource:0}: Error finding container a70e906914c14786748a77d8155cddd255820fd5bfdbfc70bbc003f68a1277ce: Status 404 returned error can't find the container with id a70e906914c14786748a77d8155cddd255820fd5bfdbfc70bbc003f68a1277ce
Jul 21 16:24:57.879167 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.879126    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d" event={"ID":"e9313f4a-156f-425e-ae9e-43856c6a1f5e","Type":"ContainerStarted","Data":"36e815460f1aa310f7c01583ae01ea2e60fb1c100a655070a558fc7ff402896d"}
Jul 21 16:24:57.880175 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:24:57.880148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd" event={"ID":"6abe2e3f-3125-40fd-a35c-7cc5de9e5334","Type":"ContainerStarted","Data":"a70e906914c14786748a77d8155cddd255820fd5bfdbfc70bbc003f68a1277ce"}
Jul 21 16:25:01.894341 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:25:01.894302    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d" event={"ID":"e9313f4a-156f-425e-ae9e-43856c6a1f5e","Type":"ContainerStarted","Data":"9c957c5a939d673c4f4609948b96b8645bd4c83fbaf999864faab7424005bcf5"}
Jul 21 16:25:01.895751 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:25:01.895726    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd" event={"ID":"6abe2e3f-3125-40fd-a35c-7cc5de9e5334","Type":"ContainerStarted","Data":"c589f7083956a978f8ab4dfec5c80d677355b6cad191cecdb0ec141ef593b9fd"}
Jul 21 16:25:01.895874 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:25:01.895843    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:25:01.897402 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:25:01.897382    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:25:01.911042 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:25:01.910940    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d" podStartSLOduration=2.173322994 podStartE2EDuration="5.910929671s" totalImagesPullingTime="3.737606677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:01.9106796 +0000 UTC m=+80.848988045" watchObservedRunningTime="2026-07-21 16:25:01.910929671 +0000 UTC m=+80.849238118"
Jul 21 16:25:01.927912 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:25:01.927868    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd" podStartSLOduration=2.191551004 podStartE2EDuration="5.9278544s" totalImagesPullingTime="3.736303396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:01.927080838 +0000 UTC m=+80.865389286" watchObservedRunningTime="2026-07-21 16:25:01.9278544 +0000 UTC m=+80.866162847"
Jul 21 16:25:20.259823 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:25:20.259786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:25:20.260143 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:25:20.259902    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:25:20.260143 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:25:20.259966    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls podName:31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3 nodeName:}" failed. No retries permitted until 2026-07-21 16:26:24.259948799 +0000 UTC m=+163.198257227 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls") pod "dns-default-kwf4m" (UID: "31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3") : secret "dns-default-metrics-tls" not found
Jul 21 16:25:23.871510 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:25:23.871479    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qjfjw"
Jul 21 16:25:51.362625 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:25:51.362583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:25:51.363174 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:25:51.362731    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 16:25:51.363174 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:25:51.362823    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs podName:46a4fa95-e3f4-4b04-a202-4347da90724d nodeName:}" failed. No retries permitted until 2026-07-21 16:27:53.362802115 +0000 UTC m=+252.301110544 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs") pod "network-metrics-daemon-k5rhr" (UID: "46a4fa95-e3f4-4b04-a202-4347da90724d") : secret "metrics-daemon-secret" not found
Jul 21 16:26:19.419945 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:26:19.419906    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kwf4m" podUID="31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3"
Jul 21 16:26:19.587757 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:26:19.587721    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:26:20.084716 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:26:20.084687    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:26:24.278170 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:26:24.278119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:26:24.278615 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:26:24.278247    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:26:24.278615 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:26:24.278315    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls podName:31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:26.27830139 +0000 UTC m=+285.216609816 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls") pod "dns-default-kwf4m" (UID: "31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3") : secret "dns-default-metrics-tls" not found
Jul 21 16:26:33.576756 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:26:33.576712    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:27:01.896529 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:01.896480    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd" podUID="6abe2e3f-3125-40fd-a35c-7cc5de9e5334" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused"
Jul 21 16:27:02.189263 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:02.189182    2578 generic.go:356] "Generic (PLEG): container finished" podID="6abe2e3f-3125-40fd-a35c-7cc5de9e5334" containerID="c589f7083956a978f8ab4dfec5c80d677355b6cad191cecdb0ec141ef593b9fd" exitCode=1
Jul 21 16:27:02.189415 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:02.189262    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd" event={"ID":"6abe2e3f-3125-40fd-a35c-7cc5de9e5334","Type":"ContainerDied","Data":"c589f7083956a978f8ab4dfec5c80d677355b6cad191cecdb0ec141ef593b9fd"}
Jul 21 16:27:02.189646 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:02.189622    2578 scope.go:117] "RemoveContainer" containerID="c589f7083956a978f8ab4dfec5c80d677355b6cad191cecdb0ec141ef593b9fd"
Jul 21 16:27:02.190679 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:02.190659    2578 generic.go:356] "Generic (PLEG): container finished" podID="e9313f4a-156f-425e-ae9e-43856c6a1f5e" containerID="9c957c5a939d673c4f4609948b96b8645bd4c83fbaf999864faab7424005bcf5" exitCode=255
Jul 21 16:27:02.190756 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:02.190673    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d" event={"ID":"e9313f4a-156f-425e-ae9e-43856c6a1f5e","Type":"ContainerDied","Data":"9c957c5a939d673c4f4609948b96b8645bd4c83fbaf999864faab7424005bcf5"}
Jul 21 16:27:02.198295 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:02.198276    2578 scope.go:117] "RemoveContainer" containerID="9c957c5a939d673c4f4609948b96b8645bd4c83fbaf999864faab7424005bcf5"
Jul 21 16:27:03.196912 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:03.196875    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8fd455556-tk78d" event={"ID":"e9313f4a-156f-425e-ae9e-43856c6a1f5e","Type":"ContainerStarted","Data":"ba50533e516c7201b13efb1fed9986b09560b03a773dd9d5f3358d0d5b2de2d9"}
Jul 21 16:27:03.198555 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:03.198529    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd" event={"ID":"6abe2e3f-3125-40fd-a35c-7cc5de9e5334","Type":"ContainerStarted","Data":"d800f3618d746f955ed19e5a6a1150b4ae52b6e2880957035cacf23770d46c9f"}
Jul 21 16:27:03.198795 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:03.198780    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:27:03.199336 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:03.199318    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-577d695579-bxftd"
Jul 21 16:27:51.823053 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.823014    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf"]
Jul 21 16:27:51.825243 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.825220    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf"
Jul 21 16:27:51.828004 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.827981    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 21 16:27:51.828004 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.827981    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 21 16:27:51.828178 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.828015    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 21 16:27:51.828852 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.828831    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:27:51.828973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.828906    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hgrk6\""
Jul 21 16:27:51.844329 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.844298    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf"]
Jul 21 16:27:51.905283 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.905251    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"]
Jul 21 16:27:51.907015 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.906994    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:27:51.909003 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.908982    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8655c54564-p4jfc"]
Jul 21 16:27:51.910670 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.910629    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wrzhp\""
Jul 21 16:27:51.910776 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.910685    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 21 16:27:51.910776 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.910631    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 16:27:51.910776 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.910745    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:51.911622 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.911606    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 16:27:51.911905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.911892    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 21 16:27:51.916631 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.916610    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 16:27:51.916734 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.916618    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kt5q5\""
Jul 21 16:27:51.916734 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.916664    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 16:27:51.917183 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.917166    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 16:27:51.921657 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.921622    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 16:27:51.933184 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.933157    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"]
Jul 21 16:27:51.940077 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.940056    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8655c54564-p4jfc"]
Jul 21 16:27:51.960778 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.960746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6799be-b3d3-475f-a5ae-abd18aa4164b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-mwnbf\" (UID: \"4e6799be-b3d3-475f-a5ae-abd18aa4164b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf"
Jul 21 16:27:51.960909 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.960867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e6799be-b3d3-475f-a5ae-abd18aa4164b-config\") pod \"service-ca-operator-5bcbc94c78-mwnbf\" (UID: \"4e6799be-b3d3-475f-a5ae-abd18aa4164b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf"
Jul 21 16:27:51.960960 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:51.960917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkt2v\" (UniqueName: \"kubernetes.io/projected/4e6799be-b3d3-475f-a5ae-abd18aa4164b-kube-api-access-bkt2v\") pod \"service-ca-operator-5bcbc94c78-mwnbf\" (UID: \"4e6799be-b3d3-475f-a5ae-abd18aa4164b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf"
Jul 21 16:27:52.062055 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062015    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkt2v\" (UniqueName: \"kubernetes.io/projected/4e6799be-b3d3-475f-a5ae-abd18aa4164b-kube-api-access-bkt2v\") pod \"service-ca-operator-5bcbc94c78-mwnbf\" (UID: \"4e6799be-b3d3-475f-a5ae-abd18aa4164b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf"
Jul 21 16:27:52.062055 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0519940-0341-4cf7-be0e-f4dfe9debd21-ca-trust-extracted\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.062307 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh8td\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-kube-api-access-vh8td\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.062307 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-certificates\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.062307 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062135    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0519940-0341-4cf7-be0e-f4dfe9debd21-installation-pull-secrets\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.062307 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6799be-b3d3-475f-a5ae-abd18aa4164b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-mwnbf\" (UID: \"4e6799be-b3d3-475f-a5ae-abd18aa4164b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf"
Jul 21 16:27:52.062307 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062257    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.062307 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-bound-sa-token\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.062307 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0519940-0341-4cf7-be0e-f4dfe9debd21-trusted-ca\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.062661 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/26ebd4b4-5145-471d-91a3-df86b81641ad-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:27:52.062661 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e6799be-b3d3-475f-a5ae-abd18aa4164b-config\") pod \"service-ca-operator-5bcbc94c78-mwnbf\" (UID: \"4e6799be-b3d3-475f-a5ae-abd18aa4164b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf"
Jul 21 16:27:52.062661 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:27:52.062661 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghhn5\" (UniqueName: \"kubernetes.io/projected/26ebd4b4-5145-471d-91a3-df86b81641ad-kube-api-access-ghhn5\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:27:52.062661 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0519940-0341-4cf7-be0e-f4dfe9debd21-image-registry-private-configuration\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.062912 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.062895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e6799be-b3d3-475f-a5ae-abd18aa4164b-config\") pod \"service-ca-operator-5bcbc94c78-mwnbf\" (UID: \"4e6799be-b3d3-475f-a5ae-abd18aa4164b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf"
Jul 21 16:27:52.064363 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.064339    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6799be-b3d3-475f-a5ae-abd18aa4164b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-mwnbf\" (UID: \"4e6799be-b3d3-475f-a5ae-abd18aa4164b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf"
Jul 21 16:27:52.069736 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.069715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkt2v\" (UniqueName: \"kubernetes.io/projected/4e6799be-b3d3-475f-a5ae-abd18aa4164b-kube-api-access-bkt2v\") pod \"service-ca-operator-5bcbc94c78-mwnbf\" (UID: \"4e6799be-b3d3-475f-a5ae-abd18aa4164b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf"
Jul 21 16:27:52.133835 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.133800    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf"
Jul 21 16:27:52.162932 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.162859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:27:52.163100 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.162951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghhn5\" (UniqueName: \"kubernetes.io/projected/26ebd4b4-5145-471d-91a3-df86b81641ad-kube-api-access-ghhn5\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:27:52.163100 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.162980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0519940-0341-4cf7-be0e-f4dfe9debd21-image-registry-private-configuration\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.163100 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:52.163004    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 16:27:52.163100 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.163032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0519940-0341-4cf7-be0e-f4dfe9debd21-ca-trust-extracted\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.163100 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:52.163063    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls podName:26ebd4b4-5145-471d-91a3-df86b81641ad nodeName:}" failed. No retries permitted until 2026-07-21 16:27:52.663046039 +0000 UTC m=+251.601354464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2sg9j" (UID: "26ebd4b4-5145-471d-91a3-df86b81641ad") : secret "cluster-monitoring-operator-tls" not found
Jul 21 16:27:52.163100 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.163081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh8td\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-kube-api-access-vh8td\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.163397 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.163118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-certificates\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.163397 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.163144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0519940-0341-4cf7-be0e-f4dfe9debd21-installation-pull-secrets\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.163397 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.163172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.163397 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.163194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-bound-sa-token\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.163397 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.163249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0519940-0341-4cf7-be0e-f4dfe9debd21-trusted-ca\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.163397 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.163298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/26ebd4b4-5145-471d-91a3-df86b81641ad-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:27:52.163397 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:52.163398    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:27:52.163766 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:52.163413    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8655c54564-p4jfc: secret "image-registry-tls" not found
Jul 21 16:27:52.163766 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.163420    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0519940-0341-4cf7-be0e-f4dfe9debd21-ca-trust-extracted\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.163766 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:52.163454    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls podName:e0519940-0341-4cf7-be0e-f4dfe9debd21 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:52.663439178 +0000 UTC m=+251.601747604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls") pod "image-registry-8655c54564-p4jfc" (UID: "e0519940-0341-4cf7-be0e-f4dfe9debd21") : secret "image-registry-tls" not found
Jul 21 16:27:52.163933 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.163823    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-certificates\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.164073 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.164050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/26ebd4b4-5145-471d-91a3-df86b81641ad-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:27:52.164334 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.164314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0519940-0341-4cf7-be0e-f4dfe9debd21-trusted-ca\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.165803 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.165776    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0519940-0341-4cf7-be0e-f4dfe9debd21-installation-pull-secrets\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.165945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.165926    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0519940-0341-4cf7-be0e-f4dfe9debd21-image-registry-private-configuration\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.175631 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.175608    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh8td\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-kube-api-access-vh8td\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.175807 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.175789    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-bound-sa-token\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.176158 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.176138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghhn5\" (UniqueName: \"kubernetes.io/projected/26ebd4b4-5145-471d-91a3-df86b81641ad-kube-api-access-ghhn5\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:27:52.255898 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.255866    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf"]
Jul 21 16:27:52.259693 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:27:52.259667    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6799be_b3d3_475f_a5ae_abd18aa4164b.slice/crio-50033734dcc1feb77b1ba9375b36ef61b99e59b7c4cca30db459588c5728b0f1 WatchSource:0}: Error finding container 50033734dcc1feb77b1ba9375b36ef61b99e59b7c4cca30db459588c5728b0f1: Status 404 returned error can't find the container with id 50033734dcc1feb77b1ba9375b36ef61b99e59b7c4cca30db459588c5728b0f1
Jul 21 16:27:52.338845 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.338808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf" event={"ID":"4e6799be-b3d3-475f-a5ae-abd18aa4164b","Type":"ContainerStarted","Data":"50033734dcc1feb77b1ba9375b36ef61b99e59b7c4cca30db459588c5728b0f1"}
Jul 21 16:27:52.667147 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.667111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:52.667333 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:52.667211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:27:52.667333 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:52.667262    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:27:52.667333 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:52.667283    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8655c54564-p4jfc: secret "image-registry-tls" not found
Jul 21 16:27:52.667333 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:52.667323    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 16:27:52.667333 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:52.667335    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls podName:e0519940-0341-4cf7-be0e-f4dfe9debd21 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:53.667320016 +0000 UTC m=+252.605628441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls") pod "image-registry-8655c54564-p4jfc" (UID: "e0519940-0341-4cf7-be0e-f4dfe9debd21") : secret "image-registry-tls" not found
Jul 21 16:27:52.667531 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:52.667374    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls podName:26ebd4b4-5145-471d-91a3-df86b81641ad nodeName:}" failed. No retries permitted until 2026-07-21 16:27:53.667358226 +0000 UTC m=+252.605666651 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2sg9j" (UID: "26ebd4b4-5145-471d-91a3-df86b81641ad") : secret "cluster-monitoring-operator-tls" not found
Jul 21 16:27:53.372245 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:53.372204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:27:53.372670 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:53.372372    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 16:27:53.372670 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:53.372436    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs podName:46a4fa95-e3f4-4b04-a202-4347da90724d nodeName:}" failed. No retries permitted until 2026-07-21 16:29:55.372420736 +0000 UTC m=+374.310729163 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs") pod "network-metrics-daemon-k5rhr" (UID: "46a4fa95-e3f4-4b04-a202-4347da90724d") : secret "metrics-daemon-secret" not found
Jul 21 16:27:53.674837 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:53.674749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:27:53.674837 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:53.674813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:53.675067 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:53.674939    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:27:53.675067 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:53.674959    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8655c54564-p4jfc: secret "image-registry-tls" not found
Jul 21 16:27:53.675067 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:53.674939    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 16:27:53.675067 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:53.675025    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls podName:e0519940-0341-4cf7-be0e-f4dfe9debd21 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:55.67500334 +0000 UTC m=+254.613311770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls") pod "image-registry-8655c54564-p4jfc" (UID: "e0519940-0341-4cf7-be0e-f4dfe9debd21") : secret "image-registry-tls" not found
Jul 21 16:27:53.675067 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:53.675043    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls podName:26ebd4b4-5145-471d-91a3-df86b81641ad nodeName:}" failed. No retries permitted until 2026-07-21 16:27:55.675034147 +0000 UTC m=+254.613342576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2sg9j" (UID: "26ebd4b4-5145-471d-91a3-df86b81641ad") : secret "cluster-monitoring-operator-tls" not found
Jul 21 16:27:54.345870 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:54.345833    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf" event={"ID":"4e6799be-b3d3-475f-a5ae-abd18aa4164b","Type":"ContainerStarted","Data":"8c61413fd9e525c4f7a14c2b022d533e785f547d14b7ac1a56d29f5824d9c960"}
Jul 21 16:27:55.689060 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:55.689017    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:27:55.689473 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:55.689085    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:55.689473 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:55.689168    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 16:27:55.689473 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:55.689242    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls podName:26ebd4b4-5145-471d-91a3-df86b81641ad nodeName:}" failed. No retries permitted until 2026-07-21 16:27:59.689225029 +0000 UTC m=+258.627533460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2sg9j" (UID: "26ebd4b4-5145-471d-91a3-df86b81641ad") : secret "cluster-monitoring-operator-tls" not found
Jul 21 16:27:55.689473 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:55.689175    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:27:55.689473 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:55.689267    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8655c54564-p4jfc: secret "image-registry-tls" not found
Jul 21 16:27:55.689473 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:55.689312    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls podName:e0519940-0341-4cf7-be0e-f4dfe9debd21 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:59.689302129 +0000 UTC m=+258.627610557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls") pod "image-registry-8655c54564-p4jfc" (UID: "e0519940-0341-4cf7-be0e-f4dfe9debd21") : secret "image-registry-tls" not found
Jul 21 16:27:56.666866 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.666802    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf" podStartSLOduration=3.850842278 podStartE2EDuration="5.666779382s" totalImagesPullingTime="1.815937104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:27:54.361699632 +0000 UTC m=+253.300008079" watchObservedRunningTime="2026-07-21 16:27:56.666779382 +0000 UTC m=+255.605087831"
Jul 21 16:27:56.668040 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.668020    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kd6cb"]
Jul 21 16:27:56.670677 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.670633    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:56.673099 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.673077    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 16:27:56.673217 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.673078    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 16:27:56.673356 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.673330    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 16:27:56.673683 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.673667    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 16:27:56.676466 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.676442    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7pk7c\""
Jul 21 16:27:56.686113 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.686082    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kd6cb"]
Jul 21 16:27:56.798569 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.798524    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0c1a9dc-f7b4-492a-9b95-320c242f1997-crio-socket\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:56.798986 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.798583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tb5n\" (UniqueName: \"kubernetes.io/projected/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-api-access-5tb5n\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:56.798986 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.798623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:56.798986 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.798685    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:56.798986 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.798769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0c1a9dc-f7b4-492a-9b95-320c242f1997-data-volume\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:56.899775 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.899733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0c1a9dc-f7b4-492a-9b95-320c242f1997-crio-socket\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:56.899956 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.899791    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tb5n\" (UniqueName: \"kubernetes.io/projected/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-api-access-5tb5n\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:56.899956 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.899811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:56.899956 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.899836    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:56.899956 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.899863    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0c1a9dc-f7b4-492a-9b95-320c242f1997-crio-socket\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:56.899956 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.899874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0c1a9dc-f7b4-492a-9b95-320c242f1997-data-volume\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:56.899956 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:56.899948    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:27:56.900170 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:56.899964    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:27:56.900170 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:56.900007    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls podName:a0c1a9dc-f7b4-492a-9b95-320c242f1997 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:57.399989972 +0000 UTC m=+256.338298414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kd6cb" (UID: "a0c1a9dc-f7b4-492a-9b95-320c242f1997") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:27:56.900170 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:56.900033    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm podName:a0c1a9dc-f7b4-492a-9b95-320c242f1997 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:57.400022581 +0000 UTC m=+256.338331007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kd6cb" (UID: "a0c1a9dc-f7b4-492a-9b95-320c242f1997") : configmap "kube-rbac-proxy" not found
Jul 21 16:27:56.900283 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.900222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0c1a9dc-f7b4-492a-9b95-320c242f1997-data-volume\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:56.908762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:56.908741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tb5n\" (UniqueName: \"kubernetes.io/projected/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-api-access-5tb5n\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:57.404859 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:57.404800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:57.404859 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:57.404866    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:57.405146 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:57.404939    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:27:57.405146 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:57.404976    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:27:57.405146 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:57.404991    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm podName:a0c1a9dc-f7b4-492a-9b95-320c242f1997 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:58.404978088 +0000 UTC m=+257.343286514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kd6cb" (UID: "a0c1a9dc-f7b4-492a-9b95-320c242f1997") : configmap "kube-rbac-proxy" not found
Jul 21 16:27:57.405146 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:57.405065    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls podName:a0c1a9dc-f7b4-492a-9b95-320c242f1997 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:58.40504744 +0000 UTC m=+257.343355876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kd6cb" (UID: "a0c1a9dc-f7b4-492a-9b95-320c242f1997") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:27:58.415736 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:58.415697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:58.415736 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:58.415748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:27:58.416189 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:58.415832    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:27:58.416189 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:58.415880    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:27:58.416189 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:58.415881    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm podName:a0c1a9dc-f7b4-492a-9b95-320c242f1997 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:00.415868219 +0000 UTC m=+259.354176646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kd6cb" (UID: "a0c1a9dc-f7b4-492a-9b95-320c242f1997") : configmap "kube-rbac-proxy" not found
Jul 21 16:27:58.416189 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:58.415952    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls podName:a0c1a9dc-f7b4-492a-9b95-320c242f1997 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:00.415935182 +0000 UTC m=+259.354243620 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kd6cb" (UID: "a0c1a9dc-f7b4-492a-9b95-320c242f1997") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:27:58.617883 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:58.617853    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p9cm5_6b6bf757-0749-4e3c-bbab-3af15a0cf5ea/dns-node-resolver/0.log"
Jul 21 16:27:59.727331 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:59.727294    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:27:59.727331 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:59.727333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:27:59.727793 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:59.727430    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 16:27:59.727793 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:59.727436    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:27:59.727793 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:59.727453    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8655c54564-p4jfc: secret "image-registry-tls" not found
Jul 21 16:27:59.727793 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:59.727478    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls podName:26ebd4b4-5145-471d-91a3-df86b81641ad nodeName:}" failed. No retries permitted until 2026-07-21 16:28:07.727464451 +0000 UTC m=+266.665772877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2sg9j" (UID: "26ebd4b4-5145-471d-91a3-df86b81641ad") : secret "cluster-monitoring-operator-tls" not found
Jul 21 16:27:59.727793 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:27:59.727512    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls podName:e0519940-0341-4cf7-be0e-f4dfe9debd21 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:07.727506015 +0000 UTC m=+266.665814441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls") pod "image-registry-8655c54564-p4jfc" (UID: "e0519940-0341-4cf7-be0e-f4dfe9debd21") : secret "image-registry-tls" not found
Jul 21 16:27:59.816964 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:27:59.816935    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jkq4v_449f52bf-433c-402e-ba3b-5dd3179bd1a7/node-ca/0.log"
Jul 21 16:28:00.416108 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:00.416076    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6xqhs_036bafe7-16e7-414a-ba6b-743635dd7852/serve-healthcheck-canary/0.log"
Jul 21 16:28:00.433541 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:00.433501    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:28:00.433705 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:00.433628    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:28:00.433705 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:00.433667    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:28:00.433816 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:00.433708    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm podName:a0c1a9dc-f7b4-492a-9b95-320c242f1997 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:04.433692644 +0000 UTC m=+263.372001069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kd6cb" (UID: "a0c1a9dc-f7b4-492a-9b95-320c242f1997") : configmap "kube-rbac-proxy" not found
Jul 21 16:28:00.433816 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:00.433784    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:00.433915 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:00.433863    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls podName:a0c1a9dc-f7b4-492a-9b95-320c242f1997 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:04.433840659 +0000 UTC m=+263.372149085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kd6cb" (UID: "a0c1a9dc-f7b4-492a-9b95-320c242f1997") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:04.465394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:04.465296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:28:04.465394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:04.465351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:28:04.465927 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:04.465455    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:04.465927 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:04.465515    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:28:04.465927 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:04.465527    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls podName:a0c1a9dc-f7b4-492a-9b95-320c242f1997 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:12.465510233 +0000 UTC m=+271.403818660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kd6cb" (UID: "a0c1a9dc-f7b4-492a-9b95-320c242f1997") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:04.465927 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:04.465663    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm podName:a0c1a9dc-f7b4-492a-9b95-320c242f1997 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:12.465620055 +0000 UTC m=+271.403928482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kd6cb" (UID: "a0c1a9dc-f7b4-492a-9b95-320c242f1997") : configmap "kube-rbac-proxy" not found
Jul 21 16:28:07.787733 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:07.787700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:28:07.787733 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:07.787737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:28:07.788335 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:07.787856    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 16:28:07.788335 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:07.787921    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls podName:26ebd4b4-5145-471d-91a3-df86b81641ad nodeName:}" failed. No retries permitted until 2026-07-21 16:28:23.787903709 +0000 UTC m=+282.726212136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2sg9j" (UID: "26ebd4b4-5145-471d-91a3-df86b81641ad") : secret "cluster-monitoring-operator-tls" not found
Jul 21 16:28:07.790196 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:07.790169    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls\") pod \"image-registry-8655c54564-p4jfc\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") " pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:28:07.823803 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:07.823777    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:28:07.950071 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:07.950043    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8655c54564-p4jfc"]
Jul 21 16:28:07.953905 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:28:07.953873    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0519940_0341_4cf7_be0e_f4dfe9debd21.slice/crio-eb8c166b17804a1b8671591d06cfd87309a700a55664e9213ebe55fd2e2b64ff WatchSource:0}: Error finding container eb8c166b17804a1b8671591d06cfd87309a700a55664e9213ebe55fd2e2b64ff: Status 404 returned error can't find the container with id eb8c166b17804a1b8671591d06cfd87309a700a55664e9213ebe55fd2e2b64ff
Jul 21 16:28:08.388967 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:08.388930    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8655c54564-p4jfc" event={"ID":"e0519940-0341-4cf7-be0e-f4dfe9debd21","Type":"ContainerStarted","Data":"3cb97718afb172a79e72e521edb66cdc630ecdc80d6b24b5d639fe34f463719f"}
Jul 21 16:28:08.389183 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:08.389015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8655c54564-p4jfc" event={"ID":"e0519940-0341-4cf7-be0e-f4dfe9debd21","Type":"ContainerStarted","Data":"eb8c166b17804a1b8671591d06cfd87309a700a55664e9213ebe55fd2e2b64ff"}
Jul 21 16:28:08.389183 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:08.389055    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:28:08.409279 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:08.409211    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8655c54564-p4jfc" podStartSLOduration=17.409189174 podStartE2EDuration="17.409189174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:08.408713529 +0000 UTC m=+267.347021978" watchObservedRunningTime="2026-07-21 16:28:08.409189174 +0000 UTC m=+267.347497622"
Jul 21 16:28:12.529172 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:12.529123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:28:12.529172 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:12.529178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:28:12.529753 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:12.529734    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0c1a9dc-f7b4-492a-9b95-320c242f1997-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:28:12.531465 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:12.531440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0c1a9dc-f7b4-492a-9b95-320c242f1997-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd6cb\" (UID: \"a0c1a9dc-f7b4-492a-9b95-320c242f1997\") " pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:28:12.580234 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:12.580196    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kd6cb"
Jul 21 16:28:12.706320 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:12.706294    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kd6cb"]
Jul 21 16:28:12.709671 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:28:12.709624    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c1a9dc_f7b4_492a_9b95_320c242f1997.slice/crio-502abbb07a73e25d5b32c3135fac7c879ea3d8ba911b54d9b84b498b793db8da WatchSource:0}: Error finding container 502abbb07a73e25d5b32c3135fac7c879ea3d8ba911b54d9b84b498b793db8da: Status 404 returned error can't find the container with id 502abbb07a73e25d5b32c3135fac7c879ea3d8ba911b54d9b84b498b793db8da
Jul 21 16:28:13.404495 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:13.404401    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kd6cb" event={"ID":"a0c1a9dc-f7b4-492a-9b95-320c242f1997","Type":"ContainerStarted","Data":"502abbb07a73e25d5b32c3135fac7c879ea3d8ba911b54d9b84b498b793db8da"}
Jul 21 16:28:18.423810 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:18.423761    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kd6cb" event={"ID":"a0c1a9dc-f7b4-492a-9b95-320c242f1997","Type":"ContainerStarted","Data":"3049596bbee8d8c484f041a44cd47dee187f8afde8fcbb2e3f13686a8cdcba1c"}
Jul 21 16:28:18.424802 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:18.424777    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-wfs6v"]
Jul 21 16:28:18.428406 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:18.428376    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8655c54564-p4jfc"]
Jul 21 16:28:18.428797 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:18.428729    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-wfs6v"
Jul 21 16:28:18.432070 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:18.431429    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 16:28:18.432070 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:18.431690    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 16:28:18.432070 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:18.431911    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gg4sz\""
Jul 21 16:28:18.444558 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:18.444478    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-wfs6v"]
Jul 21 16:28:18.480133 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:18.480081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptzdd\" (UniqueName: \"kubernetes.io/projected/18981a60-fae7-495a-b8f3-a5510af00008-kube-api-access-ptzdd\") pod \"downloads-5bc67dcd46-wfs6v\" (UID: \"18981a60-fae7-495a-b8f3-a5510af00008\") " pod="openshift-console/downloads-5bc67dcd46-wfs6v"
Jul 21 16:28:18.580684 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:18.580624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzdd\" (UniqueName: \"kubernetes.io/projected/18981a60-fae7-495a-b8f3-a5510af00008-kube-api-access-ptzdd\") pod \"downloads-5bc67dcd46-wfs6v\" (UID: \"18981a60-fae7-495a-b8f3-a5510af00008\") " pod="openshift-console/downloads-5bc67dcd46-wfs6v"
Jul 21 16:28:18.591405 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:18.591375    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzdd\" (UniqueName: \"kubernetes.io/projected/18981a60-fae7-495a-b8f3-a5510af00008-kube-api-access-ptzdd\") pod \"downloads-5bc67dcd46-wfs6v\" (UID: \"18981a60-fae7-495a-b8f3-a5510af00008\") " pod="openshift-console/downloads-5bc67dcd46-wfs6v"
Jul 21 16:28:18.740227 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:18.740147    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-wfs6v"
Jul 21 16:28:18.885345 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:18.885264    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-wfs6v"]
Jul 21 16:28:18.889227 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:28:18.889195    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18981a60_fae7_495a_b8f3_a5510af00008.slice/crio-dc84e2d63a89b381b340623781499057d73a32d7c3df04bdf4c6f01b374998ca WatchSource:0}: Error finding container dc84e2d63a89b381b340623781499057d73a32d7c3df04bdf4c6f01b374998ca: Status 404 returned error can't find the container with id dc84e2d63a89b381b340623781499057d73a32d7c3df04bdf4c6f01b374998ca
Jul 21 16:28:19.428007 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:19.427968    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-wfs6v" event={"ID":"18981a60-fae7-495a-b8f3-a5510af00008","Type":"ContainerStarted","Data":"dc84e2d63a89b381b340623781499057d73a32d7c3df04bdf4c6f01b374998ca"}
Jul 21 16:28:21.438254 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:21.438217    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kd6cb" event={"ID":"a0c1a9dc-f7b4-492a-9b95-320c242f1997","Type":"ContainerStarted","Data":"7209b93967d51d7834248fb6b10e3ee7a7b57608c4f0c411ce67af377876e503"}
Jul 21 16:28:23.085798 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:23.085751    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kwf4m" podUID="31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3"
Jul 21 16:28:23.447434 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:23.447396    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:28:23.826343 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:23.826247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:28:23.829438 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:23.829381    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/26ebd4b4-5145-471d-91a3-df86b81641ad-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2sg9j\" (UID: \"26ebd4b4-5145-471d-91a3-df86b81641ad\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:28:24.017124 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:24.017082    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"
Jul 21 16:28:25.158404 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:25.158375    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j"]
Jul 21 16:28:25.162174 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:28:25.162138    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ebd4b4_5145_471d_91a3_df86b81641ad.slice/crio-78d9b5ff5859aa6c07cf61789d7cc76c88a63b63c766978fd63846694ca0555c WatchSource:0}: Error finding container 78d9b5ff5859aa6c07cf61789d7cc76c88a63b63c766978fd63846694ca0555c: Status 404 returned error can't find the container with id 78d9b5ff5859aa6c07cf61789d7cc76c88a63b63c766978fd63846694ca0555c
Jul 21 16:28:25.457223 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:25.457179    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kd6cb" event={"ID":"a0c1a9dc-f7b4-492a-9b95-320c242f1997","Type":"ContainerStarted","Data":"3c8a00b39130b2924de68d2ee0f6d500da20b5b554a46ecec5d67f7dbe34376e"}
Jul 21 16:28:25.458390 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:25.458357    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j" event={"ID":"26ebd4b4-5145-471d-91a3-df86b81641ad","Type":"ContainerStarted","Data":"78d9b5ff5859aa6c07cf61789d7cc76c88a63b63c766978fd63846694ca0555c"}
Jul 21 16:28:25.475772 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:25.475719    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kd6cb" podStartSLOduration=17.253709514 podStartE2EDuration="29.475701137s" totalImagesPullingTime="12.221991623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:25.474701137 +0000 UTC m=+284.413009612" watchObservedRunningTime="2026-07-21 16:28:25.475701137 +0000 UTC m=+284.414009586"
Jul 21 16:28:26.345061 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:26.345024    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:28:26.347601 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:26.347578    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3-metrics-tls\") pod \"dns-default-kwf4m\" (UID: \"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3\") " pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:28:26.450896 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:26.450864    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kwsf5\""
Jul 21 16:28:26.458948 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:26.458915    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:28:26.609285 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:26.609253    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kwf4m"]
Jul 21 16:28:27.467839 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:27.467807    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kwf4m" event={"ID":"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3","Type":"ContainerStarted","Data":"a2ae0d5d375d8ea2b2a682957fd864767c8b45ae6160f5a5afafa5765d6328c2"}
Jul 21 16:28:27.990623 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:27.990590    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-f96ng"]
Jul 21 16:28:27.994064 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:27.994040    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-f96ng"
Jul 21 16:28:27.996885 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:27.996828    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 21 16:28:27.997223 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:27.996839    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2wxlr\""
Jul 21 16:28:28.002404 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.002378    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-f96ng"]
Jul 21 16:28:28.057444 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.057384    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e8e4db0d-f382-4071-b02d-13cc30b80305-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-f96ng\" (UID: \"e8e4db0d-f382-4071-b02d-13cc30b80305\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-f96ng"
Jul 21 16:28:28.158573 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.158532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e8e4db0d-f382-4071-b02d-13cc30b80305-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-f96ng\" (UID: \"e8e4db0d-f382-4071-b02d-13cc30b80305\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-f96ng"
Jul 21 16:28:28.158775 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:28.158733    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 21 16:28:28.158834 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:28.158814    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8e4db0d-f382-4071-b02d-13cc30b80305-tls-certificates podName:e8e4db0d-f382-4071-b02d-13cc30b80305 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:28.658793986 +0000 UTC m=+287.597102415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e8e4db0d-f382-4071-b02d-13cc30b80305-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-f96ng" (UID: "e8e4db0d-f382-4071-b02d-13cc30b80305") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 21 16:28:28.435352 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.435302    2578 patch_prober.go:28] interesting pod/image-registry-8655c54564-p4jfc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 16:28:28.435543 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.435377    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8655c54564-p4jfc" podUID="e0519940-0341-4cf7-be0e-f4dfe9debd21" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 16:28:28.474220 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.474173    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j" event={"ID":"26ebd4b4-5145-471d-91a3-df86b81641ad","Type":"ContainerStarted","Data":"8701553cac281be5590aea2cd4a5dd3f03c0419c493e3ee54d8524932a2708ed"}
Jul 21 16:28:28.491864 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.491748    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2sg9j" podStartSLOduration=35.192076692 podStartE2EDuration="37.491726908s" totalImagesPullingTime="2.299650216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:28.490520784 +0000 UTC m=+287.428829233" watchObservedRunningTime="2026-07-21 16:28:28.491726908 +0000 UTC m=+287.430035357"
Jul 21 16:28:28.560982 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.560944    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d7d85897d-cmlk8"]
Jul 21 16:28:28.564456 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.564425    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.567168 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.567142    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 16:28:28.567316 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.567243    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 16:28:28.567390 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.567374    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 16:28:28.567439 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.567150    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 16:28:28.567619 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.567602    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-654wr\""
Jul 21 16:28:28.567999 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.567808    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 16:28:28.575473 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.575442    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 16:28:28.576922 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.576845    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7d85897d-cmlk8"]
Jul 21 16:28:28.663158 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.663116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/772d3fda-a57a-4ead-bd9e-da3f01168340-console-serving-cert\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.663361 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.663173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-trusted-ca-bundle\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.663361 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.663229    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/772d3fda-a57a-4ead-bd9e-da3f01168340-console-oauth-config\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.663361 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.663260    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-service-ca\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.663361 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.663302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e8e4db0d-f382-4071-b02d-13cc30b80305-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-f96ng\" (UID: \"e8e4db0d-f382-4071-b02d-13cc30b80305\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-f96ng"
Jul 21 16:28:28.663361 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.663343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-console-config\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.663624 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.663383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-772n7\" (UniqueName: \"kubernetes.io/projected/772d3fda-a57a-4ead-bd9e-da3f01168340-kube-api-access-772n7\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.663624 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.663504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-oauth-serving-cert\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.666624 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.666577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e8e4db0d-f382-4071-b02d-13cc30b80305-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-f96ng\" (UID: \"e8e4db0d-f382-4071-b02d-13cc30b80305\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-f96ng"
Jul 21 16:28:28.764381 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.764290    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/772d3fda-a57a-4ead-bd9e-da3f01168340-console-serving-cert\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.764381 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.764348    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-trusted-ca-bundle\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.764381 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.764380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/772d3fda-a57a-4ead-bd9e-da3f01168340-console-oauth-config\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.764675 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.764408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-service-ca\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.764675 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.764432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-console-config\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.764675 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.764455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-772n7\" (UniqueName: \"kubernetes.io/projected/772d3fda-a57a-4ead-bd9e-da3f01168340-kube-api-access-772n7\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.764675 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.764524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-oauth-serving-cert\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.766442 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.765314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-oauth-serving-cert\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.766442 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.765378    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-service-ca\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.766442 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.765939    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-console-config\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.766442 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.765999    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-trusted-ca-bundle\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.769179 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.769156    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/772d3fda-a57a-4ead-bd9e-da3f01168340-console-oauth-config\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.770471 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.770425    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/772d3fda-a57a-4ead-bd9e-da3f01168340-console-serving-cert\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.775026 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.774999    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-772n7\" (UniqueName: \"kubernetes.io/projected/772d3fda-a57a-4ead-bd9e-da3f01168340-kube-api-access-772n7\") pod \"console-7d7d85897d-cmlk8\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") " pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.878036 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.878003    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:28.907552 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:28.907263    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-f96ng"
Jul 21 16:28:29.082845 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:29.082764    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7d85897d-cmlk8"]
Jul 21 16:28:29.097524 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:28:29.097354    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod772d3fda_a57a_4ead_bd9e_da3f01168340.slice/crio-e08f4a491fbe7bae942b3d75cf9f7dfb8bc7d07c4c1abceb810d3984446a4110 WatchSource:0}: Error finding container e08f4a491fbe7bae942b3d75cf9f7dfb8bc7d07c4c1abceb810d3984446a4110: Status 404 returned error can't find the container with id e08f4a491fbe7bae942b3d75cf9f7dfb8bc7d07c4c1abceb810d3984446a4110
Jul 21 16:28:29.126574 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:29.126546    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-f96ng"]
Jul 21 16:28:29.129184 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:28:29.129126    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e4db0d_f382_4071_b02d_13cc30b80305.slice/crio-6d2a761a606fda203a9650ce2017cf2178e51b08e1a31ee411b1f7bf1c469c19 WatchSource:0}: Error finding container 6d2a761a606fda203a9650ce2017cf2178e51b08e1a31ee411b1f7bf1c469c19: Status 404 returned error can't find the container with id 6d2a761a606fda203a9650ce2017cf2178e51b08e1a31ee411b1f7bf1c469c19
Jul 21 16:28:29.480460 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:29.480423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kwf4m" event={"ID":"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3","Type":"ContainerStarted","Data":"2feed05d5e0167117375df13e96f53498975154efab117de76e13195d2ba0a64"}
Jul 21 16:28:29.480965 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:29.480490    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kwf4m" event={"ID":"31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3","Type":"ContainerStarted","Data":"011279aa39934eb46fbe0f16d32b39a42ea2043d004c8f5ccd459e7eedacaaf3"}
Jul 21 16:28:29.480965 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:29.480536    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:28:29.482359 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:29.482325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7d85897d-cmlk8" event={"ID":"772d3fda-a57a-4ead-bd9e-da3f01168340","Type":"ContainerStarted","Data":"e08f4a491fbe7bae942b3d75cf9f7dfb8bc7d07c4c1abceb810d3984446a4110"}
Jul 21 16:28:29.483930 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:29.483901    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-f96ng" event={"ID":"e8e4db0d-f382-4071-b02d-13cc30b80305","Type":"ContainerStarted","Data":"6d2a761a606fda203a9650ce2017cf2178e51b08e1a31ee411b1f7bf1c469c19"}
Jul 21 16:28:29.498302 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:29.498235    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kwf4m" podStartSLOduration=251.252360768 podStartE2EDuration="4m13.498216748s" totalImagesPullingTime="2.24585598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:29.497174558 +0000 UTC m=+288.435483018" watchObservedRunningTime="2026-07-21 16:28:29.498216748 +0000 UTC m=+288.436525196"
Jul 21 16:28:36.577685 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:36.577613    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-k5rhr" podUID="46a4fa95-e3f4-4b04-a202-4347da90724d"
Jul 21 16:28:38.434360 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:38.434181    2578 patch_prober.go:28] interesting pod/image-registry-8655c54564-p4jfc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 16:28:38.434360 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:38.434241    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8655c54564-p4jfc" podUID="e0519940-0341-4cf7-be0e-f4dfe9debd21" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 16:28:39.491523 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:39.491485    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kwf4m"
Jul 21 16:28:39.527744 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:39.527706    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-wfs6v" event={"ID":"18981a60-fae7-495a-b8f3-a5510af00008","Type":"ContainerStarted","Data":"da3648dbde4be6935941c52d124fe8849c09a97b93a4c2658302a5c1932767e9"}
Jul 21 16:28:39.528497 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:39.528417    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-wfs6v"
Jul 21 16:28:39.530821 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:39.530795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7d85897d-cmlk8" event={"ID":"772d3fda-a57a-4ead-bd9e-da3f01168340","Type":"ContainerStarted","Data":"b468471c8796aa84d820c3198b1dacdf1a210808414c94faf6f26a673e3d8494"}
Jul 21 16:28:39.532619 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:39.532593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-f96ng" event={"ID":"e8e4db0d-f382-4071-b02d-13cc30b80305","Type":"ContainerStarted","Data":"f39e5f0b82519c4c0a7d586e7afb08a626cf435427bd6b9a17597634badf2b0f"}
Jul 21 16:28:39.532874 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:39.532855    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-f96ng"
Jul 21 16:28:39.536068 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:39.536037    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-wfs6v"
Jul 21 16:28:39.538084 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:39.538059    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-f96ng"
Jul 21 16:28:39.545646 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:39.545598    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-wfs6v" podStartSLOduration=1.5003910679999999 podStartE2EDuration="21.545584153s" totalImagesPullingTime="20.045193085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:39.544834182 +0000 UTC m=+298.483142644" watchObservedRunningTime="2026-07-21 16:28:39.545584153 +0000 UTC m=+298.483892601"
Jul 21 16:28:39.575952 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:39.575907    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-f96ng" podStartSLOduration=2.770806752 podStartE2EDuration="12.575891047s" totalImagesPullingTime="9.805084295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:39.574594748 +0000 UTC m=+298.512903201" watchObservedRunningTime="2026-07-21 16:28:39.575891047 +0000 UTC m=+298.514199494"
Jul 21 16:28:39.595734 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:39.595680    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d7d85897d-cmlk8" podStartSLOduration=1.753852864 podStartE2EDuration="11.595663209s" totalImagesPullingTime="9.841810345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:39.593886049 +0000 UTC m=+298.532194498" watchObservedRunningTime="2026-07-21 16:28:39.595663209 +0000 UTC m=+298.533971657"
Jul 21 16:28:41.476299 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:41.476276    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 16:28:43.458000 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.457933    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8655c54564-p4jfc" podUID="e0519940-0341-4cf7-be0e-f4dfe9debd21" containerName="registry" containerID="cri-o://3cb97718afb172a79e72e521edb66cdc630ecdc80d6b24b5d639fe34f463719f" gracePeriod=30
Jul 21 16:28:43.774442 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.774410    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:28:43.893010 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.892968    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0519940-0341-4cf7-be0e-f4dfe9debd21-image-registry-private-configuration\") pod \"e0519940-0341-4cf7-be0e-f4dfe9debd21\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") "
Jul 21 16:28:43.893193 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.893022    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0519940-0341-4cf7-be0e-f4dfe9debd21-trusted-ca\") pod \"e0519940-0341-4cf7-be0e-f4dfe9debd21\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") "
Jul 21 16:28:43.893193 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.893050    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls\") pod \"e0519940-0341-4cf7-be0e-f4dfe9debd21\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") "
Jul 21 16:28:43.893193 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.893077    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0519940-0341-4cf7-be0e-f4dfe9debd21-ca-trust-extracted\") pod \"e0519940-0341-4cf7-be0e-f4dfe9debd21\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") "
Jul 21 16:28:43.893193 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.893108    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0519940-0341-4cf7-be0e-f4dfe9debd21-installation-pull-secrets\") pod \"e0519940-0341-4cf7-be0e-f4dfe9debd21\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") "
Jul 21 16:28:43.893193 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.893176    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh8td\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-kube-api-access-vh8td\") pod \"e0519940-0341-4cf7-be0e-f4dfe9debd21\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") "
Jul 21 16:28:43.893439 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.893207    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-certificates\") pod \"e0519940-0341-4cf7-be0e-f4dfe9debd21\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") "
Jul 21 16:28:43.893439 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.893239    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-bound-sa-token\") pod \"e0519940-0341-4cf7-be0e-f4dfe9debd21\" (UID: \"e0519940-0341-4cf7-be0e-f4dfe9debd21\") "
Jul 21 16:28:43.893599 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.893460    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0519940-0341-4cf7-be0e-f4dfe9debd21-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e0519940-0341-4cf7-be0e-f4dfe9debd21" (UID: "e0519940-0341-4cf7-be0e-f4dfe9debd21"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:28:43.894100 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.894049    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e0519940-0341-4cf7-be0e-f4dfe9debd21" (UID: "e0519940-0341-4cf7-be0e-f4dfe9debd21"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:28:43.895926 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.895873    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e0519940-0341-4cf7-be0e-f4dfe9debd21" (UID: "e0519940-0341-4cf7-be0e-f4dfe9debd21"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:28:43.896039 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.895988    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e0519940-0341-4cf7-be0e-f4dfe9debd21" (UID: "e0519940-0341-4cf7-be0e-f4dfe9debd21"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:28:43.896039 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.895990    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0519940-0341-4cf7-be0e-f4dfe9debd21-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e0519940-0341-4cf7-be0e-f4dfe9debd21" (UID: "e0519940-0341-4cf7-be0e-f4dfe9debd21"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:28:43.896166 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.896139    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0519940-0341-4cf7-be0e-f4dfe9debd21-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e0519940-0341-4cf7-be0e-f4dfe9debd21" (UID: "e0519940-0341-4cf7-be0e-f4dfe9debd21"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:28:43.896708 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.896675    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-kube-api-access-vh8td" (OuterVolumeSpecName: "kube-api-access-vh8td") pod "e0519940-0341-4cf7-be0e-f4dfe9debd21" (UID: "e0519940-0341-4cf7-be0e-f4dfe9debd21"). InnerVolumeSpecName "kube-api-access-vh8td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:28:43.906052 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.906029    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0519940-0341-4cf7-be0e-f4dfe9debd21-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e0519940-0341-4cf7-be0e-f4dfe9debd21" (UID: "e0519940-0341-4cf7-be0e-f4dfe9debd21"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:28:43.994443 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.994350    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh8td\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-kube-api-access-vh8td\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:28:43.994443 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.994395    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-certificates\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:28:43.994443 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.994409    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-bound-sa-token\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:28:43.994443 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.994418    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0519940-0341-4cf7-be0e-f4dfe9debd21-image-registry-private-configuration\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:28:43.994443 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.994427    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0519940-0341-4cf7-be0e-f4dfe9debd21-trusted-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:28:43.994443 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.994436    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0519940-0341-4cf7-be0e-f4dfe9debd21-registry-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:28:43.994443 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.994444    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0519940-0341-4cf7-be0e-f4dfe9debd21-ca-trust-extracted\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:28:43.994443 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:43.994452    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0519940-0341-4cf7-be0e-f4dfe9debd21-installation-pull-secrets\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:28:44.393919 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.393877    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"]
Jul 21 16:28:44.394238 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.394213    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0519940-0341-4cf7-be0e-f4dfe9debd21" containerName="registry"
Jul 21 16:28:44.394238 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.394235    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0519940-0341-4cf7-be0e-f4dfe9debd21" containerName="registry"
Jul 21 16:28:44.394409 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.394289    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0519940-0341-4cf7-be0e-f4dfe9debd21" containerName="registry"
Jul 21 16:28:44.421573 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.421542    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"]
Jul 21 16:28:44.421748 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.421688    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:44.424360 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.424332    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cqd7p"]
Jul 21 16:28:44.425796 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.425720    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 16:28:44.425796 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.425747    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-646ck\""
Jul 21 16:28:44.426185 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.426009    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 21 16:28:44.426185 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.426072    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 21 16:28:44.438541 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.438521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.442349 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.442330    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 16:28:44.442623 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.442601    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 16:28:44.443481 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.443464    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 16:28:44.444019 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.443999    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7zcbj\""
Jul 21 16:28:44.449675 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.449656    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-xzr58"]
Jul 21 16:28:44.461177 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.461156    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.465136 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.465114    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 21 16:28:44.465790 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.465771    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 21 16:28:44.466096 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.466078    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2r9pz\""
Jul 21 16:28:44.467126 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.466961    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 21 16:28:44.477693 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.477669    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-xzr58"]
Jul 21 16:28:44.553507 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.553478    2578 generic.go:356] "Generic (PLEG): container finished" podID="e0519940-0341-4cf7-be0e-f4dfe9debd21" containerID="3cb97718afb172a79e72e521edb66cdc630ecdc80d6b24b5d639fe34f463719f" exitCode=0
Jul 21 16:28:44.553682 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.553524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8655c54564-p4jfc" event={"ID":"e0519940-0341-4cf7-be0e-f4dfe9debd21","Type":"ContainerDied","Data":"3cb97718afb172a79e72e521edb66cdc630ecdc80d6b24b5d639fe34f463719f"}
Jul 21 16:28:44.553682 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.553548    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8655c54564-p4jfc"
Jul 21 16:28:44.553682 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.553573    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8655c54564-p4jfc" event={"ID":"e0519940-0341-4cf7-be0e-f4dfe9debd21","Type":"ContainerDied","Data":"eb8c166b17804a1b8671591d06cfd87309a700a55664e9213ebe55fd2e2b64ff"}
Jul 21 16:28:44.553682 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.553611    2578 scope.go:117] "RemoveContainer" containerID="3cb97718afb172a79e72e521edb66cdc630ecdc80d6b24b5d639fe34f463719f"
Jul 21 16:28:44.563476 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.563447    2578 scope.go:117] "RemoveContainer" containerID="3cb97718afb172a79e72e521edb66cdc630ecdc80d6b24b5d639fe34f463719f"
Jul 21 16:28:44.563856 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:44.563830    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cb97718afb172a79e72e521edb66cdc630ecdc80d6b24b5d639fe34f463719f\": container with ID starting with 3cb97718afb172a79e72e521edb66cdc630ecdc80d6b24b5d639fe34f463719f not found: ID does not exist" containerID="3cb97718afb172a79e72e521edb66cdc630ecdc80d6b24b5d639fe34f463719f"
Jul 21 16:28:44.563957 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.563866    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb97718afb172a79e72e521edb66cdc630ecdc80d6b24b5d639fe34f463719f"} err="failed to get container status \"3cb97718afb172a79e72e521edb66cdc630ecdc80d6b24b5d639fe34f463719f\": rpc error: code = NotFound desc = could not find container \"3cb97718afb172a79e72e521edb66cdc630ecdc80d6b24b5d639fe34f463719f\": container with ID starting with 3cb97718afb172a79e72e521edb66cdc630ecdc80d6b24b5d639fe34f463719f not found: ID does not exist"
Jul 21 16:28:44.576386 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.576361    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8655c54564-p4jfc"]
Jul 21 16:28:44.580992 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.580964    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8655c54564-p4jfc"]
Jul 21 16:28:44.599010 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.598982    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43702191-d958-45d3-9e72-b383bf98d285-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bvz5l\" (UID: \"43702191-d958-45d3-9e72-b383bf98d285\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:44.599163 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22d077db-f6eb-4694-bf82-e04645da4827-root\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.599163 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43702191-d958-45d3-9e72-b383bf98d285-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bvz5l\" (UID: \"43702191-d958-45d3-9e72-b383bf98d285\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:44.599163 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-tls\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.599163 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22d077db-f6eb-4694-bf82-e04645da4827-sys\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.599342 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.599342 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5ff34ef7-59df-4a3f-baf3-c2811578ade8-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.599342 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599231    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-textfile\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.599342 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599294    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5ff34ef7-59df-4a3f-baf3-c2811578ade8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.599509 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-accelerators-collector-config\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.599509 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599401    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whvxv\" (UniqueName: \"kubernetes.io/projected/5ff34ef7-59df-4a3f-baf3-c2811578ade8-kube-api-access-whvxv\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.599509 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599473    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/43702191-d958-45d3-9e72-b383bf98d285-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bvz5l\" (UID: \"43702191-d958-45d3-9e72-b383bf98d285\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:44.599659 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ff34ef7-59df-4a3f-baf3-c2811578ade8-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.599659 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22d077db-f6eb-4694-bf82-e04645da4827-metrics-client-ca\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.599659 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwqws\" (UniqueName: \"kubernetes.io/projected/43702191-d958-45d3-9e72-b383bf98d285-kube-api-access-bwqws\") pod \"openshift-state-metrics-79f6958cdf-bvz5l\" (UID: \"43702191-d958-45d3-9e72-b383bf98d285\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:44.599659 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599628    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cc2t\" (UniqueName: \"kubernetes.io/projected/22d077db-f6eb-4694-bf82-e04645da4827-kube-api-access-7cc2t\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.599845 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-wtmp\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.599845 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ff34ef7-59df-4a3f-baf3-c2811578ade8-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.599845 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.599729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ff34ef7-59df-4a3f-baf3-c2811578ade8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.700929 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.700847    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/43702191-d958-45d3-9e72-b383bf98d285-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bvz5l\" (UID: \"43702191-d958-45d3-9e72-b383bf98d285\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:44.700929 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.700888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ff34ef7-59df-4a3f-baf3-c2811578ade8-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.700929 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.700914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22d077db-f6eb-4694-bf82-e04645da4827-metrics-client-ca\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.701201 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:44.701071    2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 21 16:28:44.701201 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:28:44.701140    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43702191-d958-45d3-9e72-b383bf98d285-openshift-state-metrics-tls podName:43702191-d958-45d3-9e72-b383bf98d285 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:45.201117514 +0000 UTC m=+304.139425963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/43702191-d958-45d3-9e72-b383bf98d285-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-bvz5l" (UID: "43702191-d958-45d3-9e72-b383bf98d285") : secret "openshift-state-metrics-tls" not found
Jul 21 16:28:44.701201 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwqws\" (UniqueName: \"kubernetes.io/projected/43702191-d958-45d3-9e72-b383bf98d285-kube-api-access-bwqws\") pod \"openshift-state-metrics-79f6958cdf-bvz5l\" (UID: \"43702191-d958-45d3-9e72-b383bf98d285\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:44.701363 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701208    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cc2t\" (UniqueName: \"kubernetes.io/projected/22d077db-f6eb-4694-bf82-e04645da4827-kube-api-access-7cc2t\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.701363 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-wtmp\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.701363 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ff34ef7-59df-4a3f-baf3-c2811578ade8-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.701363 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ff34ef7-59df-4a3f-baf3-c2811578ade8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.701363 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701328    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43702191-d958-45d3-9e72-b383bf98d285-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bvz5l\" (UID: \"43702191-d958-45d3-9e72-b383bf98d285\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:44.701363 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22d077db-f6eb-4694-bf82-e04645da4827-root\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.701693 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43702191-d958-45d3-9e72-b383bf98d285-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bvz5l\" (UID: \"43702191-d958-45d3-9e72-b383bf98d285\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:44.701693 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701418    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-tls\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.701693 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22d077db-f6eb-4694-bf82-e04645da4827-sys\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.701693 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.701693 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22d077db-f6eb-4694-bf82-e04645da4827-metrics-client-ca\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.701693 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5ff34ef7-59df-4a3f-baf3-c2811578ade8-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.701995 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ff34ef7-59df-4a3f-baf3-c2811578ade8-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.701995 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.701803    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5ff34ef7-59df-4a3f-baf3-c2811578ade8-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.702696 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.702157    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22d077db-f6eb-4694-bf82-e04645da4827-root\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.702696 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.702501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43702191-d958-45d3-9e72-b383bf98d285-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bvz5l\" (UID: \"43702191-d958-45d3-9e72-b383bf98d285\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:44.702696 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.702555    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-textfile\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.702985 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.702856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-textfile\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.702985 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.702943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5ff34ef7-59df-4a3f-baf3-c2811578ade8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.702985 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.702982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-accelerators-collector-config\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.703143 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.703019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvxv\" (UniqueName: \"kubernetes.io/projected/5ff34ef7-59df-4a3f-baf3-c2811578ade8-kube-api-access-whvxv\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.703360 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.703339    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22d077db-f6eb-4694-bf82-e04645da4827-sys\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.703785 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.703735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-wtmp\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.703912 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.703881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5ff34ef7-59df-4a3f-baf3-c2811578ade8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.703912 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.703888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-accelerators-collector-config\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.704719 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.704681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-tls\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.704865 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.704823    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ff34ef7-59df-4a3f-baf3-c2811578ade8-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.705069 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.705047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22d077db-f6eb-4694-bf82-e04645da4827-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.705170 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.705142    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43702191-d958-45d3-9e72-b383bf98d285-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bvz5l\" (UID: \"43702191-d958-45d3-9e72-b383bf98d285\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:44.706233 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.706214    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ff34ef7-59df-4a3f-baf3-c2811578ade8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.712034 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.711986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cc2t\" (UniqueName: \"kubernetes.io/projected/22d077db-f6eb-4694-bf82-e04645da4827-kube-api-access-7cc2t\") pod \"node-exporter-cqd7p\" (UID: \"22d077db-f6eb-4694-bf82-e04645da4827\") " pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.713078 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.713056    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whvxv\" (UniqueName: \"kubernetes.io/projected/5ff34ef7-59df-4a3f-baf3-c2811578ade8-kube-api-access-whvxv\") pod \"kube-state-metrics-56c5594674-xzr58\" (UID: \"5ff34ef7-59df-4a3f-baf3-c2811578ade8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.713217 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.713180    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwqws\" (UniqueName: \"kubernetes.io/projected/43702191-d958-45d3-9e72-b383bf98d285-kube-api-access-bwqws\") pod \"openshift-state-metrics-79f6958cdf-bvz5l\" (UID: \"43702191-d958-45d3-9e72-b383bf98d285\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:44.748784 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.748753    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cqd7p"
Jul 21 16:28:44.770687 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.770652    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58"
Jul 21 16:28:44.779269 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:28:44.779237    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d077db_f6eb_4694_bf82_e04645da4827.slice/crio-c7d87aaef31b497f7d921b83c2d55bffac8ae10cefa1bcbde931a1311967a52c WatchSource:0}: Error finding container c7d87aaef31b497f7d921b83c2d55bffac8ae10cefa1bcbde931a1311967a52c: Status 404 returned error can't find the container with id c7d87aaef31b497f7d921b83c2d55bffac8ae10cefa1bcbde931a1311967a52c
Jul 21 16:28:44.781357 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.781339    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:28:44.940582 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:44.940553    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-xzr58"]
Jul 21 16:28:44.944114 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:28:44.944080    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff34ef7_59df_4a3f_baf3_c2811578ade8.slice/crio-8979dc0b26074480ffb3e81baf92d3771437360bfa629e2c56b494e8a7d74299 WatchSource:0}: Error finding container 8979dc0b26074480ffb3e81baf92d3771437360bfa629e2c56b494e8a7d74299: Status 404 returned error can't find the container with id 8979dc0b26074480ffb3e81baf92d3771437360bfa629e2c56b494e8a7d74299
Jul 21 16:28:45.208330 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:45.208292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/43702191-d958-45d3-9e72-b383bf98d285-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bvz5l\" (UID: \"43702191-d958-45d3-9e72-b383bf98d285\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:45.211102 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:45.211066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/43702191-d958-45d3-9e72-b383bf98d285-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bvz5l\" (UID: \"43702191-d958-45d3-9e72-b383bf98d285\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:45.333550 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:45.333511    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"
Jul 21 16:28:45.534566 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:45.534481    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l"]
Jul 21 16:28:45.538695 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:28:45.538633    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43702191_d958_45d3_9e72_b383bf98d285.slice/crio-9b568135c7e8000001012b2d7a5a213e9f045c8ae3841efe61370f6ec8536349 WatchSource:0}: Error finding container 9b568135c7e8000001012b2d7a5a213e9f045c8ae3841efe61370f6ec8536349: Status 404 returned error can't find the container with id 9b568135c7e8000001012b2d7a5a213e9f045c8ae3841efe61370f6ec8536349
Jul 21 16:28:45.563315 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:45.563231    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l" event={"ID":"43702191-d958-45d3-9e72-b383bf98d285","Type":"ContainerStarted","Data":"9b568135c7e8000001012b2d7a5a213e9f045c8ae3841efe61370f6ec8536349"}
Jul 21 16:28:45.564903 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:45.564860    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58" event={"ID":"5ff34ef7-59df-4a3f-baf3-c2811578ade8","Type":"ContainerStarted","Data":"8979dc0b26074480ffb3e81baf92d3771437360bfa629e2c56b494e8a7d74299"}
Jul 21 16:28:45.566333 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:45.566304    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cqd7p" event={"ID":"22d077db-f6eb-4694-bf82-e04645da4827","Type":"ContainerStarted","Data":"c7d87aaef31b497f7d921b83c2d55bffac8ae10cefa1bcbde931a1311967a52c"}
Jul 21 16:28:45.583710 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:45.583679    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0519940-0341-4cf7-be0e-f4dfe9debd21" path="/var/lib/kubelet/pods/e0519940-0341-4cf7-be0e-f4dfe9debd21/volumes"
Jul 21 16:28:46.573634 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:46.573589    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l" event={"ID":"43702191-d958-45d3-9e72-b383bf98d285","Type":"ContainerStarted","Data":"efa0d238b2b56196d0108951c9925625f3b7ccc86054173c2e76c912fdaa1298"}
Jul 21 16:28:46.574193 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:46.573721    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l" event={"ID":"43702191-d958-45d3-9e72-b383bf98d285","Type":"ContainerStarted","Data":"a770e727a9359b1704ab6f9bb7afaba0e7c919a8afbc4b14fab626e12ebd95d4"}
Jul 21 16:28:47.427469 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.427437    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-748cbf9467-znfdf"]
Jul 21 16:28:47.447228 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.447197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-748cbf9467-znfdf"]
Jul 21 16:28:47.447394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.447335    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.449968 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.449700    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 21 16:28:47.449968 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.449768    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wt2m9\""
Jul 21 16:28:47.449968 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.449839    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 21 16:28:47.449968 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.449850    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 21 16:28:47.450298 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.449979    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-73f5gupd89rph\""
Jul 21 16:28:47.450298 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.449985    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 21 16:28:47.450298 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.450078    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 21 16:28:47.530740 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.530706    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.530897 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.530742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj2gz\" (UniqueName: \"kubernetes.io/projected/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-kube-api-access-fj2gz\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.530897 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.530833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-tls\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.530897 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.530883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.531058 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.530948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.531058 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.530989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.531058 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.531029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-metrics-client-ca\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.531207 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.531061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-grpc-tls\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.631595 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.631558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.631595 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.631597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj2gz\" (UniqueName: \"kubernetes.io/projected/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-kube-api-access-fj2gz\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.632167 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.631696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-tls\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.632167 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.631776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.632167 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.631837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.632167 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.631874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.632167 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.631914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-metrics-client-ca\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.632167 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.631951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-grpc-tls\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.633023 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.632999    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-metrics-client-ca\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.634706 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.634682    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.635042 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.635016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-tls\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.635146 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.635117    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.635215 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.635156    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.636005 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.635979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-grpc-tls\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.636463 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.636442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.639364 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.639341    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj2gz\" (UniqueName: \"kubernetes.io/projected/bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8-kube-api-access-fj2gz\") pod \"thanos-querier-748cbf9467-znfdf\" (UID: \"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8\") " pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.760062 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.760026    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:47.958128 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:47.958099    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-748cbf9467-znfdf"]
Jul 21 16:28:48.584547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:48.584507    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l" event={"ID":"43702191-d958-45d3-9e72-b383bf98d285","Type":"ContainerStarted","Data":"2952502ad6cba8ad5bfca06464d7f6596c55c9d310e9673cb07688a6437faef9"}
Jul 21 16:28:48.586495 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:48.586469    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58" event={"ID":"5ff34ef7-59df-4a3f-baf3-c2811578ade8","Type":"ContainerStarted","Data":"7dd88e4b5ee76f834f5472b9bbfb325bd2c01821beb740daf57d18e3f51f3b58"}
Jul 21 16:28:48.586614 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:48.586528    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58" event={"ID":"5ff34ef7-59df-4a3f-baf3-c2811578ade8","Type":"ContainerStarted","Data":"be74545037e12dea32e4f48e95d1cbdd3794e78e0641f79ed092509d7d7ab435"}
Jul 21 16:28:48.586614 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:48.586549    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58" event={"ID":"5ff34ef7-59df-4a3f-baf3-c2811578ade8","Type":"ContainerStarted","Data":"5b7eec42ccd3eac8932f3484fd3df9b3030e2896fe494a0c41d8bca731e33ce4"}
Jul 21 16:28:48.587930 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:48.587904    2578 generic.go:356] "Generic (PLEG): container finished" podID="22d077db-f6eb-4694-bf82-e04645da4827" containerID="21cba11d3446ec6a8e74fcaca0c26841a2576462caa59039bd98e13e2a461752" exitCode=0
Jul 21 16:28:48.588019 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:48.587985    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cqd7p" event={"ID":"22d077db-f6eb-4694-bf82-e04645da4827","Type":"ContainerDied","Data":"21cba11d3446ec6a8e74fcaca0c26841a2576462caa59039bd98e13e2a461752"}
Jul 21 16:28:48.589082 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:48.589062    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf" event={"ID":"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8","Type":"ContainerStarted","Data":"66cc54aaa0dcf3c115130130c4412d28f1afb7219feb7ef37cf95d9ba0da84fd"}
Jul 21 16:28:48.602450 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:48.602404    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bvz5l" podStartSLOduration=2.718254483 podStartE2EDuration="4.602391083s" totalImagesPullingTime="1.8841366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:48.601020376 +0000 UTC m=+307.539328836" watchObservedRunningTime="2026-07-21 16:28:48.602391083 +0000 UTC m=+307.540699578"
Jul 21 16:28:48.636555 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:48.636494    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-xzr58" podStartSLOduration=1.859341613 podStartE2EDuration="4.636477605s" totalImagesPullingTime="2.777135992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:48.636004525 +0000 UTC m=+307.574312984" watchObservedRunningTime="2026-07-21 16:28:48.636477605 +0000 UTC m=+307.574786054"
Jul 21 16:28:48.878668 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:48.878622    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:48.878844 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:48.878704    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:48.884250 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:48.884228    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:49.232737 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.232650    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7d85897d-cmlk8"]
Jul 21 16:28:49.276477 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.276446    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59769b599f-6cxmg"]
Jul 21 16:28:49.298118 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.298086    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59769b599f-6cxmg"]
Jul 21 16:28:49.298271 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.298196    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.348265 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.348236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-oauth-serving-cert\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.348469 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.348286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-serving-cert\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.348469 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.348311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-oauth-config\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.348469 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.348371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cftbq\" (UniqueName: \"kubernetes.io/projected/5aa87273-7e41-40e6-8d4e-0685f7b39848-kube-api-access-cftbq\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.348602 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.348483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-service-ca\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.348602 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.348530    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-config\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.348602 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.348560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-trusted-ca-bundle\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.449729 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.449696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-serving-cert\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.449729 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.449734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-oauth-config\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.450032 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.449769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cftbq\" (UniqueName: \"kubernetes.io/projected/5aa87273-7e41-40e6-8d4e-0685f7b39848-kube-api-access-cftbq\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.450032 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.449825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-service-ca\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.450032 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.449862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-config\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.450032 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.449890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-trusted-ca-bundle\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.450032 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.449961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-oauth-serving-cert\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.450751 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.450684    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-config\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.450751 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.450710    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-oauth-serving-cert\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.450937 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.450867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-service-ca\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.450937 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.450881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-trusted-ca-bundle\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.452578 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.452542    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-serving-cert\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.452814 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.452788    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-oauth-config\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.460107 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.460088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cftbq\" (UniqueName: \"kubernetes.io/projected/5aa87273-7e41-40e6-8d4e-0685f7b39848-kube-api-access-cftbq\") pod \"console-59769b599f-6cxmg\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") " pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.576678 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.576584    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:28:49.595905 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.595866    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cqd7p" event={"ID":"22d077db-f6eb-4694-bf82-e04645da4827","Type":"ContainerStarted","Data":"afbd07513727e0af0c9198c07b48fd9c52722266adda00ac5f1b484ff3b7f39b"}
Jul 21 16:28:49.596136 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.595929    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cqd7p" event={"ID":"22d077db-f6eb-4694-bf82-e04645da4827","Type":"ContainerStarted","Data":"e92205718a69471118f7484465a15b3bed42b61a6db50d07b71f0391d3cfb27d"}
Jul 21 16:28:49.599902 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.599879    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:28:49.609568 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.609544    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:49.614367 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:49.614327    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cqd7p" podStartSLOduration=2.6308889669999997 podStartE2EDuration="5.614310667s" totalImagesPullingTime="2.898590498s" totalInitContainerRuntime="84.831202ms" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:49.612959608 +0000 UTC m=+308.551268049" watchObservedRunningTime="2026-07-21 16:28:49.614310667 +0000 UTC m=+308.552619117"
Jul 21 16:28:50.264666 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.264610    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59769b599f-6cxmg"]
Jul 21 16:28:50.267259 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:28:50.267229    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa87273_7e41_40e6_8d4e_0685f7b39848.slice/crio-a4cc52a4a3be1e4168b86f16959e4b8d6f8334119d40521ab9cfc74addf2f533 WatchSource:0}: Error finding container a4cc52a4a3be1e4168b86f16959e4b8d6f8334119d40521ab9cfc74addf2f533: Status 404 returned error can't find the container with id a4cc52a4a3be1e4168b86f16959e4b8d6f8334119d40521ab9cfc74addf2f533
Jul 21 16:28:50.601414 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.601380    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf" event={"ID":"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8","Type":"ContainerStarted","Data":"6f36a38506f50d6e4d900a4537ef46d63219a21b09d280e4b0b6738bb7782b30"}
Jul 21 16:28:50.602700 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.602672    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59769b599f-6cxmg" event={"ID":"5aa87273-7e41-40e6-8d4e-0685f7b39848","Type":"ContainerStarted","Data":"be5a0747b8071cd80a4df0e3e03cf342a3c18e2a2610d63703554c686e8127db"}
Jul 21 16:28:50.602810 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.602716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59769b599f-6cxmg" event={"ID":"5aa87273-7e41-40e6-8d4e-0685f7b39848","Type":"ContainerStarted","Data":"a4cc52a4a3be1e4168b86f16959e4b8d6f8334119d40521ab9cfc74addf2f533"}
Jul 21 16:28:50.618605 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.618582    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 16:28:50.632616 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.632595    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.636332 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.636308    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 16:28:50.636699 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.636667    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 16:28:50.636807 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.636698    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 16:28:50.636807 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.636762    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c8hrz\""
Jul 21 16:28:50.636920 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.636827    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 16:28:50.636920 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.636857    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 16:28:50.637029 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.636997    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 16:28:50.637088 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.637047    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dh9tm8565tadk\""
Jul 21 16:28:50.637155 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.637115    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 16:28:50.637208 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.637197    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 16:28:50.637452 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.637424    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 16:28:50.637566 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.637463    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 16:28:50.637865 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.637711    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 16:28:50.638589 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.638247    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 16:28:50.638589 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.638310    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 16:28:50.638589 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.638462    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 16:28:50.640442 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.640421    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 16:28:50.641040 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.641021    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 16:28:50.651941 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.651893    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59769b599f-6cxmg" podStartSLOduration=1.6518752540000001 podStartE2EDuration="1.651875254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:50.650068275 +0000 UTC m=+309.588376724" watchObservedRunningTime="2026-07-21 16:28:50.651875254 +0000 UTC m=+309.590183702"
Jul 21 16:28:50.664235 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.664209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.664339 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.664252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/139a6da4-062c-4905-892d-6018d6db2dfb-config-out\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.664339 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.664283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.664450 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.664365    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.664500 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.664444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.664500 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.664478    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jttmh\" (UniqueName: \"kubernetes.io/projected/139a6da4-062c-4905-892d-6018d6db2dfb-kube-api-access-jttmh\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.664598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.664518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.664598 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.664550    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-web-config\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.664717 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.664633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.664770 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.664713    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.664819 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.664773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.664897 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.664878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.664948 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.664910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.664997 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.664981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.665050 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.665009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.665102 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.665057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.665153 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.665104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/139a6da4-062c-4905-892d-6018d6db2dfb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.665153 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.665129    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.665249 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.665194    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.665249 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.665228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-config\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.766932 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.766902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767012 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.766948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/139a6da4-062c-4905-892d-6018d6db2dfb-config-out\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767012 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.766975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767012 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767158 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767158 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jttmh\" (UniqueName: \"kubernetes.io/projected/139a6da4-062c-4905-892d-6018d6db2dfb-kube-api-access-jttmh\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767158 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767158 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-web-config\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767158 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767221    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767266    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767394 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767376    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767719 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767719 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767471    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/139a6da4-062c-4905-892d-6018d6db2dfb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767719 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767719 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.767719 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-config\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.768017 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.767933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.768368 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.768344    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.768485 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.768401    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.769877 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.769754    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.770631 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.770320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.772245 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.770892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.772245 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.771009    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/139a6da4-062c-4905-892d-6018d6db2dfb-config-out\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.772245 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.771218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.772245 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.771260    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/139a6da4-062c-4905-892d-6018d6db2dfb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.772245 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.771476    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.772245 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.771534    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-web-config\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.772245 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.771684    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.772245 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.772101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-config\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.772245 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.772198    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.772829 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.772581    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.773307 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.773282    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.773392 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.773361    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.773702 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.773680    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/139a6da4-062c-4905-892d-6018d6db2dfb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.774253 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.774229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/139a6da4-062c-4905-892d-6018d6db2dfb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.775006 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.774987    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jttmh\" (UniqueName: \"kubernetes.io/projected/139a6da4-062c-4905-892d-6018d6db2dfb-kube-api-access-jttmh\") pod \"prometheus-k8s-0\" (UID: \"139a6da4-062c-4905-892d-6018d6db2dfb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:50.966827 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:50.966793    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:28:51.128551 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:51.128511    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 16:28:51.132715 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:28:51.132689    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139a6da4_062c_4905_892d_6018d6db2dfb.slice/crio-5f633f106e51c2f43583b8dd65e1fa6e1ff23126e6b560a676c688074c0a3251 WatchSource:0}: Error finding container 5f633f106e51c2f43583b8dd65e1fa6e1ff23126e6b560a676c688074c0a3251: Status 404 returned error can't find the container with id 5f633f106e51c2f43583b8dd65e1fa6e1ff23126e6b560a676c688074c0a3251
Jul 21 16:28:51.608680 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:51.608626    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf" event={"ID":"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8","Type":"ContainerStarted","Data":"63de9de7cab270b33d3557fa9559126ebb525692f99edf5b3117c4b1fb9f2995"}
Jul 21 16:28:51.609168 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:51.608729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf" event={"ID":"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8","Type":"ContainerStarted","Data":"4b92a43b353bf81ce65b68d4198c1165763b2e0b6d40ce7d46c670ab24909482"}
Jul 21 16:28:51.610057 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:51.610020    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"139a6da4-062c-4905-892d-6018d6db2dfb","Type":"ContainerStarted","Data":"5f633f106e51c2f43583b8dd65e1fa6e1ff23126e6b560a676c688074c0a3251"}
Jul 21 16:28:53.620828 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:53.620791    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf" event={"ID":"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8","Type":"ContainerStarted","Data":"1a4a1db39b6361105f3b38f7b6668dd0e839d24ef98cd68e4d3f3ecd0e983df6"}
Jul 21 16:28:53.621316 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:53.620861    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf" event={"ID":"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8","Type":"ContainerStarted","Data":"c3904cc8edecd832324c2ece9a18e96e92725a90d555753cb1ec476f69118cbb"}
Jul 21 16:28:53.621316 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:53.620900    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf" event={"ID":"bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8","Type":"ContainerStarted","Data":"a8ff426d6b0a22860788f24460c9a3dbbbffb5db1729c8acd910fd8445b065dd"}
Jul 21 16:28:53.621316 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:53.620945    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:28:53.622342 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:53.622316    2578 generic.go:356] "Generic (PLEG): container finished" podID="139a6da4-062c-4905-892d-6018d6db2dfb" containerID="167e4273013dd65decafc8a1afe2b806714b6f159aca8c7626ca1eaed20514f8" exitCode=0
Jul 21 16:28:53.622460 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:53.622390    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"139a6da4-062c-4905-892d-6018d6db2dfb","Type":"ContainerDied","Data":"167e4273013dd65decafc8a1afe2b806714b6f159aca8c7626ca1eaed20514f8"}
Jul 21 16:28:53.641923 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:53.641875    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf" podStartSLOduration=2.425248867 podStartE2EDuration="6.641857284s" totalImagesPullingTime="4.216608417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:53.64056616 +0000 UTC m=+312.578874609" watchObservedRunningTime="2026-07-21 16:28:53.641857284 +0000 UTC m=+312.580165734"
Jul 21 16:28:54.685902 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:54.685862    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59769b599f-6cxmg"]
Jul 21 16:28:57.641358 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:57.641335    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"139a6da4-062c-4905-892d-6018d6db2dfb","Type":"ContainerStarted","Data":"cbd6671af12fb703b78863272ae7d9f37854e0c7124d7a56a4f32538e45aea27"}
Jul 21 16:28:57.641666 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:57.641395    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"139a6da4-062c-4905-892d-6018d6db2dfb","Type":"ContainerStarted","Data":"138460af393fbb485e1544cb4425e9b38c3fe03f2723b0c90c3f3c9bc051373c"}
Jul 21 16:28:57.641666 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:57.641421    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"139a6da4-062c-4905-892d-6018d6db2dfb","Type":"ContainerStarted","Data":"2cca6e3bf5e4d19172ff29675566355f7f63eaaa7477bdf3dc21924511574b6a"}
Jul 21 16:28:57.641666 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:57.641445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"139a6da4-062c-4905-892d-6018d6db2dfb","Type":"ContainerStarted","Data":"838d56f3552f46ff2680e8ce66870fab9f542dff95096625a850b188f6be739e"}
Jul 21 16:28:58.648758 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:58.648725    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"139a6da4-062c-4905-892d-6018d6db2dfb","Type":"ContainerStarted","Data":"68b20bae59b4ac03ccd62cca1eec874132fbb125c46bdd28410a07e097ef05e0"}
Jul 21 16:28:58.649245 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:58.648785    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"139a6da4-062c-4905-892d-6018d6db2dfb","Type":"ContainerStarted","Data":"2d996c136271c677011e462f342605dc35de65acd069be8cf42015f624c19af0"}
Jul 21 16:28:58.678239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:58.678183    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.748703254 podStartE2EDuration="8.678166711s" totalImagesPullingTime="4.910348469s" totalInitContainerRuntime="19.114988ms" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:58.675766538 +0000 UTC m=+317.614074983" watchObservedRunningTime="2026-07-21 16:28:58.678166711 +0000 UTC m=+317.616475152"
Jul 21 16:28:59.610384 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:59.610353    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:28:59.633850 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:28:59.633825    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-748cbf9467-znfdf"
Jul 21 16:29:00.967835 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:00.967804    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:29:15.623728 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.623670    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d7d85897d-cmlk8" podUID="772d3fda-a57a-4ead-bd9e-da3f01168340" containerName="console" containerID="cri-o://b468471c8796aa84d820c3198b1dacdf1a210808414c94faf6f26a673e3d8494" gracePeriod=15
Jul 21 16:29:15.909839 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.909774    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:29:15.988389 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.988358    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/772d3fda-a57a-4ead-bd9e-da3f01168340-console-serving-cert\") pod \"772d3fda-a57a-4ead-bd9e-da3f01168340\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") "
Jul 21 16:29:15.988531 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.988416    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-console-config\") pod \"772d3fda-a57a-4ead-bd9e-da3f01168340\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") "
Jul 21 16:29:15.988531 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.988444    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/772d3fda-a57a-4ead-bd9e-da3f01168340-console-oauth-config\") pod \"772d3fda-a57a-4ead-bd9e-da3f01168340\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") "
Jul 21 16:29:15.988606 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.988571    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-service-ca\") pod \"772d3fda-a57a-4ead-bd9e-da3f01168340\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") "
Jul 21 16:29:15.988668 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.988655    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-772n7\" (UniqueName: \"kubernetes.io/projected/772d3fda-a57a-4ead-bd9e-da3f01168340-kube-api-access-772n7\") pod \"772d3fda-a57a-4ead-bd9e-da3f01168340\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") "
Jul 21 16:29:15.988711 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.988698    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-trusted-ca-bundle\") pod \"772d3fda-a57a-4ead-bd9e-da3f01168340\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") "
Jul 21 16:29:15.988768 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.988752    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-oauth-serving-cert\") pod \"772d3fda-a57a-4ead-bd9e-da3f01168340\" (UID: \"772d3fda-a57a-4ead-bd9e-da3f01168340\") "
Jul 21 16:29:15.988867 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.988844    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-console-config" (OuterVolumeSpecName: "console-config") pod "772d3fda-a57a-4ead-bd9e-da3f01168340" (UID: "772d3fda-a57a-4ead-bd9e-da3f01168340"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:15.988993 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.988968    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-service-ca" (OuterVolumeSpecName: "service-ca") pod "772d3fda-a57a-4ead-bd9e-da3f01168340" (UID: "772d3fda-a57a-4ead-bd9e-da3f01168340"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:15.989094 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.989060    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-console-config\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:29:15.989094 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.989077    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "772d3fda-a57a-4ead-bd9e-da3f01168340" (UID: "772d3fda-a57a-4ead-bd9e-da3f01168340"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:15.989205 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.989126    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "772d3fda-a57a-4ead-bd9e-da3f01168340" (UID: "772d3fda-a57a-4ead-bd9e-da3f01168340"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:15.990619 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.990588    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/772d3fda-a57a-4ead-bd9e-da3f01168340-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "772d3fda-a57a-4ead-bd9e-da3f01168340" (UID: "772d3fda-a57a-4ead-bd9e-da3f01168340"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:29:15.990776 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.990653    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/772d3fda-a57a-4ead-bd9e-da3f01168340-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "772d3fda-a57a-4ead-bd9e-da3f01168340" (UID: "772d3fda-a57a-4ead-bd9e-da3f01168340"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:29:15.990776 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:15.990697    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/772d3fda-a57a-4ead-bd9e-da3f01168340-kube-api-access-772n7" (OuterVolumeSpecName: "kube-api-access-772n7") pod "772d3fda-a57a-4ead-bd9e-da3f01168340" (UID: "772d3fda-a57a-4ead-bd9e-da3f01168340"). InnerVolumeSpecName "kube-api-access-772n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:29:16.090299 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.090258    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/772d3fda-a57a-4ead-bd9e-da3f01168340-console-oauth-config\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:29:16.090299 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.090294    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:29:16.090299 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.090307    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-772n7\" (UniqueName: \"kubernetes.io/projected/772d3fda-a57a-4ead-bd9e-da3f01168340-kube-api-access-772n7\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:29:16.090529 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.090320    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-trusted-ca-bundle\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:29:16.090529 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.090331    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/772d3fda-a57a-4ead-bd9e-da3f01168340-oauth-serving-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:29:16.090529 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.090344    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/772d3fda-a57a-4ead-bd9e-da3f01168340-console-serving-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:29:16.718276 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.718234    2578 generic.go:356] "Generic (PLEG): container finished" podID="772d3fda-a57a-4ead-bd9e-da3f01168340" containerID="b468471c8796aa84d820c3198b1dacdf1a210808414c94faf6f26a673e3d8494" exitCode=0
Jul 21 16:29:16.718733 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.718281    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7d85897d-cmlk8"
Jul 21 16:29:16.718733 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.718320    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7d85897d-cmlk8" event={"ID":"772d3fda-a57a-4ead-bd9e-da3f01168340","Type":"ContainerDied","Data":"b468471c8796aa84d820c3198b1dacdf1a210808414c94faf6f26a673e3d8494"}
Jul 21 16:29:16.718733 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.718376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7d85897d-cmlk8" event={"ID":"772d3fda-a57a-4ead-bd9e-da3f01168340","Type":"ContainerDied","Data":"e08f4a491fbe7bae942b3d75cf9f7dfb8bc7d07c4c1abceb810d3984446a4110"}
Jul 21 16:29:16.718733 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.718398    2578 scope.go:117] "RemoveContainer" containerID="b468471c8796aa84d820c3198b1dacdf1a210808414c94faf6f26a673e3d8494"
Jul 21 16:29:16.727302 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.727280    2578 scope.go:117] "RemoveContainer" containerID="b468471c8796aa84d820c3198b1dacdf1a210808414c94faf6f26a673e3d8494"
Jul 21 16:29:16.727539 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:29:16.727522    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b468471c8796aa84d820c3198b1dacdf1a210808414c94faf6f26a673e3d8494\": container with ID starting with b468471c8796aa84d820c3198b1dacdf1a210808414c94faf6f26a673e3d8494 not found: ID does not exist" containerID="b468471c8796aa84d820c3198b1dacdf1a210808414c94faf6f26a673e3d8494"
Jul 21 16:29:16.727604 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.727550    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b468471c8796aa84d820c3198b1dacdf1a210808414c94faf6f26a673e3d8494"} err="failed to get container status \"b468471c8796aa84d820c3198b1dacdf1a210808414c94faf6f26a673e3d8494\": rpc error: code = NotFound desc = could not find container \"b468471c8796aa84d820c3198b1dacdf1a210808414c94faf6f26a673e3d8494\": container with ID starting with b468471c8796aa84d820c3198b1dacdf1a210808414c94faf6f26a673e3d8494 not found: ID does not exist"
Jul 21 16:29:16.740703 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.740677    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7d85897d-cmlk8"]
Jul 21 16:29:16.745822 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:16.745798    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d7d85897d-cmlk8"]
Jul 21 16:29:17.581725 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:17.581691    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="772d3fda-a57a-4ead-bd9e-da3f01168340" path="/var/lib/kubelet/pods/772d3fda-a57a-4ead-bd9e-da3f01168340/volumes"
Jul 21 16:29:19.710445 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:19.710391    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59769b599f-6cxmg" podUID="5aa87273-7e41-40e6-8d4e-0685f7b39848" containerName="console" containerID="cri-o://be5a0747b8071cd80a4df0e3e03cf342a3c18e2a2610d63703554c686e8127db" gracePeriod=15
Jul 21 16:29:19.732926 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:19.732904    2578 generic.go:356] "Generic (PLEG): container finished" podID="4e6799be-b3d3-475f-a5ae-abd18aa4164b" containerID="8c61413fd9e525c4f7a14c2b022d533e785f547d14b7ac1a56d29f5824d9c960" exitCode=0
Jul 21 16:29:19.733012 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:19.732976    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf" event={"ID":"4e6799be-b3d3-475f-a5ae-abd18aa4164b","Type":"ContainerDied","Data":"8c61413fd9e525c4f7a14c2b022d533e785f547d14b7ac1a56d29f5824d9c960"}
Jul 21 16:29:19.733361 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:19.733346    2578 scope.go:117] "RemoveContainer" containerID="8c61413fd9e525c4f7a14c2b022d533e785f547d14b7ac1a56d29f5824d9c960"
Jul 21 16:29:19.997302 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:19.997276    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:29:20.129483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.129387    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cftbq\" (UniqueName: \"kubernetes.io/projected/5aa87273-7e41-40e6-8d4e-0685f7b39848-kube-api-access-cftbq\") pod \"5aa87273-7e41-40e6-8d4e-0685f7b39848\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") "
Jul 21 16:29:20.129483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.129440    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-oauth-serving-cert\") pod \"5aa87273-7e41-40e6-8d4e-0685f7b39848\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") "
Jul 21 16:29:20.129747 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.129547    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-serving-cert\") pod \"5aa87273-7e41-40e6-8d4e-0685f7b39848\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") "
Jul 21 16:29:20.129747 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.129600    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-service-ca\") pod \"5aa87273-7e41-40e6-8d4e-0685f7b39848\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") "
Jul 21 16:29:20.129855 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.129814    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5aa87273-7e41-40e6-8d4e-0685f7b39848" (UID: "5aa87273-7e41-40e6-8d4e-0685f7b39848"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:20.129948 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.129925    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-service-ca" (OuterVolumeSpecName: "service-ca") pod "5aa87273-7e41-40e6-8d4e-0685f7b39848" (UID: "5aa87273-7e41-40e6-8d4e-0685f7b39848"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:20.130006 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.129946    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-config\") pod \"5aa87273-7e41-40e6-8d4e-0685f7b39848\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") "
Jul 21 16:29:20.130006 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.129990    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-trusted-ca-bundle\") pod \"5aa87273-7e41-40e6-8d4e-0685f7b39848\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") "
Jul 21 16:29:20.130106 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.130022    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-oauth-config\") pod \"5aa87273-7e41-40e6-8d4e-0685f7b39848\" (UID: \"5aa87273-7e41-40e6-8d4e-0685f7b39848\") "
Jul 21 16:29:20.130201 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.130180    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-config" (OuterVolumeSpecName: "console-config") pod "5aa87273-7e41-40e6-8d4e-0685f7b39848" (UID: "5aa87273-7e41-40e6-8d4e-0685f7b39848"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:20.130351 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.130332    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5aa87273-7e41-40e6-8d4e-0685f7b39848" (UID: "5aa87273-7e41-40e6-8d4e-0685f7b39848"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:20.130351 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.130341    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:29:20.130466 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.130369    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-config\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:29:20.130466 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.130380    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-oauth-serving-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:29:20.131881 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.131849    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aa87273-7e41-40e6-8d4e-0685f7b39848-kube-api-access-cftbq" (OuterVolumeSpecName: "kube-api-access-cftbq") pod "5aa87273-7e41-40e6-8d4e-0685f7b39848" (UID: "5aa87273-7e41-40e6-8d4e-0685f7b39848"). InnerVolumeSpecName "kube-api-access-cftbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:29:20.131881 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.131875    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5aa87273-7e41-40e6-8d4e-0685f7b39848" (UID: "5aa87273-7e41-40e6-8d4e-0685f7b39848"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:29:20.132134 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.132117    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5aa87273-7e41-40e6-8d4e-0685f7b39848" (UID: "5aa87273-7e41-40e6-8d4e-0685f7b39848"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:29:20.230930 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.230897    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cftbq\" (UniqueName: \"kubernetes.io/projected/5aa87273-7e41-40e6-8d4e-0685f7b39848-kube-api-access-cftbq\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:29:20.230930 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.230924    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-serving-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:29:20.230930 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.230934    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa87273-7e41-40e6-8d4e-0685f7b39848-trusted-ca-bundle\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:29:20.230930 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.230942    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5aa87273-7e41-40e6-8d4e-0685f7b39848-console-oauth-config\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:29:20.742871 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.742840    2578 generic.go:356] "Generic (PLEG): container finished" podID="5aa87273-7e41-40e6-8d4e-0685f7b39848" containerID="be5a0747b8071cd80a4df0e3e03cf342a3c18e2a2610d63703554c686e8127db" exitCode=0
Jul 21 16:29:20.743344 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.742892    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59769b599f-6cxmg"
Jul 21 16:29:20.743344 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.742932    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59769b599f-6cxmg" event={"ID":"5aa87273-7e41-40e6-8d4e-0685f7b39848","Type":"ContainerDied","Data":"be5a0747b8071cd80a4df0e3e03cf342a3c18e2a2610d63703554c686e8127db"}
Jul 21 16:29:20.743344 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.743020    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59769b599f-6cxmg" event={"ID":"5aa87273-7e41-40e6-8d4e-0685f7b39848","Type":"ContainerDied","Data":"a4cc52a4a3be1e4168b86f16959e4b8d6f8334119d40521ab9cfc74addf2f533"}
Jul 21 16:29:20.743344 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.743039    2578 scope.go:117] "RemoveContainer" containerID="be5a0747b8071cd80a4df0e3e03cf342a3c18e2a2610d63703554c686e8127db"
Jul 21 16:29:20.744860 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.744842    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-mwnbf" event={"ID":"4e6799be-b3d3-475f-a5ae-abd18aa4164b","Type":"ContainerStarted","Data":"be0dd26a114a8d5e2a657671d1a5f0ebdec896bfb71a5418f061f928d6ffe7e2"}
Jul 21 16:29:20.751748 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.751732    2578 scope.go:117] "RemoveContainer" containerID="be5a0747b8071cd80a4df0e3e03cf342a3c18e2a2610d63703554c686e8127db"
Jul 21 16:29:20.752011 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:29:20.751992    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be5a0747b8071cd80a4df0e3e03cf342a3c18e2a2610d63703554c686e8127db\": container with ID starting with be5a0747b8071cd80a4df0e3e03cf342a3c18e2a2610d63703554c686e8127db not found: ID does not exist" containerID="be5a0747b8071cd80a4df0e3e03cf342a3c18e2a2610d63703554c686e8127db"
Jul 21 16:29:20.752091 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.752018    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be5a0747b8071cd80a4df0e3e03cf342a3c18e2a2610d63703554c686e8127db"} err="failed to get container status \"be5a0747b8071cd80a4df0e3e03cf342a3c18e2a2610d63703554c686e8127db\": rpc error: code = NotFound desc = could not find container \"be5a0747b8071cd80a4df0e3e03cf342a3c18e2a2610d63703554c686e8127db\": container with ID starting with be5a0747b8071cd80a4df0e3e03cf342a3c18e2a2610d63703554c686e8127db not found: ID does not exist"
Jul 21 16:29:20.773764 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.773717    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59769b599f-6cxmg"]
Jul 21 16:29:20.781313 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:20.781288    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59769b599f-6cxmg"]
Jul 21 16:29:21.581993 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:21.581959    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aa87273-7e41-40e6-8d4e-0685f7b39848" path="/var/lib/kubelet/pods/5aa87273-7e41-40e6-8d4e-0685f7b39848/volumes"
Jul 21 16:29:50.967471 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:50.967435    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:29:50.985899 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:50.985875    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:29:51.886723 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:51.886697    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:29:55.407577 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:55.407535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:29:55.409799 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:55.409774    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46a4fa95-e3f4-4b04-a202-4347da90724d-metrics-certs\") pod \"network-metrics-daemon-k5rhr\" (UID: \"46a4fa95-e3f4-4b04-a202-4347da90724d\") " pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:29:55.580196 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:55.580164    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mwzzh\""
Jul 21 16:29:55.588936 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:55.588911    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5rhr"
Jul 21 16:29:55.710226 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:55.710141    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k5rhr"]
Jul 21 16:29:55.712765 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:29:55.712737    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46a4fa95_e3f4_4b04_a202_4347da90724d.slice/crio-34a6ab82134f203e9b2739e1ffd32f7e4ceb1c6d96aa2fa03100fcc1df4fbb1f WatchSource:0}: Error finding container 34a6ab82134f203e9b2739e1ffd32f7e4ceb1c6d96aa2fa03100fcc1df4fbb1f: Status 404 returned error can't find the container with id 34a6ab82134f203e9b2739e1ffd32f7e4ceb1c6d96aa2fa03100fcc1df4fbb1f
Jul 21 16:29:55.886516 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:55.886484    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k5rhr" event={"ID":"46a4fa95-e3f4-4b04-a202-4347da90724d","Type":"ContainerStarted","Data":"34a6ab82134f203e9b2739e1ffd32f7e4ceb1c6d96aa2fa03100fcc1df4fbb1f"}
Jul 21 16:29:56.891080 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:56.891052    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k5rhr" event={"ID":"46a4fa95-e3f4-4b04-a202-4347da90724d","Type":"ContainerStarted","Data":"03a214a8cd018e5acb6b7634ff79fda46cfea55533cb30922810de2ceafe6576"}
Jul 21 16:29:56.891424 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:56.891098    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k5rhr" event={"ID":"46a4fa95-e3f4-4b04-a202-4347da90724d","Type":"ContainerStarted","Data":"9370696f929c7308a1d43c9555d3ac2903363a094dc5c91df1156e0fad211771"}
Jul 21 16:29:56.908275 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:29:56.908233    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k5rhr" podStartSLOduration=374.059754437 podStartE2EDuration="6m14.90821966s" totalImagesPullingTime="848.465223ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:56.906222065 +0000 UTC m=+375.844530511" watchObservedRunningTime="2026-07-21 16:29:56.90821966 +0000 UTC m=+375.846528135"
Jul 21 16:32:17.391783 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.391746    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"]
Jul 21 16:32:17.392282 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.392058    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa87273-7e41-40e6-8d4e-0685f7b39848" containerName="console"
Jul 21 16:32:17.392282 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.392069    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa87273-7e41-40e6-8d4e-0685f7b39848" containerName="console"
Jul 21 16:32:17.392282 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.392092    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="772d3fda-a57a-4ead-bd9e-da3f01168340" containerName="console"
Jul 21 16:32:17.392282 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.392097    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="772d3fda-a57a-4ead-bd9e-da3f01168340" containerName="console"
Jul 21 16:32:17.392282 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.392146    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aa87273-7e41-40e6-8d4e-0685f7b39848" containerName="console"
Jul 21 16:32:17.392282 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.392154    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="772d3fda-a57a-4ead-bd9e-da3f01168340" containerName="console"
Jul 21 16:32:17.394011 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.393993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:17.397596 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.397574    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:32:17.397808 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.397574    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 16:32:17.397910 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.397888    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 16:32:17.398006 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.397924    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cdt8l\""
Jul 21 16:32:17.398067 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.398043    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 16:32:17.398180 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.398164    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 16:32:17.404544 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.404523    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"]
Jul 21 16:32:17.525912 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.525882    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b394d66b-58aa-4265-b86f-0c91636a0b6b-manager-config\") pod \"lws-controller-manager-76d8f8b6b-tg4hv\" (UID: \"b394d66b-58aa-4265-b86f-0c91636a0b6b\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:17.525912 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.525913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b394d66b-58aa-4265-b86f-0c91636a0b6b-metrics-cert\") pod \"lws-controller-manager-76d8f8b6b-tg4hv\" (UID: \"b394d66b-58aa-4265-b86f-0c91636a0b6b\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:17.526118 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.525946    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b394d66b-58aa-4265-b86f-0c91636a0b6b-cert\") pod \"lws-controller-manager-76d8f8b6b-tg4hv\" (UID: \"b394d66b-58aa-4265-b86f-0c91636a0b6b\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:17.526118 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.525965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74m62\" (UniqueName: \"kubernetes.io/projected/b394d66b-58aa-4265-b86f-0c91636a0b6b-kube-api-access-74m62\") pod \"lws-controller-manager-76d8f8b6b-tg4hv\" (UID: \"b394d66b-58aa-4265-b86f-0c91636a0b6b\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:17.627287 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.627258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b394d66b-58aa-4265-b86f-0c91636a0b6b-manager-config\") pod \"lws-controller-manager-76d8f8b6b-tg4hv\" (UID: \"b394d66b-58aa-4265-b86f-0c91636a0b6b\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:17.627287 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.627288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b394d66b-58aa-4265-b86f-0c91636a0b6b-metrics-cert\") pod \"lws-controller-manager-76d8f8b6b-tg4hv\" (UID: \"b394d66b-58aa-4265-b86f-0c91636a0b6b\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:17.627484 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.627313    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b394d66b-58aa-4265-b86f-0c91636a0b6b-cert\") pod \"lws-controller-manager-76d8f8b6b-tg4hv\" (UID: \"b394d66b-58aa-4265-b86f-0c91636a0b6b\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:17.627484 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.627424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74m62\" (UniqueName: \"kubernetes.io/projected/b394d66b-58aa-4265-b86f-0c91636a0b6b-kube-api-access-74m62\") pod \"lws-controller-manager-76d8f8b6b-tg4hv\" (UID: \"b394d66b-58aa-4265-b86f-0c91636a0b6b\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:17.628181 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.628158    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b394d66b-58aa-4265-b86f-0c91636a0b6b-manager-config\") pod \"lws-controller-manager-76d8f8b6b-tg4hv\" (UID: \"b394d66b-58aa-4265-b86f-0c91636a0b6b\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:17.629939 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.629920    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b394d66b-58aa-4265-b86f-0c91636a0b6b-cert\") pod \"lws-controller-manager-76d8f8b6b-tg4hv\" (UID: \"b394d66b-58aa-4265-b86f-0c91636a0b6b\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:17.630057 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.629988    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b394d66b-58aa-4265-b86f-0c91636a0b6b-metrics-cert\") pod \"lws-controller-manager-76d8f8b6b-tg4hv\" (UID: \"b394d66b-58aa-4265-b86f-0c91636a0b6b\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:17.636065 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.636043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74m62\" (UniqueName: \"kubernetes.io/projected/b394d66b-58aa-4265-b86f-0c91636a0b6b-kube-api-access-74m62\") pod \"lws-controller-manager-76d8f8b6b-tg4hv\" (UID: \"b394d66b-58aa-4265-b86f-0c91636a0b6b\") " pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:17.704360 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.704291    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:17.830108 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:17.830083    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"]
Jul 21 16:32:17.832128 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:32:17.832102    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb394d66b_58aa_4265_b86f_0c91636a0b6b.slice/crio-c2f3b818cea2267c9aa3c790cb935d215c3d1c832393c4c4684c3573efc1af76 WatchSource:0}: Error finding container c2f3b818cea2267c9aa3c790cb935d215c3d1c832393c4c4684c3573efc1af76: Status 404 returned error can't find the container with id c2f3b818cea2267c9aa3c790cb935d215c3d1c832393c4c4684c3573efc1af76
Jul 21 16:32:18.427557 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:18.427524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv" event={"ID":"b394d66b-58aa-4265-b86f-0c91636a0b6b","Type":"ContainerStarted","Data":"c2f3b818cea2267c9aa3c790cb935d215c3d1c832393c4c4684c3573efc1af76"}
Jul 21 16:32:23.450575 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:23.450534    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv" event={"ID":"b394d66b-58aa-4265-b86f-0c91636a0b6b","Type":"ContainerStarted","Data":"ca6af5a9deab8464b009cc6977d4e797395b2b4197930f9f2bbedcb3d71e23a1"}
Jul 21 16:32:23.451061 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:23.450627    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:23.472035 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:23.471990    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv" podStartSLOduration=1.350941723 podStartE2EDuration="6.471977106s" totalImagesPullingTime="5.121035383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:23.471008031 +0000 UTC m=+522.409316472" watchObservedRunningTime="2026-07-21 16:32:23.471977106 +0000 UTC m=+522.410285554"
Jul 21 16:32:26.970693 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:26.970653    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"]
Jul 21 16:32:26.972926 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:26.972904    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:26.985700 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:26.985678    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 16:32:26.985819 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:26.985716    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 16:32:26.985819 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:26.985762    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 16:32:26.985819 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:26.985719    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 16:32:26.986443 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:26.986422    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jfczg\""
Jul 21 16:32:27.026827 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.026801    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"]
Jul 21 16:32:27.113880 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.113846    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssdnx\" (UniqueName: \"kubernetes.io/projected/87027c35-a390-4a15-8974-ed0fcc5d5e81-kube-api-access-ssdnx\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.114067 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.113888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87027c35-a390-4a15-8974-ed0fcc5d5e81-tmp\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.114067 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.113973    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/87027c35-a390-4a15-8974-ed0fcc5d5e81-manifests\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.114067 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.114044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87027c35-a390-4a15-8974-ed0fcc5d5e81-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.114191 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.114102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/87027c35-a390-4a15-8974-ed0fcc5d5e81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.215222 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.215195    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/87027c35-a390-4a15-8974-ed0fcc5d5e81-manifests\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.215389 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.215231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87027c35-a390-4a15-8974-ed0fcc5d5e81-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.215389 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.215257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/87027c35-a390-4a15-8974-ed0fcc5d5e81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.215389 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.215293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssdnx\" (UniqueName: \"kubernetes.io/projected/87027c35-a390-4a15-8974-ed0fcc5d5e81-kube-api-access-ssdnx\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.215389 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.215313    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87027c35-a390-4a15-8974-ed0fcc5d5e81-tmp\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.215687 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.215627    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/87027c35-a390-4a15-8974-ed0fcc5d5e81-manifests\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.217519 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.217496    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87027c35-a390-4a15-8974-ed0fcc5d5e81-tmp\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.217650 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.217583    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/87027c35-a390-4a15-8974-ed0fcc5d5e81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.217801 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.217783    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87027c35-a390-4a15-8974-ed0fcc5d5e81-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.224093 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.224040    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssdnx\" (UniqueName: \"kubernetes.io/projected/87027c35-a390-4a15-8974-ed0fcc5d5e81-kube-api-access-ssdnx\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw\" (UID: \"87027c35-a390-4a15-8974-ed0fcc5d5e81\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.283035 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.283018    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:27.415195 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.415169    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"]
Jul 21 16:32:27.417630 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:32:27.417603    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87027c35_a390_4a15_8974_ed0fcc5d5e81.slice/crio-ad13683f8241ffe48dc0edf2dcfb615d38d1bc0563a97e26a496e63e8a519dc2 WatchSource:0}: Error finding container ad13683f8241ffe48dc0edf2dcfb615d38d1bc0563a97e26a496e63e8a519dc2: Status 404 returned error can't find the container with id ad13683f8241ffe48dc0edf2dcfb615d38d1bc0563a97e26a496e63e8a519dc2
Jul 21 16:32:27.467400 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:27.467373    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw" event={"ID":"87027c35-a390-4a15-8974-ed0fcc5d5e81","Type":"ContainerStarted","Data":"ad13683f8241ffe48dc0edf2dcfb615d38d1bc0563a97e26a496e63e8a519dc2"}
Jul 21 16:32:31.490046 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:31.490000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw" event={"ID":"87027c35-a390-4a15-8974-ed0fcc5d5e81","Type":"ContainerStarted","Data":"04c7ab2fb703bc049c0de7b50532b64a5d039e611ba0f0f4e534a533e56b8eda"}
Jul 21 16:32:32.495283 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:32.495246    2578 generic.go:356] "Generic (PLEG): container finished" podID="87027c35-a390-4a15-8974-ed0fcc5d5e81" containerID="04c7ab2fb703bc049c0de7b50532b64a5d039e611ba0f0f4e534a533e56b8eda" exitCode=0
Jul 21 16:32:32.495702 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:32.495335    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw" event={"ID":"87027c35-a390-4a15-8974-ed0fcc5d5e81","Type":"ContainerDied","Data":"04c7ab2fb703bc049c0de7b50532b64a5d039e611ba0f0f4e534a533e56b8eda"}
Jul 21 16:32:33.501543 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:33.501500    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw" event={"ID":"87027c35-a390-4a15-8974-ed0fcc5d5e81","Type":"ContainerStarted","Data":"f4b1e33dda725279bad24c55e717ca41cf9de272b3564e59ddad932d54b07cd8"}
Jul 21 16:32:33.501937 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:33.501582    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:33.525969 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:33.525924    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw" podStartSLOduration=3.116466334 podStartE2EDuration="7.525909192s" totalImagesPullingTime="3.363181557s" totalInitContainerRuntime="1.046261301s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:33.523990975 +0000 UTC m=+532.462299423" watchObservedRunningTime="2026-07-21 16:32:33.525909192 +0000 UTC m=+532.464217640"
Jul 21 16:32:34.456377 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:34.456349    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76d8f8b6b-tg4hv"
Jul 21 16:32:44.508359 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:44.508326    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw"
Jul 21 16:32:57.169222 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.169182    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54864c54db-ht5cz"]
Jul 21 16:32:57.181444 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.181410    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54864c54db-ht5cz"
Jul 21 16:32:57.188240 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.188215    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 16:32:57.188828 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.188804    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 16:32:57.189277 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.188999    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 16:32:57.189839 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.189675    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-j5lmm\""
Jul 21 16:32:57.190227 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.190208    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 16:32:57.191545 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.191524    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54864c54db-ht5cz"]
Jul 21 16:32:57.274345 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.274326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rc68\" (UniqueName: \"kubernetes.io/projected/af4d4bc5-9002-4506-8df6-51a2647d6adc-kube-api-access-7rc68\") pod \"kube-auth-proxy-54864c54db-ht5cz\" (UID: \"af4d4bc5-9002-4506-8df6-51a2647d6adc\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-ht5cz"
Jul 21 16:32:57.274439 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.274359    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af4d4bc5-9002-4506-8df6-51a2647d6adc-tls-certs\") pod \"kube-auth-proxy-54864c54db-ht5cz\" (UID: \"af4d4bc5-9002-4506-8df6-51a2647d6adc\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-ht5cz"
Jul 21 16:32:57.274439 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.274386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af4d4bc5-9002-4506-8df6-51a2647d6adc-tmp\") pod \"kube-auth-proxy-54864c54db-ht5cz\" (UID: \"af4d4bc5-9002-4506-8df6-51a2647d6adc\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-ht5cz"
Jul 21 16:32:57.374941 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.374915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rc68\" (UniqueName: \"kubernetes.io/projected/af4d4bc5-9002-4506-8df6-51a2647d6adc-kube-api-access-7rc68\") pod \"kube-auth-proxy-54864c54db-ht5cz\" (UID: \"af4d4bc5-9002-4506-8df6-51a2647d6adc\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-ht5cz"
Jul 21 16:32:57.375049 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.374957    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af4d4bc5-9002-4506-8df6-51a2647d6adc-tls-certs\") pod \"kube-auth-proxy-54864c54db-ht5cz\" (UID: \"af4d4bc5-9002-4506-8df6-51a2647d6adc\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-ht5cz"
Jul 21 16:32:57.375049 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.374998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af4d4bc5-9002-4506-8df6-51a2647d6adc-tmp\") pod \"kube-auth-proxy-54864c54db-ht5cz\" (UID: \"af4d4bc5-9002-4506-8df6-51a2647d6adc\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-ht5cz"
Jul 21 16:32:57.377232 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.377203    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af4d4bc5-9002-4506-8df6-51a2647d6adc-tmp\") pod \"kube-auth-proxy-54864c54db-ht5cz\" (UID: \"af4d4bc5-9002-4506-8df6-51a2647d6adc\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-ht5cz"
Jul 21 16:32:57.377381 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.377366    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af4d4bc5-9002-4506-8df6-51a2647d6adc-tls-certs\") pod \"kube-auth-proxy-54864c54db-ht5cz\" (UID: \"af4d4bc5-9002-4506-8df6-51a2647d6adc\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-ht5cz"
Jul 21 16:32:57.384798 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.384776    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rc68\" (UniqueName: \"kubernetes.io/projected/af4d4bc5-9002-4506-8df6-51a2647d6adc-kube-api-access-7rc68\") pod \"kube-auth-proxy-54864c54db-ht5cz\" (UID: \"af4d4bc5-9002-4506-8df6-51a2647d6adc\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-ht5cz"
Jul 21 16:32:57.492256 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.492207    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54864c54db-ht5cz"
Jul 21 16:32:57.616782 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:57.616759    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54864c54db-ht5cz"]
Jul 21 16:32:57.619138 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:32:57.619110    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf4d4bc5_9002_4506_8df6_51a2647d6adc.slice/crio-2cb8734f613e5efeab0dbc9fc2ac8e4ec8a22edc17201512271ab9ef9683db62 WatchSource:0}: Error finding container 2cb8734f613e5efeab0dbc9fc2ac8e4ec8a22edc17201512271ab9ef9683db62: Status 404 returned error can't find the container with id 2cb8734f613e5efeab0dbc9fc2ac8e4ec8a22edc17201512271ab9ef9683db62
Jul 21 16:32:58.611337 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:32:58.611301    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54864c54db-ht5cz" event={"ID":"af4d4bc5-9002-4506-8df6-51a2647d6adc","Type":"ContainerStarted","Data":"2cb8734f613e5efeab0dbc9fc2ac8e4ec8a22edc17201512271ab9ef9683db62"}
Jul 21 16:33:00.620769 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:33:00.620680    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54864c54db-ht5cz" event={"ID":"af4d4bc5-9002-4506-8df6-51a2647d6adc","Type":"ContainerStarted","Data":"ac45d60fb5558f17d355d644dd855a1f4a13021ea5c18fa61e9425c7ba3a3576"}
Jul 21 16:33:00.649105 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:33:00.649051    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54864c54db-ht5cz" podStartSLOduration=0.902651866 podStartE2EDuration="3.649035458s" totalImagesPullingTime="2.746383592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:00.648228922 +0000 UTC m=+559.586537368" watchObservedRunningTime="2026-07-21 16:33:00.649035458 +0000 UTC m=+559.587343905"
Jul 21 16:34:22.253323 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:22.253238    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"]
Jul 21 16:34:22.256430 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:22.256414    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"
Jul 21 16:34:22.275291 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:22.275271    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hjgjh\""
Jul 21 16:34:22.275980 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:22.275967    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 16:34:22.280564 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:22.280542    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtvp4\" (UniqueName: \"kubernetes.io/projected/8a3c0311-245b-4436-95ba-57e110e48d1f-kube-api-access-mtvp4\") pod \"limitador-operator-controller-manager-859d7b78bd-p4n79\" (UID: \"8a3c0311-245b-4436-95ba-57e110e48d1f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"
Jul 21 16:34:22.282573 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:22.282558    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 16:34:22.296763 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:22.296698    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"]
Jul 21 16:34:22.381846 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:22.381782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtvp4\" (UniqueName: \"kubernetes.io/projected/8a3c0311-245b-4436-95ba-57e110e48d1f-kube-api-access-mtvp4\") pod \"limitador-operator-controller-manager-859d7b78bd-p4n79\" (UID: \"8a3c0311-245b-4436-95ba-57e110e48d1f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"
Jul 21 16:34:22.392485 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:22.392455    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtvp4\" (UniqueName: \"kubernetes.io/projected/8a3c0311-245b-4436-95ba-57e110e48d1f-kube-api-access-mtvp4\") pod \"limitador-operator-controller-manager-859d7b78bd-p4n79\" (UID: \"8a3c0311-245b-4436-95ba-57e110e48d1f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"
Jul 21 16:34:22.566098 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:22.566001    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"
Jul 21 16:34:22.703028 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:22.702997    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"]
Jul 21 16:34:22.706672 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:34:22.706625    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3c0311_245b_4436_95ba_57e110e48d1f.slice/crio-5ca42a5be73b1801f2c9df3092c709fe944e392c470348cd4ffedfe6e0a594f3 WatchSource:0}: Error finding container 5ca42a5be73b1801f2c9df3092c709fe944e392c470348cd4ffedfe6e0a594f3: Status 404 returned error can't find the container with id 5ca42a5be73b1801f2c9df3092c709fe944e392c470348cd4ffedfe6e0a594f3
Jul 21 16:34:22.708856 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:22.708837    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:34:22.969334 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:22.969297    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79" event={"ID":"8a3c0311-245b-4436-95ba-57e110e48d1f","Type":"ContainerStarted","Data":"5ca42a5be73b1801f2c9df3092c709fe944e392c470348cd4ffedfe6e0a594f3"}
Jul 21 16:34:25.984306 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:25.984269    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79" event={"ID":"8a3c0311-245b-4436-95ba-57e110e48d1f","Type":"ContainerStarted","Data":"827febc32d6ded3f9b0d90c1ecc23d1beffb6a3285900745bc6785266d444d6d"}
Jul 21 16:34:25.984748 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:25.984342    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"
Jul 21 16:34:26.002482 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:26.002435    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79" podStartSLOduration=1.74102039 podStartE2EDuration="4.002420407s" totalImagesPullingTime="2.261400017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:26.000959778 +0000 UTC m=+644.939268236" watchObservedRunningTime="2026-07-21 16:34:26.002420407 +0000 UTC m=+644.940728876"
Jul 21 16:34:36.991287 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:36.991255    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"
Jul 21 16:34:46.471294 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:46.471262    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"]
Jul 21 16:34:46.471781 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:46.471493    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79" podUID="8a3c0311-245b-4436-95ba-57e110e48d1f" containerName="manager" containerID="cri-o://827febc32d6ded3f9b0d90c1ecc23d1beffb6a3285900745bc6785266d444d6d" gracePeriod=2
Jul 21 16:34:46.491655 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:46.491611    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"]
Jul 21 16:34:46.497855 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:34:46.497815    2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8a3c0311-245b-4436-95ba-57e110e48d1f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-p4n79\": pods \"limitador-operator-controller-manager-859d7b78bd-p4n79\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"
Jul 21 16:34:46.708325 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:46.708300    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"
Jul 21 16:34:46.712224 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:34:46.712197    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p4n79\" is forbidden: User \"system:node:ip-10-0-130-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-171.ec2.internal' and this object" podUID="8a3c0311-245b-4436-95ba-57e110e48d1f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"
Jul 21 16:34:46.787354 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:46.787269    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtvp4\" (UniqueName: \"kubernetes.io/projected/8a3c0311-245b-4436-95ba-57e110e48d1f-kube-api-access-mtvp4\") pod \"8a3c0311-245b-4436-95ba-57e110e48d1f\" (UID: \"8a3c0311-245b-4436-95ba-57e110e48d1f\") "
Jul 21 16:34:46.789441 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:46.789417    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a3c0311-245b-4436-95ba-57e110e48d1f-kube-api-access-mtvp4" (OuterVolumeSpecName: "kube-api-access-mtvp4") pod "8a3c0311-245b-4436-95ba-57e110e48d1f" (UID: "8a3c0311-245b-4436-95ba-57e110e48d1f"). InnerVolumeSpecName "kube-api-access-mtvp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:34:46.887970 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:46.887932    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtvp4\" (UniqueName: \"kubernetes.io/projected/8a3c0311-245b-4436-95ba-57e110e48d1f-kube-api-access-mtvp4\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:34:47.076342 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:47.076265    2578 generic.go:356] "Generic (PLEG): container finished" podID="8a3c0311-245b-4436-95ba-57e110e48d1f" containerID="827febc32d6ded3f9b0d90c1ecc23d1beffb6a3285900745bc6785266d444d6d" exitCode=0
Jul 21 16:34:47.076342 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:47.076312    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"
Jul 21 16:34:47.076508 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:47.076370    2578 scope.go:117] "RemoveContainer" containerID="827febc32d6ded3f9b0d90c1ecc23d1beffb6a3285900745bc6785266d444d6d"
Jul 21 16:34:47.078811 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:34:47.078787    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p4n79\" is forbidden: User \"system:node:ip-10-0-130-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-171.ec2.internal' and this object" podUID="8a3c0311-245b-4436-95ba-57e110e48d1f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"
Jul 21 16:34:47.085908 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:47.085892    2578 scope.go:117] "RemoveContainer" containerID="827febc32d6ded3f9b0d90c1ecc23d1beffb6a3285900745bc6785266d444d6d"
Jul 21 16:34:47.086140 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:34:47.086121    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"827febc32d6ded3f9b0d90c1ecc23d1beffb6a3285900745bc6785266d444d6d\": container with ID starting with 827febc32d6ded3f9b0d90c1ecc23d1beffb6a3285900745bc6785266d444d6d not found: ID does not exist" containerID="827febc32d6ded3f9b0d90c1ecc23d1beffb6a3285900745bc6785266d444d6d"
Jul 21 16:34:47.086205 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:47.086154    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"827febc32d6ded3f9b0d90c1ecc23d1beffb6a3285900745bc6785266d444d6d"} err="failed to get container status \"827febc32d6ded3f9b0d90c1ecc23d1beffb6a3285900745bc6785266d444d6d\": rpc error: code = NotFound desc = could not find container \"827febc32d6ded3f9b0d90c1ecc23d1beffb6a3285900745bc6785266d444d6d\": container with ID starting with 827febc32d6ded3f9b0d90c1ecc23d1beffb6a3285900745bc6785266d444d6d not found: ID does not exist"
Jul 21 16:34:47.087631 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:34:47.087609    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p4n79\" is forbidden: User \"system:node:ip-10-0-130-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-171.ec2.internal' and this object" podUID="8a3c0311-245b-4436-95ba-57e110e48d1f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4n79"
Jul 21 16:34:47.582827 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:34:47.582785    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a3c0311-245b-4436-95ba-57e110e48d1f" path="/var/lib/kubelet/pods/8a3c0311-245b-4436-95ba-57e110e48d1f/volumes"
Jul 21 16:35:15.172978 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.172937    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"]
Jul 21 16:35:15.173435 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.173253    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a3c0311-245b-4436-95ba-57e110e48d1f" containerName="manager"
Jul 21 16:35:15.173435 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.173263    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a3c0311-245b-4436-95ba-57e110e48d1f" containerName="manager"
Jul 21 16:35:15.173435 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.173334    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a3c0311-245b-4436-95ba-57e110e48d1f" containerName="manager"
Jul 21 16:35:15.176222 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.176202    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.179370 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.179350    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 16:35:15.179457 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.179441    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-v6f76\""
Jul 21 16:35:15.194819 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.194793    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"]
Jul 21 16:35:15.203024 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.202997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pzkl\" (UniqueName: \"kubernetes.io/projected/54412d7d-1b0e-45d0-acee-ff70727ddc61-kube-api-access-4pzkl\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.203131 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.203035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.203131 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.203061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.203131 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.203086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54412d7d-1b0e-45d0-acee-ff70727ddc61-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.203349 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.203150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54412d7d-1b0e-45d0-acee-ff70727ddc61-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.203349 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.203190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.203349 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.203214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.203349 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.203260    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.203349 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.203301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54412d7d-1b0e-45d0-acee-ff70727ddc61-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.304431 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.304399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.304558 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.304435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.304558 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.304476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.304558 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.304505    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54412d7d-1b0e-45d0-acee-ff70727ddc61-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.304712 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.304674    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pzkl\" (UniqueName: \"kubernetes.io/projected/54412d7d-1b0e-45d0-acee-ff70727ddc61-kube-api-access-4pzkl\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.304762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.304711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.304762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.304731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.304860 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.304773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54412d7d-1b0e-45d0-acee-ff70727ddc61-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.304860 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.304835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54412d7d-1b0e-45d0-acee-ff70727ddc61-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.304954 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.304860    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.304954 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.304911    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.304954 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.304904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.305238 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.305219    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.305423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.305405    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54412d7d-1b0e-45d0-acee-ff70727ddc61-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.306956 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.306939    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54412d7d-1b0e-45d0-acee-ff70727ddc61-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.307316 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.307295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54412d7d-1b0e-45d0-acee-ff70727ddc61-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.312649 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.312615    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54412d7d-1b0e-45d0-acee-ff70727ddc61-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.312831 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.312813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pzkl\" (UniqueName: \"kubernetes.io/projected/54412d7d-1b0e-45d0-acee-ff70727ddc61-kube-api-access-4pzkl\") pod \"maas-default-gateway-openshift-default-5896d4dd49-2ttxt\" (UID: \"54412d7d-1b0e-45d0-acee-ff70727ddc61\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.486096 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.486034    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:15.621830 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:15.621805    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"]
Jul 21 16:35:15.624288 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:35:15.624261    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54412d7d_1b0e_45d0_acee_ff70727ddc61.slice/crio-a2c9e46a8a8f44a4c5d139d0e37d551b69e17fda16e3a88eae7ec24b2a73802a WatchSource:0}: Error finding container a2c9e46a8a8f44a4c5d139d0e37d551b69e17fda16e3a88eae7ec24b2a73802a: Status 404 returned error can't find the container with id a2c9e46a8a8f44a4c5d139d0e37d551b69e17fda16e3a88eae7ec24b2a73802a
Jul 21 16:35:16.198407 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:16.198370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt" event={"ID":"54412d7d-1b0e-45d0-acee-ff70727ddc61","Type":"ContainerStarted","Data":"a2c9e46a8a8f44a4c5d139d0e37d551b69e17fda16e3a88eae7ec24b2a73802a"}
Jul 21 16:35:19.651050 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:19.651011    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 21 16:35:19.651291 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:19.651086    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 21 16:35:19.651291 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:19.651114    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 21 16:35:20.216604 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:20.216567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt" event={"ID":"54412d7d-1b0e-45d0-acee-ff70727ddc61","Type":"ContainerStarted","Data":"c0ffc31be42e92b7c7c2b1a74ca8516b53f9862ae1d3d3fea6d5a34aee3dd3f6"}
Jul 21 16:35:20.241004 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:20.240933    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt" podStartSLOduration=1.216943919 podStartE2EDuration="5.240913086s" totalImagesPullingTime="4.023969167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:20.238191979 +0000 UTC m=+699.176500427" watchObservedRunningTime="2026-07-21 16:35:20.240913086 +0000 UTC m=+699.179221533"
Jul 21 16:35:20.487072 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:20.486981    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:20.491386 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:20.491363    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:21.221314 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:21.221285    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:21.222192 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:21.222171    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:35:29.463814 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.463782    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"]
Jul 21 16:35:29.467432 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.467408    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"
Jul 21 16:35:29.469770 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.469749    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 16:35:29.469872 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.469749    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 16:35:29.470431 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.470412    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 16:35:29.470498 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.470428    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9q6hx\""
Jul 21 16:35:29.475845 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.475822    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"]
Jul 21 16:35:29.529053 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.529021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pvbm\" (UniqueName: \"kubernetes.io/projected/b1469518-eec1-42f0-8258-a1889e282d5f-kube-api-access-9pvbm\") pod \"limitador-limitador-64c94fd64f-n9j5b\" (UID: \"b1469518-eec1-42f0-8258-a1889e282d5f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"
Jul 21 16:35:29.529203 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.529077    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b1469518-eec1-42f0-8258-a1889e282d5f-config-file\") pod \"limitador-limitador-64c94fd64f-n9j5b\" (UID: \"b1469518-eec1-42f0-8258-a1889e282d5f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"
Jul 21 16:35:29.556346 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.556318    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"]
Jul 21 16:35:29.630225 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.630194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pvbm\" (UniqueName: \"kubernetes.io/projected/b1469518-eec1-42f0-8258-a1889e282d5f-kube-api-access-9pvbm\") pod \"limitador-limitador-64c94fd64f-n9j5b\" (UID: \"b1469518-eec1-42f0-8258-a1889e282d5f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"
Jul 21 16:35:29.630225 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.630235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b1469518-eec1-42f0-8258-a1889e282d5f-config-file\") pod \"limitador-limitador-64c94fd64f-n9j5b\" (UID: \"b1469518-eec1-42f0-8258-a1889e282d5f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"
Jul 21 16:35:29.630850 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.630831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b1469518-eec1-42f0-8258-a1889e282d5f-config-file\") pod \"limitador-limitador-64c94fd64f-n9j5b\" (UID: \"b1469518-eec1-42f0-8258-a1889e282d5f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"
Jul 21 16:35:29.638367 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.638341    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pvbm\" (UniqueName: \"kubernetes.io/projected/b1469518-eec1-42f0-8258-a1889e282d5f-kube-api-access-9pvbm\") pod \"limitador-limitador-64c94fd64f-n9j5b\" (UID: \"b1469518-eec1-42f0-8258-a1889e282d5f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"
Jul 21 16:35:29.778601 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.778527    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"
Jul 21 16:35:29.920322 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:29.920301    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"]
Jul 21 16:35:29.922279 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:35:29.922249    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1469518_eec1_42f0_8258_a1889e282d5f.slice/crio-48e0aa278678357ccdf3c9d4b687efa038e90b8c8f0121529c1ec1cbf5858f47 WatchSource:0}: Error finding container 48e0aa278678357ccdf3c9d4b687efa038e90b8c8f0121529c1ec1cbf5858f47: Status 404 returned error can't find the container with id 48e0aa278678357ccdf3c9d4b687efa038e90b8c8f0121529c1ec1cbf5858f47
Jul 21 16:35:30.266973 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.266939    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b" event={"ID":"b1469518-eec1-42f0-8258-a1889e282d5f","Type":"ContainerStarted","Data":"48e0aa278678357ccdf3c9d4b687efa038e90b8c8f0121529c1ec1cbf5858f47"}
Jul 21 16:35:30.315659 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.315612    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-8n9lh"]
Jul 21 16:35:30.320691 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.320669    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8n9lh"
Jul 21 16:35:30.322914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.322892    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4sbk8\""
Jul 21 16:35:30.324929 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.324905    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8n9lh"]
Jul 21 16:35:30.437038 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.437014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhrrd\" (UniqueName: \"kubernetes.io/projected/b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f-kube-api-access-hhrrd\") pod \"authorino-58cd955675-8n9lh\" (UID: \"b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f\") " pod="kuadrant-system/authorino-58cd955675-8n9lh"
Jul 21 16:35:30.537945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.537800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhrrd\" (UniqueName: \"kubernetes.io/projected/b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f-kube-api-access-hhrrd\") pod \"authorino-58cd955675-8n9lh\" (UID: \"b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f\") " pod="kuadrant-system/authorino-58cd955675-8n9lh"
Jul 21 16:35:30.549079 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.549049    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhrrd\" (UniqueName: \"kubernetes.io/projected/b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f-kube-api-access-hhrrd\") pod \"authorino-58cd955675-8n9lh\" (UID: \"b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f\") " pod="kuadrant-system/authorino-58cd955675-8n9lh"
Jul 21 16:35:30.612717 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.611661    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-c7dzc"]
Jul 21 16:35:30.616208 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.615680    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c7dzc"
Jul 21 16:35:30.625166 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.624889    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c7dzc"]
Jul 21 16:35:30.631935 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.631773    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8n9lh"
Jul 21 16:35:30.740045 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.739999    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvrb2\" (UniqueName: \"kubernetes.io/projected/1d2ed480-ba31-4dc5-bc87-c83e848cba53-kube-api-access-gvrb2\") pod \"authorino-75d556bd77-c7dzc\" (UID: \"1d2ed480-ba31-4dc5-bc87-c83e848cba53\") " pod="kuadrant-system/authorino-75d556bd77-c7dzc"
Jul 21 16:35:30.804025 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.803876    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8n9lh"]
Jul 21 16:35:30.808400 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:35:30.808364    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3c55f8e_ee32_4291_ab7b_e7a2adf2e25f.slice/crio-530efba226eb5ced531036eebafb0b59c8e7fb8763108e16e0a0c2a4971b0ef2 WatchSource:0}: Error finding container 530efba226eb5ced531036eebafb0b59c8e7fb8763108e16e0a0c2a4971b0ef2: Status 404 returned error can't find the container with id 530efba226eb5ced531036eebafb0b59c8e7fb8763108e16e0a0c2a4971b0ef2
Jul 21 16:35:30.841548 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.841417    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvrb2\" (UniqueName: \"kubernetes.io/projected/1d2ed480-ba31-4dc5-bc87-c83e848cba53-kube-api-access-gvrb2\") pod \"authorino-75d556bd77-c7dzc\" (UID: \"1d2ed480-ba31-4dc5-bc87-c83e848cba53\") " pod="kuadrant-system/authorino-75d556bd77-c7dzc"
Jul 21 16:35:30.850595 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.850565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvrb2\" (UniqueName: \"kubernetes.io/projected/1d2ed480-ba31-4dc5-bc87-c83e848cba53-kube-api-access-gvrb2\") pod \"authorino-75d556bd77-c7dzc\" (UID: \"1d2ed480-ba31-4dc5-bc87-c83e848cba53\") " pod="kuadrant-system/authorino-75d556bd77-c7dzc"
Jul 21 16:35:30.931829 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:30.931802    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c7dzc"
Jul 21 16:35:31.075725 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:31.075699    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c7dzc"]
Jul 21 16:35:31.077857 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:35:31.077827    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d2ed480_ba31_4dc5_bc87_c83e848cba53.slice/crio-3a8c941417e5726852259cc263044e2a50263046e498a5f6f1d3c0727e82a2d7 WatchSource:0}: Error finding container 3a8c941417e5726852259cc263044e2a50263046e498a5f6f1d3c0727e82a2d7: Status 404 returned error can't find the container with id 3a8c941417e5726852259cc263044e2a50263046e498a5f6f1d3c0727e82a2d7
Jul 21 16:35:31.273346 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:31.273303    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8n9lh" event={"ID":"b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f","Type":"ContainerStarted","Data":"530efba226eb5ced531036eebafb0b59c8e7fb8763108e16e0a0c2a4971b0ef2"}
Jul 21 16:35:31.274677 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:31.274625    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c7dzc" event={"ID":"1d2ed480-ba31-4dc5-bc87-c83e848cba53","Type":"ContainerStarted","Data":"3a8c941417e5726852259cc263044e2a50263046e498a5f6f1d3c0727e82a2d7"}
Jul 21 16:35:35.297057 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:35.297012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c7dzc" event={"ID":"1d2ed480-ba31-4dc5-bc87-c83e848cba53","Type":"ContainerStarted","Data":"525017760ec7e17c107ec58aebc2bdefb1317b0dacd7beab3e9dcce3dda8f9e6"}
Jul 21 16:35:35.298436 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:35.298414    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b" event={"ID":"b1469518-eec1-42f0-8258-a1889e282d5f","Type":"ContainerStarted","Data":"23d602c08743dca855a743475e4533554aec381932f6900ea0110b6c708e4aaf"}
Jul 21 16:35:35.298523 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:35.298509    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"
Jul 21 16:35:35.299767 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:35.299744    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8n9lh" event={"ID":"b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f","Type":"ContainerStarted","Data":"c26f6412c59a610e939379d3ebc998e92a7e5354f61dd5355cc1319ce5df0cdc"}
Jul 21 16:35:35.312865 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:35.312828    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-c7dzc" podStartSLOduration=1.745217783 podStartE2EDuration="5.312815436s" totalImagesPullingTime="3.567597653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:35.311778897 +0000 UTC m=+714.250087359" watchObservedRunningTime="2026-07-21 16:35:35.312815436 +0000 UTC m=+714.251123862"
Jul 21 16:35:35.327214 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:35.327172    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b" podStartSLOduration=1.677669035 podStartE2EDuration="6.327158449s" totalImagesPullingTime="4.649489414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:35.326297125 +0000 UTC m=+714.264605573" watchObservedRunningTime="2026-07-21 16:35:35.327158449 +0000 UTC m=+714.265466933"
Jul 21 16:35:35.341133 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:35.341109    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8n9lh"]
Jul 21 16:35:35.349125 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:35.349088    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-8n9lh" podStartSLOduration=1.523122874 podStartE2EDuration="5.349075204s" totalImagesPullingTime="3.82595233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:35.347723942 +0000 UTC m=+714.286032393" watchObservedRunningTime="2026-07-21 16:35:35.349075204 +0000 UTC m=+714.287383652"
Jul 21 16:35:37.309140 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:37.309097    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-8n9lh" podUID="b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f" containerName="authorino" containerID="cri-o://c26f6412c59a610e939379d3ebc998e92a7e5354f61dd5355cc1319ce5df0cdc" gracePeriod=30
Jul 21 16:35:37.552950 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:37.552926    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8n9lh"
Jul 21 16:35:37.612237 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:37.612210    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhrrd\" (UniqueName: \"kubernetes.io/projected/b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f-kube-api-access-hhrrd\") pod \"b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f\" (UID: \"b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f\") "
Jul 21 16:35:37.614174 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:37.614144    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f-kube-api-access-hhrrd" (OuterVolumeSpecName: "kube-api-access-hhrrd") pod "b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f" (UID: "b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f"). InnerVolumeSpecName "kube-api-access-hhrrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:35:37.712890 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:37.712862    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhrrd\" (UniqueName: \"kubernetes.io/projected/b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f-kube-api-access-hhrrd\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:35:38.314672 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:38.314625    2578 generic.go:356] "Generic (PLEG): container finished" podID="b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f" containerID="c26f6412c59a610e939379d3ebc998e92a7e5354f61dd5355cc1319ce5df0cdc" exitCode=0
Jul 21 16:35:38.315063 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:38.314691    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8n9lh"
Jul 21 16:35:38.315063 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:38.314710    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8n9lh" event={"ID":"b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f","Type":"ContainerDied","Data":"c26f6412c59a610e939379d3ebc998e92a7e5354f61dd5355cc1319ce5df0cdc"}
Jul 21 16:35:38.315063 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:38.314759    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8n9lh" event={"ID":"b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f","Type":"ContainerDied","Data":"530efba226eb5ced531036eebafb0b59c8e7fb8763108e16e0a0c2a4971b0ef2"}
Jul 21 16:35:38.315063 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:38.314783    2578 scope.go:117] "RemoveContainer" containerID="c26f6412c59a610e939379d3ebc998e92a7e5354f61dd5355cc1319ce5df0cdc"
Jul 21 16:35:38.323621 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:38.323604    2578 scope.go:117] "RemoveContainer" containerID="c26f6412c59a610e939379d3ebc998e92a7e5354f61dd5355cc1319ce5df0cdc"
Jul 21 16:35:38.323900 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:35:38.323880    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c26f6412c59a610e939379d3ebc998e92a7e5354f61dd5355cc1319ce5df0cdc\": container with ID starting with c26f6412c59a610e939379d3ebc998e92a7e5354f61dd5355cc1319ce5df0cdc not found: ID does not exist" containerID="c26f6412c59a610e939379d3ebc998e92a7e5354f61dd5355cc1319ce5df0cdc"
Jul 21 16:35:38.323994 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:38.323907    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c26f6412c59a610e939379d3ebc998e92a7e5354f61dd5355cc1319ce5df0cdc"} err="failed to get container status \"c26f6412c59a610e939379d3ebc998e92a7e5354f61dd5355cc1319ce5df0cdc\": rpc error: code = NotFound desc = could not find container \"c26f6412c59a610e939379d3ebc998e92a7e5354f61dd5355cc1319ce5df0cdc\": container with ID starting with c26f6412c59a610e939379d3ebc998e92a7e5354f61dd5355cc1319ce5df0cdc not found: ID does not exist"
Jul 21 16:35:38.335456 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:38.335436    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8n9lh"]
Jul 21 16:35:38.339239 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:38.339218    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-8n9lh"]
Jul 21 16:35:39.582593 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:39.582561    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f" path="/var/lib/kubelet/pods/b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f/volumes"
Jul 21 16:35:44.065486 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:44.065450    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"]
Jul 21 16:35:44.065909 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:44.065629    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b" podUID="b1469518-eec1-42f0-8258-a1889e282d5f" containerName="limitador" containerID="cri-o://23d602c08743dca855a743475e4533554aec381932f6900ea0110b6c708e4aaf" gracePeriod=30
Jul 21 16:35:44.066391 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:44.066352    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"
Jul 21 16:35:44.602923 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:44.602901    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"
Jul 21 16:35:44.771358 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:44.771286    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pvbm\" (UniqueName: \"kubernetes.io/projected/b1469518-eec1-42f0-8258-a1889e282d5f-kube-api-access-9pvbm\") pod \"b1469518-eec1-42f0-8258-a1889e282d5f\" (UID: \"b1469518-eec1-42f0-8258-a1889e282d5f\") "
Jul 21 16:35:44.771358 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:44.771324    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b1469518-eec1-42f0-8258-a1889e282d5f-config-file\") pod \"b1469518-eec1-42f0-8258-a1889e282d5f\" (UID: \"b1469518-eec1-42f0-8258-a1889e282d5f\") "
Jul 21 16:35:44.771737 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:44.771710    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1469518-eec1-42f0-8258-a1889e282d5f-config-file" (OuterVolumeSpecName: "config-file") pod "b1469518-eec1-42f0-8258-a1889e282d5f" (UID: "b1469518-eec1-42f0-8258-a1889e282d5f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:35:44.773308 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:44.773283    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1469518-eec1-42f0-8258-a1889e282d5f-kube-api-access-9pvbm" (OuterVolumeSpecName: "kube-api-access-9pvbm") pod "b1469518-eec1-42f0-8258-a1889e282d5f" (UID: "b1469518-eec1-42f0-8258-a1889e282d5f"). InnerVolumeSpecName "kube-api-access-9pvbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:35:44.872224 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:44.872202    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pvbm\" (UniqueName: \"kubernetes.io/projected/b1469518-eec1-42f0-8258-a1889e282d5f-kube-api-access-9pvbm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:35:44.872224 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:44.872221    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b1469518-eec1-42f0-8258-a1889e282d5f-config-file\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:35:45.348293 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:45.348261    2578 generic.go:356] "Generic (PLEG): container finished" podID="b1469518-eec1-42f0-8258-a1889e282d5f" containerID="23d602c08743dca855a743475e4533554aec381932f6900ea0110b6c708e4aaf" exitCode=0
Jul 21 16:35:45.348775 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:45.348301    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"
Jul 21 16:35:45.348775 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:45.348349    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b" event={"ID":"b1469518-eec1-42f0-8258-a1889e282d5f","Type":"ContainerDied","Data":"23d602c08743dca855a743475e4533554aec381932f6900ea0110b6c708e4aaf"}
Jul 21 16:35:45.348775 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:45.348399    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n9j5b" event={"ID":"b1469518-eec1-42f0-8258-a1889e282d5f","Type":"ContainerDied","Data":"48e0aa278678357ccdf3c9d4b687efa038e90b8c8f0121529c1ec1cbf5858f47"}
Jul 21 16:35:45.348775 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:45.348422    2578 scope.go:117] "RemoveContainer" containerID="23d602c08743dca855a743475e4533554aec381932f6900ea0110b6c708e4aaf"
Jul 21 16:35:45.356710 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:45.356686    2578 scope.go:117] "RemoveContainer" containerID="23d602c08743dca855a743475e4533554aec381932f6900ea0110b6c708e4aaf"
Jul 21 16:35:45.356957 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:35:45.356934    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23d602c08743dca855a743475e4533554aec381932f6900ea0110b6c708e4aaf\": container with ID starting with 23d602c08743dca855a743475e4533554aec381932f6900ea0110b6c708e4aaf not found: ID does not exist" containerID="23d602c08743dca855a743475e4533554aec381932f6900ea0110b6c708e4aaf"
Jul 21 16:35:45.357024 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:45.356970    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d602c08743dca855a743475e4533554aec381932f6900ea0110b6c708e4aaf"} err="failed to get container status \"23d602c08743dca855a743475e4533554aec381932f6900ea0110b6c708e4aaf\": rpc error: code = NotFound desc = could not find container \"23d602c08743dca855a743475e4533554aec381932f6900ea0110b6c708e4aaf\": container with ID starting with 23d602c08743dca855a743475e4533554aec381932f6900ea0110b6c708e4aaf not found: ID does not exist"
Jul 21 16:35:45.368621 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:45.368601    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"]
Jul 21 16:35:45.372706 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:45.372682    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n9j5b"]
Jul 21 16:35:45.583627 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:45.583594    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1469518-eec1-42f0-8258-a1889e282d5f" path="/var/lib/kubelet/pods/b1469518-eec1-42f0-8258-a1889e282d5f/volumes"
Jul 21 16:35:47.984872 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:47.984833    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb"]
Jul 21 16:35:47.985388 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:47.985371    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1469518-eec1-42f0-8258-a1889e282d5f" containerName="limitador"
Jul 21 16:35:47.985439 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:47.985392    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1469518-eec1-42f0-8258-a1889e282d5f" containerName="limitador"
Jul 21 16:35:47.985439 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:47.985416    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f" containerName="authorino"
Jul 21 16:35:47.985439 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:47.985425    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f" containerName="authorino"
Jul 21 16:35:47.985543 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:47.985506    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3c55f8e-ee32-4291-ab7b-e7a2adf2e25f" containerName="authorino"
Jul 21 16:35:47.985543 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:47.985520    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1469518-eec1-42f0-8258-a1889e282d5f" containerName="limitador"
Jul 21 16:35:47.990102 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:47.990080    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb"
Jul 21 16:35:47.993253 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:47.993230    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7gwd7\""
Jul 21 16:35:47.993435 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:47.993414    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 16:35:47.994322 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:47.994300    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 16:35:47.994445 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:47.994344    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 21 16:35:47.996284 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:47.996250    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb"]
Jul 21 16:35:48.102923 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:48.102882    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrw9z\" (UniqueName: \"kubernetes.io/projected/1be6aac8-1ccf-4027-9f09-a275c605db0b-kube-api-access-wrw9z\") pod \"postgres-69fb4594cf-fpbtb\" (UID: \"1be6aac8-1ccf-4027-9f09-a275c605db0b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb"
Jul 21 16:35:48.102923 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:48.102930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1be6aac8-1ccf-4027-9f09-a275c605db0b-data\") pod \"postgres-69fb4594cf-fpbtb\" (UID: \"1be6aac8-1ccf-4027-9f09-a275c605db0b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb"
Jul 21 16:35:48.204187 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:48.204156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrw9z\" (UniqueName: \"kubernetes.io/projected/1be6aac8-1ccf-4027-9f09-a275c605db0b-kube-api-access-wrw9z\") pod \"postgres-69fb4594cf-fpbtb\" (UID: \"1be6aac8-1ccf-4027-9f09-a275c605db0b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb"
Jul 21 16:35:48.204324 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:48.204193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1be6aac8-1ccf-4027-9f09-a275c605db0b-data\") pod \"postgres-69fb4594cf-fpbtb\" (UID: \"1be6aac8-1ccf-4027-9f09-a275c605db0b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb"
Jul 21 16:35:48.204612 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:48.204591    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1be6aac8-1ccf-4027-9f09-a275c605db0b-data\") pod \"postgres-69fb4594cf-fpbtb\" (UID: \"1be6aac8-1ccf-4027-9f09-a275c605db0b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb"
Jul 21 16:35:48.216068 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:48.216048    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrw9z\" (UniqueName: \"kubernetes.io/projected/1be6aac8-1ccf-4027-9f09-a275c605db0b-kube-api-access-wrw9z\") pod \"postgres-69fb4594cf-fpbtb\" (UID: \"1be6aac8-1ccf-4027-9f09-a275c605db0b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb"
Jul 21 16:35:48.302049 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:48.301984    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb"
Jul 21 16:35:48.428688 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:48.428524    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb"]
Jul 21 16:35:48.431450 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:35:48.431415    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be6aac8_1ccf_4027_9f09_a275c605db0b.slice/crio-b4a52d7c066b1d1f29193b1bbe90c2e4cec0ad10962806b0f1d8780b61007c80 WatchSource:0}: Error finding container b4a52d7c066b1d1f29193b1bbe90c2e4cec0ad10962806b0f1d8780b61007c80: Status 404 returned error can't find the container with id b4a52d7c066b1d1f29193b1bbe90c2e4cec0ad10962806b0f1d8780b61007c80
Jul 21 16:35:49.371988 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:49.371946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb" event={"ID":"1be6aac8-1ccf-4027-9f09-a275c605db0b","Type":"ContainerStarted","Data":"b4a52d7c066b1d1f29193b1bbe90c2e4cec0ad10962806b0f1d8780b61007c80"}
Jul 21 16:35:53.394853 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:53.394758    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb" event={"ID":"1be6aac8-1ccf-4027-9f09-a275c605db0b","Type":"ContainerStarted","Data":"22667f76bead29f27e3c82a94aa7f1aacdcf1ab344fa6f852f941132c5772164"}
Jul 21 16:35:53.395260 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:53.394874    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb"
Jul 21 16:35:53.411837 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:53.411791    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb" podStartSLOduration=1.742649209 podStartE2EDuration="6.411773441s" totalImagesPullingTime="4.669124232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:53.410317799 +0000 UTC m=+732.348626248" watchObservedRunningTime="2026-07-21 16:35:53.411773441 +0000 UTC m=+732.350081888"
Jul 21 16:35:59.428667 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:59.428623    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fpbtb"
Jul 21 16:35:59.945490 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:59.945456    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ggnrs"]
Jul 21 16:35:59.948945 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:59.948925    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ggnrs"
Jul 21 16:35:59.958110 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:35:59.958075    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ggnrs"]
Jul 21 16:36:00.004864 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.004832    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glmw4\" (UniqueName: \"kubernetes.io/projected/302570d5-2e34-4c96-825d-2c18275e0947-kube-api-access-glmw4\") pod \"authorino-5d4b67c446-ggnrs\" (UID: \"302570d5-2e34-4c96-825d-2c18275e0947\") " pod="kuadrant-system/authorino-5d4b67c446-ggnrs"
Jul 21 16:36:00.105958 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.105922    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glmw4\" (UniqueName: \"kubernetes.io/projected/302570d5-2e34-4c96-825d-2c18275e0947-kube-api-access-glmw4\") pod \"authorino-5d4b67c446-ggnrs\" (UID: \"302570d5-2e34-4c96-825d-2c18275e0947\") " pod="kuadrant-system/authorino-5d4b67c446-ggnrs"
Jul 21 16:36:00.113756 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.113735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glmw4\" (UniqueName: \"kubernetes.io/projected/302570d5-2e34-4c96-825d-2c18275e0947-kube-api-access-glmw4\") pod \"authorino-5d4b67c446-ggnrs\" (UID: \"302570d5-2e34-4c96-825d-2c18275e0947\") " pod="kuadrant-system/authorino-5d4b67c446-ggnrs"
Jul 21 16:36:00.171052 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.171021    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ggnrs"]
Jul 21 16:36:00.171276 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.171265    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ggnrs"
Jul 21 16:36:00.194569 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.194542    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-bfbbbb687-9vbs8"]
Jul 21 16:36:00.199116 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.199063    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bfbbbb687-9vbs8"
Jul 21 16:36:00.205810 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.205786    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bfbbbb687-9vbs8"]
Jul 21 16:36:00.206698 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.206672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65rvq\" (UniqueName: \"kubernetes.io/projected/e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706-kube-api-access-65rvq\") pod \"authorino-bfbbbb687-9vbs8\" (UID: \"e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706\") " pod="kuadrant-system/authorino-bfbbbb687-9vbs8"
Jul 21 16:36:00.266122 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.266090    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-bfbbbb687-9vbs8"]
Jul 21 16:36:00.266393 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:36:00.266371    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-65rvq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-bfbbbb687-9vbs8" podUID="e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706"
Jul 21 16:36:00.298524 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.298494    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-569db4b5dc-pmqv5"]
Jul 21 16:36:00.301970 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.301946    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569db4b5dc-pmqv5"
Jul 21 16:36:00.302564 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.302538    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ggnrs"]
Jul 21 16:36:00.304160 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.304141    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 16:36:00.305330 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:36:00.305310    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod302570d5_2e34_4c96_825d_2c18275e0947.slice/crio-ede0448d48b63b84d378d31f4d40001e8227edca158af2c16c800a1079731d10 WatchSource:0}: Error finding container ede0448d48b63b84d378d31f4d40001e8227edca158af2c16c800a1079731d10: Status 404 returned error can't find the container with id ede0448d48b63b84d378d31f4d40001e8227edca158af2c16c800a1079731d10
Jul 21 16:36:00.307049 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.307031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65rvq\" (UniqueName: \"kubernetes.io/projected/e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706-kube-api-access-65rvq\") pod \"authorino-bfbbbb687-9vbs8\" (UID: \"e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706\") " pod="kuadrant-system/authorino-bfbbbb687-9vbs8"
Jul 21 16:36:00.307107 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.307087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e7ea375-7b8a-41ee-bc93-035d6aac2a03-tls-cert\") pod \"authorino-569db4b5dc-pmqv5\" (UID: \"4e7ea375-7b8a-41ee-bc93-035d6aac2a03\") " pod="kuadrant-system/authorino-569db4b5dc-pmqv5"
Jul 21 16:36:00.307154 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.307122    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd6m2\" (UniqueName: \"kubernetes.io/projected/4e7ea375-7b8a-41ee-bc93-035d6aac2a03-kube-api-access-sd6m2\") pod \"authorino-569db4b5dc-pmqv5\" (UID: \"4e7ea375-7b8a-41ee-bc93-035d6aac2a03\") " pod="kuadrant-system/authorino-569db4b5dc-pmqv5"
Jul 21 16:36:00.310530 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.310508    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-569db4b5dc-pmqv5"]
Jul 21 16:36:00.320363 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.320339    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65rvq\" (UniqueName: \"kubernetes.io/projected/e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706-kube-api-access-65rvq\") pod \"authorino-bfbbbb687-9vbs8\" (UID: \"e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706\") " pod="kuadrant-system/authorino-bfbbbb687-9vbs8"
Jul 21 16:36:00.407694 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.407632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e7ea375-7b8a-41ee-bc93-035d6aac2a03-tls-cert\") pod \"authorino-569db4b5dc-pmqv5\" (UID: \"4e7ea375-7b8a-41ee-bc93-035d6aac2a03\") " pod="kuadrant-system/authorino-569db4b5dc-pmqv5"
Jul 21 16:36:00.407865 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.407701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd6m2\" (UniqueName: \"kubernetes.io/projected/4e7ea375-7b8a-41ee-bc93-035d6aac2a03-kube-api-access-sd6m2\") pod \"authorino-569db4b5dc-pmqv5\" (UID: \"4e7ea375-7b8a-41ee-bc93-035d6aac2a03\") " pod="kuadrant-system/authorino-569db4b5dc-pmqv5"
Jul 21 16:36:00.410048 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.410029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e7ea375-7b8a-41ee-bc93-035d6aac2a03-tls-cert\") pod \"authorino-569db4b5dc-pmqv5\" (UID: \"4e7ea375-7b8a-41ee-bc93-035d6aac2a03\") " pod="kuadrant-system/authorino-569db4b5dc-pmqv5"
Jul 21 16:36:00.415678 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.415660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd6m2\" (UniqueName: \"kubernetes.io/projected/4e7ea375-7b8a-41ee-bc93-035d6aac2a03-kube-api-access-sd6m2\") pod \"authorino-569db4b5dc-pmqv5\" (UID: \"4e7ea375-7b8a-41ee-bc93-035d6aac2a03\") " pod="kuadrant-system/authorino-569db4b5dc-pmqv5"
Jul 21 16:36:00.426553 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.426525    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ggnrs" event={"ID":"302570d5-2e34-4c96-825d-2c18275e0947","Type":"ContainerStarted","Data":"ede0448d48b63b84d378d31f4d40001e8227edca158af2c16c800a1079731d10"}
Jul 21 16:36:00.426659 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.426550    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bfbbbb687-9vbs8"
Jul 21 16:36:00.434330 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.434312    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bfbbbb687-9vbs8"
Jul 21 16:36:00.508429 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.508336    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65rvq\" (UniqueName: \"kubernetes.io/projected/e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706-kube-api-access-65rvq\") pod \"e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706\" (UID: \"e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706\") "
Jul 21 16:36:00.510420 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.510399    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706-kube-api-access-65rvq" (OuterVolumeSpecName: "kube-api-access-65rvq") pod "e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706" (UID: "e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706"). InnerVolumeSpecName "kube-api-access-65rvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:36:00.609147 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.609112    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65rvq\" (UniqueName: \"kubernetes.io/projected/e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706-kube-api-access-65rvq\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:36:00.620026 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.620001    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569db4b5dc-pmqv5"
Jul 21 16:36:00.745203 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:00.745178    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-569db4b5dc-pmqv5"]
Jul 21 16:36:00.747492 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:36:00.747467    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e7ea375_7b8a_41ee_bc93_035d6aac2a03.slice/crio-3546698d09c91905bea6b431f7846edb715e6f812a60641d2ed4f8d7f3f02513 WatchSource:0}: Error finding container 3546698d09c91905bea6b431f7846edb715e6f812a60641d2ed4f8d7f3f02513: Status 404 returned error can't find the container with id 3546698d09c91905bea6b431f7846edb715e6f812a60641d2ed4f8d7f3f02513
Jul 21 16:36:01.432333 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:01.432258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bfbbbb687-9vbs8"
Jul 21 16:36:01.432487 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:01.432242    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569db4b5dc-pmqv5" event={"ID":"4e7ea375-7b8a-41ee-bc93-035d6aac2a03","Type":"ContainerStarted","Data":"3546698d09c91905bea6b431f7846edb715e6f812a60641d2ed4f8d7f3f02513"}
Jul 21 16:36:01.460412 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:01.460377    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-bfbbbb687-9vbs8"]
Jul 21 16:36:01.464346 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:01.464318    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-bfbbbb687-9vbs8"]
Jul 21 16:36:01.582197 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:01.582167    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706" path="/var/lib/kubelet/pods/e284f2ca-9ff3-4bde-9b8f-9e9c0e49d706/volumes"
Jul 21 16:36:02.437920 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.437882    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569db4b5dc-pmqv5" event={"ID":"4e7ea375-7b8a-41ee-bc93-035d6aac2a03","Type":"ContainerStarted","Data":"df3b336cdd86bbf98818131080742261a50e18f0bbb411ad0c4815b21635fbdf"}
Jul 21 16:36:02.439326 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.439299    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ggnrs" event={"ID":"302570d5-2e34-4c96-825d-2c18275e0947","Type":"ContainerStarted","Data":"da2d193f83c18d9559ab81e337632669caebd124ae668ad9ec865bfbf4804a5a"}
Jul 21 16:36:02.439458 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.439353    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-ggnrs" podUID="302570d5-2e34-4c96-825d-2c18275e0947" containerName="authorino" containerID="cri-o://da2d193f83c18d9559ab81e337632669caebd124ae668ad9ec865bfbf4804a5a" gracePeriod=30
Jul 21 16:36:02.455250 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.455208    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-569db4b5dc-pmqv5" podStartSLOduration=1.265762028 podStartE2EDuration="2.455192985s" totalImagesPullingTime="1.189430957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:36:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:36:02.453816583 +0000 UTC m=+741.392125032" watchObservedRunningTime="2026-07-21 16:36:02.455192985 +0000 UTC m=+741.393501433"
Jul 21 16:36:02.469869 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.469806    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-ggnrs" podStartSLOduration=2.28185323 podStartE2EDuration="3.469792654s" totalImagesPullingTime="1.187939424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:36:02.469758628 +0000 UTC m=+741.408067077" watchObservedRunningTime="2026-07-21 16:36:02.469792654 +0000 UTC m=+741.408101103"
Jul 21 16:36:02.484775 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.484750    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c7dzc"]
Jul 21 16:36:02.484970 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.484945    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-c7dzc" podUID="1d2ed480-ba31-4dc5-bc87-c83e848cba53" containerName="authorino" containerID="cri-o://525017760ec7e17c107ec58aebc2bdefb1317b0dacd7beab3e9dcce3dda8f9e6" gracePeriod=30
Jul 21 16:36:02.749495 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.749474    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ggnrs"
Jul 21 16:36:02.752528 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.752511    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c7dzc"
Jul 21 16:36:02.834528 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.834495    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glmw4\" (UniqueName: \"kubernetes.io/projected/302570d5-2e34-4c96-825d-2c18275e0947-kube-api-access-glmw4\") pod \"302570d5-2e34-4c96-825d-2c18275e0947\" (UID: \"302570d5-2e34-4c96-825d-2c18275e0947\") "
Jul 21 16:36:02.834528 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.834537    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvrb2\" (UniqueName: \"kubernetes.io/projected/1d2ed480-ba31-4dc5-bc87-c83e848cba53-kube-api-access-gvrb2\") pod \"1d2ed480-ba31-4dc5-bc87-c83e848cba53\" (UID: \"1d2ed480-ba31-4dc5-bc87-c83e848cba53\") "
Jul 21 16:36:02.836619 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.836591    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/302570d5-2e34-4c96-825d-2c18275e0947-kube-api-access-glmw4" (OuterVolumeSpecName: "kube-api-access-glmw4") pod "302570d5-2e34-4c96-825d-2c18275e0947" (UID: "302570d5-2e34-4c96-825d-2c18275e0947"). InnerVolumeSpecName "kube-api-access-glmw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:36:02.836619 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.836613    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d2ed480-ba31-4dc5-bc87-c83e848cba53-kube-api-access-gvrb2" (OuterVolumeSpecName: "kube-api-access-gvrb2") pod "1d2ed480-ba31-4dc5-bc87-c83e848cba53" (UID: "1d2ed480-ba31-4dc5-bc87-c83e848cba53"). InnerVolumeSpecName "kube-api-access-gvrb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:36:02.936068 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.936037    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glmw4\" (UniqueName: \"kubernetes.io/projected/302570d5-2e34-4c96-825d-2c18275e0947-kube-api-access-glmw4\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:36:02.936068 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:02.936065    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvrb2\" (UniqueName: \"kubernetes.io/projected/1d2ed480-ba31-4dc5-bc87-c83e848cba53-kube-api-access-gvrb2\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:36:03.445534 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.445495    2578 generic.go:356] "Generic (PLEG): container finished" podID="302570d5-2e34-4c96-825d-2c18275e0947" containerID="da2d193f83c18d9559ab81e337632669caebd124ae668ad9ec865bfbf4804a5a" exitCode=0
Jul 21 16:36:03.445707 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.445551    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ggnrs"
Jul 21 16:36:03.445707 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.445585    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ggnrs" event={"ID":"302570d5-2e34-4c96-825d-2c18275e0947","Type":"ContainerDied","Data":"da2d193f83c18d9559ab81e337632669caebd124ae668ad9ec865bfbf4804a5a"}
Jul 21 16:36:03.445707 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.445627    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ggnrs" event={"ID":"302570d5-2e34-4c96-825d-2c18275e0947","Type":"ContainerDied","Data":"ede0448d48b63b84d378d31f4d40001e8227edca158af2c16c800a1079731d10"}
Jul 21 16:36:03.445707 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.445663    2578 scope.go:117] "RemoveContainer" containerID="da2d193f83c18d9559ab81e337632669caebd124ae668ad9ec865bfbf4804a5a"
Jul 21 16:36:03.447053 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.447017    2578 generic.go:356] "Generic (PLEG): container finished" podID="1d2ed480-ba31-4dc5-bc87-c83e848cba53" containerID="525017760ec7e17c107ec58aebc2bdefb1317b0dacd7beab3e9dcce3dda8f9e6" exitCode=0
Jul 21 16:36:03.447177 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.447079    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c7dzc"
Jul 21 16:36:03.447177 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.447103    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c7dzc" event={"ID":"1d2ed480-ba31-4dc5-bc87-c83e848cba53","Type":"ContainerDied","Data":"525017760ec7e17c107ec58aebc2bdefb1317b0dacd7beab3e9dcce3dda8f9e6"}
Jul 21 16:36:03.447177 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.447137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c7dzc" event={"ID":"1d2ed480-ba31-4dc5-bc87-c83e848cba53","Type":"ContainerDied","Data":"3a8c941417e5726852259cc263044e2a50263046e498a5f6f1d3c0727e82a2d7"}
Jul 21 16:36:03.462162 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.462147    2578 scope.go:117] "RemoveContainer" containerID="da2d193f83c18d9559ab81e337632669caebd124ae668ad9ec865bfbf4804a5a"
Jul 21 16:36:03.462432 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:36:03.462412    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da2d193f83c18d9559ab81e337632669caebd124ae668ad9ec865bfbf4804a5a\": container with ID starting with da2d193f83c18d9559ab81e337632669caebd124ae668ad9ec865bfbf4804a5a not found: ID does not exist" containerID="da2d193f83c18d9559ab81e337632669caebd124ae668ad9ec865bfbf4804a5a"
Jul 21 16:36:03.462478 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.462440    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da2d193f83c18d9559ab81e337632669caebd124ae668ad9ec865bfbf4804a5a"} err="failed to get container status \"da2d193f83c18d9559ab81e337632669caebd124ae668ad9ec865bfbf4804a5a\": rpc error: code = NotFound desc = could not find container \"da2d193f83c18d9559ab81e337632669caebd124ae668ad9ec865bfbf4804a5a\": container with ID starting with da2d193f83c18d9559ab81e337632669caebd124ae668ad9ec865bfbf4804a5a not found: ID does not exist"
Jul 21 16:36:03.462478 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.462458    2578 scope.go:117] "RemoveContainer" containerID="525017760ec7e17c107ec58aebc2bdefb1317b0dacd7beab3e9dcce3dda8f9e6"
Jul 21 16:36:03.470087 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.470070    2578 scope.go:117] "RemoveContainer" containerID="525017760ec7e17c107ec58aebc2bdefb1317b0dacd7beab3e9dcce3dda8f9e6"
Jul 21 16:36:03.470347 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:36:03.470316    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"525017760ec7e17c107ec58aebc2bdefb1317b0dacd7beab3e9dcce3dda8f9e6\": container with ID starting with 525017760ec7e17c107ec58aebc2bdefb1317b0dacd7beab3e9dcce3dda8f9e6 not found: ID does not exist" containerID="525017760ec7e17c107ec58aebc2bdefb1317b0dacd7beab3e9dcce3dda8f9e6"
Jul 21 16:36:03.470347 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.470336    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"525017760ec7e17c107ec58aebc2bdefb1317b0dacd7beab3e9dcce3dda8f9e6"} err="failed to get container status \"525017760ec7e17c107ec58aebc2bdefb1317b0dacd7beab3e9dcce3dda8f9e6\": rpc error: code = NotFound desc = could not find container \"525017760ec7e17c107ec58aebc2bdefb1317b0dacd7beab3e9dcce3dda8f9e6\": container with ID starting with 525017760ec7e17c107ec58aebc2bdefb1317b0dacd7beab3e9dcce3dda8f9e6 not found: ID does not exist"
Jul 21 16:36:03.474084 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.474062    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c7dzc"]
Jul 21 16:36:03.477566 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.477548    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c7dzc"]
Jul 21 16:36:03.488217 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.488199    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ggnrs"]
Jul 21 16:36:03.494312 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.494292    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ggnrs"]
Jul 21 16:36:03.583158 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.583134    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d2ed480-ba31-4dc5-bc87-c83e848cba53" path="/var/lib/kubelet/pods/1d2ed480-ba31-4dc5-bc87-c83e848cba53/volumes"
Jul 21 16:36:03.583457 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:03.583445    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="302570d5-2e34-4c96-825d-2c18275e0947" path="/var/lib/kubelet/pods/302570d5-2e34-4c96-825d-2c18275e0947/volumes"
Jul 21 16:36:42.709124 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.709078    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"]
Jul 21 16:36:42.709526 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.709438    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="302570d5-2e34-4c96-825d-2c18275e0947" containerName="authorino"
Jul 21 16:36:42.709526 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.709448    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="302570d5-2e34-4c96-825d-2c18275e0947" containerName="authorino"
Jul 21 16:36:42.709526 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.709463    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d2ed480-ba31-4dc5-bc87-c83e848cba53" containerName="authorino"
Jul 21 16:36:42.709526 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.709468    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d2ed480-ba31-4dc5-bc87-c83e848cba53" containerName="authorino"
Jul 21 16:36:42.709526 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.709514    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d2ed480-ba31-4dc5-bc87-c83e848cba53" containerName="authorino"
Jul 21 16:36:42.709526 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.709526    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="302570d5-2e34-4c96-825d-2c18275e0947" containerName="authorino"
Jul 21 16:36:42.713671 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.713632    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"
Jul 21 16:36:42.715687 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.715665    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 21 16:36:42.715930 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.715916    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wcmxc\""
Jul 21 16:36:42.723656 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.723619    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"]
Jul 21 16:36:42.870850 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.870817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e28c73f-1e5e-441b-80c0-609fd49b06d0-openshift-service-ca\") pod \"maas-api-586b44c766-mmjwr\" (UID: \"4e28c73f-1e5e-441b-80c0-609fd49b06d0\") " pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"
Jul 21 16:36:42.871043 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.870873    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9fff\" (UniqueName: \"kubernetes.io/projected/4e28c73f-1e5e-441b-80c0-609fd49b06d0-kube-api-access-p9fff\") pod \"maas-api-586b44c766-mmjwr\" (UID: \"4e28c73f-1e5e-441b-80c0-609fd49b06d0\") " pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"
Jul 21 16:36:42.871043 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.870960    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e28c73f-1e5e-441b-80c0-609fd49b06d0-maas-api-tls\") pod \"maas-api-586b44c766-mmjwr\" (UID: \"4e28c73f-1e5e-441b-80c0-609fd49b06d0\") " pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"
Jul 21 16:36:42.971671 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.971566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fff\" (UniqueName: \"kubernetes.io/projected/4e28c73f-1e5e-441b-80c0-609fd49b06d0-kube-api-access-p9fff\") pod \"maas-api-586b44c766-mmjwr\" (UID: \"4e28c73f-1e5e-441b-80c0-609fd49b06d0\") " pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"
Jul 21 16:36:42.971671 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.971611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e28c73f-1e5e-441b-80c0-609fd49b06d0-maas-api-tls\") pod \"maas-api-586b44c766-mmjwr\" (UID: \"4e28c73f-1e5e-441b-80c0-609fd49b06d0\") " pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"
Jul 21 16:36:42.971902 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.971686    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e28c73f-1e5e-441b-80c0-609fd49b06d0-openshift-service-ca\") pod \"maas-api-586b44c766-mmjwr\" (UID: \"4e28c73f-1e5e-441b-80c0-609fd49b06d0\") " pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"
Jul 21 16:36:42.972262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.972241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e28c73f-1e5e-441b-80c0-609fd49b06d0-openshift-service-ca\") pod \"maas-api-586b44c766-mmjwr\" (UID: \"4e28c73f-1e5e-441b-80c0-609fd49b06d0\") " pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"
Jul 21 16:36:42.974131 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.974111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e28c73f-1e5e-441b-80c0-609fd49b06d0-maas-api-tls\") pod \"maas-api-586b44c766-mmjwr\" (UID: \"4e28c73f-1e5e-441b-80c0-609fd49b06d0\") " pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"
Jul 21 16:36:42.986140 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:42.986116    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9fff\" (UniqueName: \"kubernetes.io/projected/4e28c73f-1e5e-441b-80c0-609fd49b06d0-kube-api-access-p9fff\") pod \"maas-api-586b44c766-mmjwr\" (UID: \"4e28c73f-1e5e-441b-80c0-609fd49b06d0\") " pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"
Jul 21 16:36:43.024065 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.024038    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"
Jul 21 16:36:43.159436 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.159407    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"]
Jul 21 16:36:43.161922 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:36:43.161893    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e28c73f_1e5e_441b_80c0_609fd49b06d0.slice/crio-8bf7fa7af7e6547fec6b08c7f1f7d9dfd89a8cd80eecf5b2059712559552f812 WatchSource:0}: Error finding container 8bf7fa7af7e6547fec6b08c7f1f7d9dfd89a8cd80eecf5b2059712559552f812: Status 404 returned error can't find the container with id 8bf7fa7af7e6547fec6b08c7f1f7d9dfd89a8cd80eecf5b2059712559552f812
Jul 21 16:36:43.402091 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.402059    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-gp6vw"]
Jul 21 16:36:43.406483 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.406462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-gp6vw"
Jul 21 16:36:43.408876 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.408845    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ts927\""
Jul 21 16:36:43.409029 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.409014    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 16:36:43.418101 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.418070    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-gp6vw"]
Jul 21 16:36:43.577306 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.577277    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a20993eb-8122-4092-85f7-e44abd3d7fed-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-gp6vw\" (UID: \"a20993eb-8122-4092-85f7-e44abd3d7fed\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gp6vw"
Jul 21 16:36:43.577467 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.577330    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xff6j\" (UniqueName: \"kubernetes.io/projected/a20993eb-8122-4092-85f7-e44abd3d7fed-kube-api-access-xff6j\") pod \"payload-pre-processing-7677b774bb-gp6vw\" (UID: \"a20993eb-8122-4092-85f7-e44abd3d7fed\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gp6vw"
Jul 21 16:36:43.631652 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.631616    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr" event={"ID":"4e28c73f-1e5e-441b-80c0-609fd49b06d0","Type":"ContainerStarted","Data":"8bf7fa7af7e6547fec6b08c7f1f7d9dfd89a8cd80eecf5b2059712559552f812"}
Jul 21 16:36:43.678273 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.678143    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a20993eb-8122-4092-85f7-e44abd3d7fed-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-gp6vw\" (UID: \"a20993eb-8122-4092-85f7-e44abd3d7fed\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gp6vw"
Jul 21 16:36:43.678273 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.678229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xff6j\" (UniqueName: \"kubernetes.io/projected/a20993eb-8122-4092-85f7-e44abd3d7fed-kube-api-access-xff6j\") pod \"payload-pre-processing-7677b774bb-gp6vw\" (UID: \"a20993eb-8122-4092-85f7-e44abd3d7fed\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gp6vw"
Jul 21 16:36:43.679006 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.678980    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a20993eb-8122-4092-85f7-e44abd3d7fed-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-gp6vw\" (UID: \"a20993eb-8122-4092-85f7-e44abd3d7fed\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gp6vw"
Jul 21 16:36:43.690017 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.689980    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xff6j\" (UniqueName: \"kubernetes.io/projected/a20993eb-8122-4092-85f7-e44abd3d7fed-kube-api-access-xff6j\") pod \"payload-pre-processing-7677b774bb-gp6vw\" (UID: \"a20993eb-8122-4092-85f7-e44abd3d7fed\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gp6vw"
Jul 21 16:36:43.717759 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.717719    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-gp6vw"
Jul 21 16:36:43.876941 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:43.876878    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-gp6vw"]
Jul 21 16:36:43.882554 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:36:43.882522    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20993eb_8122_4092_85f7_e44abd3d7fed.slice/crio-3518ca299937981012712666dad753759cd665319985121d6ec3d924bac87245 WatchSource:0}: Error finding container 3518ca299937981012712666dad753759cd665319985121d6ec3d924bac87245: Status 404 returned error can't find the container with id 3518ca299937981012712666dad753759cd665319985121d6ec3d924bac87245
Jul 21 16:36:44.655861 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:44.655810    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-gp6vw" event={"ID":"a20993eb-8122-4092-85f7-e44abd3d7fed","Type":"ContainerStarted","Data":"3518ca299937981012712666dad753759cd665319985121d6ec3d924bac87245"}
Jul 21 16:36:47.672385 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:47.672341    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr" event={"ID":"4e28c73f-1e5e-441b-80c0-609fd49b06d0","Type":"ContainerStarted","Data":"4e4204af0d991f69ae92b63500af81a14560d50b09b4fea5988189d71d3943f0"}
Jul 21 16:36:47.672891 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:47.672468    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"
Jul 21 16:36:47.673796 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:47.673770    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-gp6vw" event={"ID":"a20993eb-8122-4092-85f7-e44abd3d7fed","Type":"ContainerStarted","Data":"c5f549914d2ab287cb49469793a7439971ed5e08834fdc74f3abb4dba11d12bb"}
Jul 21 16:36:47.674261 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:47.674244    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-gp6vw"
Jul 21 16:36:47.690417 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:47.690372    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr" podStartSLOduration=1.536275746 podStartE2EDuration="5.690359123s" totalImagesPullingTime="4.154083377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:36:47.688604322 +0000 UTC m=+786.626912770" watchObservedRunningTime="2026-07-21 16:36:47.690359123 +0000 UTC m=+786.628667570"
Jul 21 16:36:47.704190 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:47.704147    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-gp6vw" podStartSLOduration=1.207583125 podStartE2EDuration="4.704129833s" totalImagesPullingTime="3.496546708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:36:47.70291042 +0000 UTC m=+786.641218868" watchObservedRunningTime="2026-07-21 16:36:47.704129833 +0000 UTC m=+786.642438283"
Jul 21 16:36:51.313256 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:51.312194    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-2ttxt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": read tcp 10.133.0.2:49548->10.133.0.26:15021: read: connection reset by peer" start-of-body=
Jul 21 16:36:51.313256 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:51.312287    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt" podUID="54412d7d-1b0e-45d0-acee-ff70727ddc61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": read tcp 10.133.0.2:49548->10.133.0.26:15021: read: connection reset by peer"
Jul 21 16:36:51.695288 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:51.695258    2578 generic.go:356] "Generic (PLEG): container finished" podID="54412d7d-1b0e-45d0-acee-ff70727ddc61" containerID="c0ffc31be42e92b7c7c2b1a74ca8516b53f9862ae1d3d3fea6d5a34aee3dd3f6" exitCode=0
Jul 21 16:36:51.695468 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:51.695332    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt" event={"ID":"54412d7d-1b0e-45d0-acee-ff70727ddc61","Type":"ContainerDied","Data":"c0ffc31be42e92b7c7c2b1a74ca8516b53f9862ae1d3d3fea6d5a34aee3dd3f6"}
Jul 21 16:36:51.695750 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:51.695736    2578 scope.go:117] "RemoveContainer" containerID="c0ffc31be42e92b7c7c2b1a74ca8516b53f9862ae1d3d3fea6d5a34aee3dd3f6"
Jul 21 16:36:51.696712 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:51.696683    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 21 16:36:51.696812 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:51.696759    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 21 16:36:51.696812 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:51.696792    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 21 16:36:52.701513 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:52.701478    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt" event={"ID":"54412d7d-1b0e-45d0-acee-ff70727ddc61","Type":"ContainerStarted","Data":"1747d0a248a2ea499fcd67fbac9ab8aadfc2a83d5d8927a964ad89d14823e96c"}
Jul 21 16:36:53.486262 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:53.486216    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:36:53.486493 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:53.486473    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-2ttxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Jul 21 16:36:53.486544 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:53.486519    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt" podUID="54412d7d-1b0e-45d0-acee-ff70727ddc61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Jul 21 16:36:53.685287 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:53.685255    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-586b44c766-mmjwr"
Jul 21 16:36:54.486526 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:54.486491    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-2ttxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Jul 21 16:36:54.486939 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:54.486543    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt" podUID="54412d7d-1b0e-45d0-acee-ff70727ddc61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Jul 21 16:36:55.486750 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:55.486712    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-2ttxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Jul 21 16:36:55.487140 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:55.486782    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt" podUID="54412d7d-1b0e-45d0-acee-ff70727ddc61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Jul 21 16:36:56.490259 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:56.490230    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:36:56.490659 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:56.490594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:36:56.491177 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:56.491160    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-2ttxt"
Jul 21 16:36:59.686034 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:36:59.686007    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-gp6vw"
Jul 21 16:37:03.504108 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.504075    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"]
Jul 21 16:37:03.510910 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.510886    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.514380 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.514303    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mkhrl\""
Jul 21 16:37:03.514380 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.514364    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 16:37:03.514549 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.514364    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 21 16:37:03.514549 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.514440    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 16:37:03.516707 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.516685    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"]
Jul 21 16:37:03.557474 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.557448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5ktc\" (UniqueName: \"kubernetes.io/projected/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-kube-api-access-j5ktc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.557586 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.557510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.557586 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.557563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.557586 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.557581    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.557724 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.557599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.557724 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.557617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.658258 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.658215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5ktc\" (UniqueName: \"kubernetes.io/projected/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-kube-api-access-j5ktc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.658469 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.658303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.658469 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.658359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.658469 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.658382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.658469 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.658411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.658721 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.658687    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.658811 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.658786    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.658906 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.658885    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.658977 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.658960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.660880 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.660861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.661174 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.661154    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.666014 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.665997    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5ktc\" (UniqueName: \"kubernetes.io/projected/8dde2ab9-c66f-40a5-ba95-6faf9ece8297-kube-api-access-j5ktc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv\" (UID: \"8dde2ab9-c66f-40a5-ba95-6faf9ece8297\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.822850 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.822754    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:03.952109 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:03.952079    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"]
Jul 21 16:37:03.954957 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:37:03.954929    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dde2ab9_c66f_40a5_ba95_6faf9ece8297.slice/crio-ef511521e4c8d272defc1fdf4b9e13b965cd45217cf1d151ca204d76f61461e4 WatchSource:0}: Error finding container ef511521e4c8d272defc1fdf4b9e13b965cd45217cf1d151ca204d76f61461e4: Status 404 returned error can't find the container with id ef511521e4c8d272defc1fdf4b9e13b965cd45217cf1d151ca204d76f61461e4
Jul 21 16:37:04.759420 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:04.759382    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv" event={"ID":"8dde2ab9-c66f-40a5-ba95-6faf9ece8297","Type":"ContainerStarted","Data":"ef511521e4c8d272defc1fdf4b9e13b965cd45217cf1d151ca204d76f61461e4"}
Jul 21 16:37:05.765258 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:05.765219    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv" event={"ID":"8dde2ab9-c66f-40a5-ba95-6faf9ece8297","Type":"ContainerStarted","Data":"836aa17c47c165765d18e7ea712aff45d0a38832f5c4f6e715f3138d95b00bf7"}
Jul 21 16:37:05.785204 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:05.785150    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv" podStartSLOduration=1.580409266 podStartE2EDuration="2.785135324s" totalImagesPullingTime="1.204726058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:37:05.783406518 +0000 UTC m=+804.721714968" watchObservedRunningTime="2026-07-21 16:37:05.785135324 +0000 UTC m=+804.723443771"
Jul 21 16:37:07.072251 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.072213    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"]
Jul 21 16:37:07.076124 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.076101    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.078499 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.078475    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 21 16:37:07.086333 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.086306    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"]
Jul 21 16:37:07.187268 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.187239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64bfbbc4-f650-487b-a403-e7b5ed9759cf-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.187438 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.187274    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64bfbbc4-f650-487b-a403-e7b5ed9759cf-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.187438 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.187348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64bfbbc4-f650-487b-a403-e7b5ed9759cf-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.187438 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.187405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64bfbbc4-f650-487b-a403-e7b5ed9759cf-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.187438 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.187427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64bfbbc4-f650-487b-a403-e7b5ed9759cf-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.187585 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.187474    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6flgp\" (UniqueName: \"kubernetes.io/projected/64bfbbc4-f650-487b-a403-e7b5ed9759cf-kube-api-access-6flgp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.288275 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.288246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64bfbbc4-f650-487b-a403-e7b5ed9759cf-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.288275 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.288277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64bfbbc4-f650-487b-a403-e7b5ed9759cf-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.288497 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.288311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6flgp\" (UniqueName: \"kubernetes.io/projected/64bfbbc4-f650-487b-a403-e7b5ed9759cf-kube-api-access-6flgp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.288497 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.288344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64bfbbc4-f650-487b-a403-e7b5ed9759cf-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.288497 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.288365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64bfbbc4-f650-487b-a403-e7b5ed9759cf-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.288497 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.288421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64bfbbc4-f650-487b-a403-e7b5ed9759cf-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.288776 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.288739    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64bfbbc4-f650-487b-a403-e7b5ed9759cf-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.288888 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.288778    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64bfbbc4-f650-487b-a403-e7b5ed9759cf-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.288888 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.288844    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64bfbbc4-f650-487b-a403-e7b5ed9759cf-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.290654 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.290620    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64bfbbc4-f650-487b-a403-e7b5ed9759cf-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.290912 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.290897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64bfbbc4-f650-487b-a403-e7b5ed9759cf-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.296388 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.296367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6flgp\" (UniqueName: \"kubernetes.io/projected/64bfbbc4-f650-487b-a403-e7b5ed9759cf-kube-api-access-6flgp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4lxr9\" (UID: \"64bfbbc4-f650-487b-a403-e7b5ed9759cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.386544 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.386512    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:07.513965 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.513938    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"]
Jul 21 16:37:07.516229 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:37:07.516198    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64bfbbc4_f650_487b_a403_e7b5ed9759cf.slice/crio-c0b33cc1f008385f8b4c80a573744e95c961020a409804a1f6c9ab49b69d698e WatchSource:0}: Error finding container c0b33cc1f008385f8b4c80a573744e95c961020a409804a1f6c9ab49b69d698e: Status 404 returned error can't find the container with id c0b33cc1f008385f8b4c80a573744e95c961020a409804a1f6c9ab49b69d698e
Jul 21 16:37:07.779080 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.779012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9" event={"ID":"64bfbbc4-f650-487b-a403-e7b5ed9759cf","Type":"ContainerStarted","Data":"c4158b8e5e4a99115f59a9cba7a595bdaa3c6a0dbb54fd99a9bedaec786e552e"}
Jul 21 16:37:07.779080 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.779080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9" event={"ID":"64bfbbc4-f650-487b-a403-e7b5ed9759cf","Type":"ContainerStarted","Data":"c0b33cc1f008385f8b4c80a573744e95c961020a409804a1f6c9ab49b69d698e"}
Jul 21 16:37:07.797955 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:07.797901    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9" podStartSLOduration=0.619611048 podStartE2EDuration="797.885014ms" totalImagesPullingTime="178.273966ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:37:07.795914158 +0000 UTC m=+806.734222607" watchObservedRunningTime="2026-07-21 16:37:07.797885014 +0000 UTC m=+806.736193482"
Jul 21 16:37:13.823023 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:13.822987    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:13.823539 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:13.823089    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:13.835528 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:13.835502    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:14.820897 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:14.820867    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv"
Jul 21 16:37:17.387540 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:17.387494    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:17.388052 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:17.387563    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:17.400032 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:17.400000    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:37:17.833861 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:37:17.833784    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4lxr9"
Jul 21 16:39:59.497426 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:39:59.497397    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c5cd97c6b-7gjqs"]
Jul 21 16:39:59.500802 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:39:59.500786    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c5cd97c6b-7gjqs"
Jul 21 16:39:59.516626 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:39:59.516603    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c5cd97c6b-7gjqs"]
Jul 21 16:39:59.580566 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:39:59.580541    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19d671a0-1917-46e0-98ee-f300c750e6f9-tls-cert\") pod \"authorino-5c5cd97c6b-7gjqs\" (UID: \"19d671a0-1917-46e0-98ee-f300c750e6f9\") " pod="kuadrant-system/authorino-5c5cd97c6b-7gjqs"
Jul 21 16:39:59.580725 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:39:59.580584    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92x9l\" (UniqueName: \"kubernetes.io/projected/19d671a0-1917-46e0-98ee-f300c750e6f9-kube-api-access-92x9l\") pod \"authorino-5c5cd97c6b-7gjqs\" (UID: \"19d671a0-1917-46e0-98ee-f300c750e6f9\") " pod="kuadrant-system/authorino-5c5cd97c6b-7gjqs"
Jul 21 16:39:59.681679 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:39:59.681632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19d671a0-1917-46e0-98ee-f300c750e6f9-tls-cert\") pod \"authorino-5c5cd97c6b-7gjqs\" (UID: \"19d671a0-1917-46e0-98ee-f300c750e6f9\") " pod="kuadrant-system/authorino-5c5cd97c6b-7gjqs"
Jul 21 16:39:59.681785 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:39:59.681696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92x9l\" (UniqueName: \"kubernetes.io/projected/19d671a0-1917-46e0-98ee-f300c750e6f9-kube-api-access-92x9l\") pod \"authorino-5c5cd97c6b-7gjqs\" (UID: \"19d671a0-1917-46e0-98ee-f300c750e6f9\") " pod="kuadrant-system/authorino-5c5cd97c6b-7gjqs"
Jul 21 16:39:59.683917 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:39:59.683898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19d671a0-1917-46e0-98ee-f300c750e6f9-tls-cert\") pod \"authorino-5c5cd97c6b-7gjqs\" (UID: \"19d671a0-1917-46e0-98ee-f300c750e6f9\") " pod="kuadrant-system/authorino-5c5cd97c6b-7gjqs"
Jul 21 16:39:59.689801 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:39:59.689785    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92x9l\" (UniqueName: \"kubernetes.io/projected/19d671a0-1917-46e0-98ee-f300c750e6f9-kube-api-access-92x9l\") pod \"authorino-5c5cd97c6b-7gjqs\" (UID: \"19d671a0-1917-46e0-98ee-f300c750e6f9\") " pod="kuadrant-system/authorino-5c5cd97c6b-7gjqs"
Jul 21 16:39:59.809188 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:39:59.809125    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c5cd97c6b-7gjqs"
Jul 21 16:39:59.948774 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:39:59.948706    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c5cd97c6b-7gjqs"]
Jul 21 16:39:59.951563 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:39:59.951532    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19d671a0_1917_46e0_98ee_f300c750e6f9.slice/crio-eceb81c27265682d831c338a75b4e3621a7caa6c9d7f8c5b69d2a9753f7e9146 WatchSource:0}: Error finding container eceb81c27265682d831c338a75b4e3621a7caa6c9d7f8c5b69d2a9753f7e9146: Status 404 returned error can't find the container with id eceb81c27265682d831c338a75b4e3621a7caa6c9d7f8c5b69d2a9753f7e9146
Jul 21 16:39:59.952911 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:39:59.952893    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:40:00.554461 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:00.554417    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c5cd97c6b-7gjqs" event={"ID":"19d671a0-1917-46e0-98ee-f300c750e6f9","Type":"ContainerStarted","Data":"4c6b5f485ef3cd78d5e3d5923dabf81c577be773e121c53e318df847aa862c09"}
Jul 21 16:40:00.554461 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:00.554464    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c5cd97c6b-7gjqs" event={"ID":"19d671a0-1917-46e0-98ee-f300c750e6f9","Type":"ContainerStarted","Data":"eceb81c27265682d831c338a75b4e3621a7caa6c9d7f8c5b69d2a9753f7e9146"}
Jul 21 16:40:00.574317 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:00.574271    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c5cd97c6b-7gjqs" podStartSLOduration=1.129936039 podStartE2EDuration="1.574256788s" totalImagesPullingTime="444.320749ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:40:00.572728882 +0000 UTC m=+979.511037330" watchObservedRunningTime="2026-07-21 16:40:00.574256788 +0000 UTC m=+979.512565234"
Jul 21 16:40:00.602852 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:00.601580    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-569db4b5dc-pmqv5"]
Jul 21 16:40:00.602852 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:00.601784    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-569db4b5dc-pmqv5" podUID="4e7ea375-7b8a-41ee-bc93-035d6aac2a03" containerName="authorino" containerID="cri-o://df3b336cdd86bbf98818131080742261a50e18f0bbb411ad0c4815b21635fbdf" gracePeriod=30
Jul 21 16:40:00.860380 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:00.860354    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569db4b5dc-pmqv5"
Jul 21 16:40:00.892054 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:00.892019    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e7ea375-7b8a-41ee-bc93-035d6aac2a03-tls-cert\") pod \"4e7ea375-7b8a-41ee-bc93-035d6aac2a03\" (UID: \"4e7ea375-7b8a-41ee-bc93-035d6aac2a03\") "
Jul 21 16:40:00.892202 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:00.892097    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd6m2\" (UniqueName: \"kubernetes.io/projected/4e7ea375-7b8a-41ee-bc93-035d6aac2a03-kube-api-access-sd6m2\") pod \"4e7ea375-7b8a-41ee-bc93-035d6aac2a03\" (UID: \"4e7ea375-7b8a-41ee-bc93-035d6aac2a03\") "
Jul 21 16:40:00.894191 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:00.894158    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e7ea375-7b8a-41ee-bc93-035d6aac2a03-kube-api-access-sd6m2" (OuterVolumeSpecName: "kube-api-access-sd6m2") pod "4e7ea375-7b8a-41ee-bc93-035d6aac2a03" (UID: "4e7ea375-7b8a-41ee-bc93-035d6aac2a03"). InnerVolumeSpecName "kube-api-access-sd6m2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:40:00.903612 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:00.903584    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e7ea375-7b8a-41ee-bc93-035d6aac2a03-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4e7ea375-7b8a-41ee-bc93-035d6aac2a03" (UID: "4e7ea375-7b8a-41ee-bc93-035d6aac2a03"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:40:00.993406 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:00.993329    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd6m2\" (UniqueName: \"kubernetes.io/projected/4e7ea375-7b8a-41ee-bc93-035d6aac2a03-kube-api-access-sd6m2\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:40:00.993406 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:00.993357    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e7ea375-7b8a-41ee-bc93-035d6aac2a03-tls-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:40:01.561326 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:01.561292    2578 generic.go:356] "Generic (PLEG): container finished" podID="4e7ea375-7b8a-41ee-bc93-035d6aac2a03" containerID="df3b336cdd86bbf98818131080742261a50e18f0bbb411ad0c4815b21635fbdf" exitCode=0
Jul 21 16:40:01.561813 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:01.561339    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569db4b5dc-pmqv5"
Jul 21 16:40:01.561813 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:01.561379    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569db4b5dc-pmqv5" event={"ID":"4e7ea375-7b8a-41ee-bc93-035d6aac2a03","Type":"ContainerDied","Data":"df3b336cdd86bbf98818131080742261a50e18f0bbb411ad0c4815b21635fbdf"}
Jul 21 16:40:01.561813 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:01.561428    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569db4b5dc-pmqv5" event={"ID":"4e7ea375-7b8a-41ee-bc93-035d6aac2a03","Type":"ContainerDied","Data":"3546698d09c91905bea6b431f7846edb715e6f812a60641d2ed4f8d7f3f02513"}
Jul 21 16:40:01.561813 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:01.561452    2578 scope.go:117] "RemoveContainer" containerID="df3b336cdd86bbf98818131080742261a50e18f0bbb411ad0c4815b21635fbdf"
Jul 21 16:40:01.570952 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:01.570935    2578 scope.go:117] "RemoveContainer" containerID="df3b336cdd86bbf98818131080742261a50e18f0bbb411ad0c4815b21635fbdf"
Jul 21 16:40:01.571209 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:40:01.571187    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df3b336cdd86bbf98818131080742261a50e18f0bbb411ad0c4815b21635fbdf\": container with ID starting with df3b336cdd86bbf98818131080742261a50e18f0bbb411ad0c4815b21635fbdf not found: ID does not exist" containerID="df3b336cdd86bbf98818131080742261a50e18f0bbb411ad0c4815b21635fbdf"
Jul 21 16:40:01.571301 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:01.571217    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df3b336cdd86bbf98818131080742261a50e18f0bbb411ad0c4815b21635fbdf"} err="failed to get container status \"df3b336cdd86bbf98818131080742261a50e18f0bbb411ad0c4815b21635fbdf\": rpc error: code = NotFound desc = could not find container \"df3b336cdd86bbf98818131080742261a50e18f0bbb411ad0c4815b21635fbdf\": container with ID starting with df3b336cdd86bbf98818131080742261a50e18f0bbb411ad0c4815b21635fbdf not found: ID does not exist"
Jul 21 16:40:01.583901 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:01.583875    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-569db4b5dc-pmqv5"]
Jul 21 16:40:01.589876 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:01.589855    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-569db4b5dc-pmqv5"]
Jul 21 16:40:03.581721 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:40:03.581692    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e7ea375-7b8a-41ee-bc93-035d6aac2a03" path="/var/lib/kubelet/pods/4e7ea375-7b8a-41ee-bc93-035d6aac2a03/volumes"
Jul 21 16:50:58.277900 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.277862    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"]
Jul 21 16:50:58.278388 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.278234    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e7ea375-7b8a-41ee-bc93-035d6aac2a03" containerName="authorino"
Jul 21 16:50:58.278388 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.278246    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e7ea375-7b8a-41ee-bc93-035d6aac2a03" containerName="authorino"
Jul 21 16:50:58.278388 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.278313    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e7ea375-7b8a-41ee-bc93-035d6aac2a03" containerName="authorino"
Jul 21 16:50:58.281388 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.281371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.283733 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.283714    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-860bd34a-kserve-self-signed-certs\""
Jul 21 16:50:58.297912 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.297885    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"]
Jul 21 16:50:58.467786 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.467752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-tls-certs\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.467969 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.467795    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-model-cache\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.467969 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.467882    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-tmp-dir\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.467969 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.467931    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-dshm\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.468074 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.468004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-home\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.468074 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.468020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssn26\" (UniqueName: \"kubernetes.io/projected/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-kube-api-access-ssn26\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.569277 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.569188    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-dshm\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.569277 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.569243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-home\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.569277 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.569260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssn26\" (UniqueName: \"kubernetes.io/projected/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-kube-api-access-ssn26\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.569510 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.569295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-tls-certs\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.569510 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.569315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-model-cache\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.569604 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.569573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-tmp-dir\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.569771 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.569742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-model-cache\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.569894 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.569749    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-home\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.569894 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.569872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-tmp-dir\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.571459 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.571440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-dshm\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.571745 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.571725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-tls-certs\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.577540 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.577515    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssn26\" (UniqueName: \"kubernetes.io/projected/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-kube-api-access-ssn26\") pod \"e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") " pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.589571 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.589549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:50:58.732622 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:58.732598    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"]
Jul 21 16:50:58.734574 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:50:58.734540    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc32fd55_9ef5_4dcb_9190_649e0fc82e59.slice/crio-bfd4f4be467e5d6ca01b526ae5630aec666a5fe7359d902df55fb3814d94341b WatchSource:0}: Error finding container bfd4f4be467e5d6ca01b526ae5630aec666a5fe7359d902df55fb3814d94341b: Status 404 returned error can't find the container with id bfd4f4be467e5d6ca01b526ae5630aec666a5fe7359d902df55fb3814d94341b
Jul 21 16:50:59.606953 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:59.606914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp" event={"ID":"fc32fd55-9ef5-4dcb-9190-649e0fc82e59","Type":"ContainerStarted","Data":"854043fab6842fd751ada846ac29085a7572b67c284b902ba510746afe386070"}
Jul 21 16:50:59.607411 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:59.606957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp" event={"ID":"fc32fd55-9ef5-4dcb-9190-649e0fc82e59","Type":"ContainerStarted","Data":"bfd4f4be467e5d6ca01b526ae5630aec666a5fe7359d902df55fb3814d94341b"}
Jul 21 16:50:59.624754 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:50:59.624706    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp" podStartSLOduration=1.624692541 podStartE2EDuration="1.624692541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:50:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:50:59.623631661 +0000 UTC m=+1638.561940125" watchObservedRunningTime="2026-07-21 16:50:59.624692541 +0000 UTC m=+1638.563000988"
Jul 21 16:51:08.590171 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:08.590073    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:51:08.590171 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:08.590126    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:51:08.602702 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:08.602677    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:51:08.657070 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:08.657042    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:51:23.387205 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.387170    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"]
Jul 21 16:51:23.391237 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.391219    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.393619 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.393597    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-860bd34a-kserve-self-signed-certs\""
Jul 21 16:51:23.401195 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.401173    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"]
Jul 21 16:51:23.508701 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.508676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-home\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.508807 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.508733    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-model-cache\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.508807 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.508776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-tmp-dir\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.508807 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.508800    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-dshm\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.508910 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.508867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-tls-certs\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.508910 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.508901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2w95\" (UniqueName: \"kubernetes.io/projected/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-kube-api-access-l2w95\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.609729 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.609699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-model-cache\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.609842 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.609739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-tmp-dir\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.609842 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.609765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-dshm\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.609842 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.609797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-tls-certs\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.609842 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.609817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2w95\" (UniqueName: \"kubernetes.io/projected/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-kube-api-access-l2w95\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.610050 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.609845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-home\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.610158 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.610131    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-tmp-dir\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.610225 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.610135    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-model-cache\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.610225 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.610189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-home\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.612136 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.612109    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-dshm\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.612314 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.612297    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-tls-certs\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.618124 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.618103    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2w95\" (UniqueName: \"kubernetes.io/projected/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-kube-api-access-l2w95\") pod \"e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") " pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.701232 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.701170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:23.831709 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:23.831686    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"]
Jul 21 16:51:23.834182 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:51:23.834156    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40dc9a52_5322_4a8e_9d4b_9fcadd1fa4b0.slice/crio-82a37f8f4f180dd7d8363eb7f2933c9f747c5e631c7669be6b3f1ecbbb3ee452 WatchSource:0}: Error finding container 82a37f8f4f180dd7d8363eb7f2933c9f747c5e631c7669be6b3f1ecbbb3ee452: Status 404 returned error can't find the container with id 82a37f8f4f180dd7d8363eb7f2933c9f747c5e631c7669be6b3f1ecbbb3ee452
Jul 21 16:51:24.719329 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:24.719289    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv" event={"ID":"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0","Type":"ContainerStarted","Data":"d520d5ac552a6244332016a213fd1789c8ff8e756931cc9d49a057a8e2822244"}
Jul 21 16:51:24.719329 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:24.719331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv" event={"ID":"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0","Type":"ContainerStarted","Data":"82a37f8f4f180dd7d8363eb7f2933c9f747c5e631c7669be6b3f1ecbbb3ee452"}
Jul 21 16:51:24.744654 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:24.744594    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv" podStartSLOduration=1.744579603 podStartE2EDuration="1.744579603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:51:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:51:24.744384583 +0000 UTC m=+1663.682693047" watchObservedRunningTime="2026-07-21 16:51:24.744579603 +0000 UTC m=+1663.682888051"
Jul 21 16:51:33.701507 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:33.701475    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:33.701999 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:33.701537    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:33.713910 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:33.713887    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:33.772156 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:33.772132    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:40.899399 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:40.899359    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"]
Jul 21 16:51:41.972603 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:41.972572    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"]
Jul 21 16:51:55.921277 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:55.921213    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp" podUID="fc32fd55-9ef5-4dcb-9190-649e0fc82e59" containerName="main" containerID="cri-o://854043fab6842fd751ada846ac29085a7572b67c284b902ba510746afe386070" gracePeriod=45
Jul 21 16:51:56.174952 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.174892    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:51:56.311450 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.311413    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssn26\" (UniqueName: \"kubernetes.io/projected/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-kube-api-access-ssn26\") pod \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") "
Jul 21 16:51:56.311620 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.311512    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-home\") pod \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") "
Jul 21 16:51:56.311620 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.311541    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-dshm\") pod \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") "
Jul 21 16:51:56.311620 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.311572    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-model-cache\") pod \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") "
Jul 21 16:51:56.311620 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.311600    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-tls-certs\") pod \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") "
Jul 21 16:51:56.311620 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.311617    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-tmp-dir\") pod \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\" (UID: \"fc32fd55-9ef5-4dcb-9190-649e0fc82e59\") "
Jul 21 16:51:56.311918 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.311822    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-home" (OuterVolumeSpecName: "home") pod "fc32fd55-9ef5-4dcb-9190-649e0fc82e59" (UID: "fc32fd55-9ef5-4dcb-9190-649e0fc82e59"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:51:56.311918 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.311858    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-model-cache" (OuterVolumeSpecName: "model-cache") pod "fc32fd55-9ef5-4dcb-9190-649e0fc82e59" (UID: "fc32fd55-9ef5-4dcb-9190-649e0fc82e59"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:51:56.312038 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.312018    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:51:56.312097 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.312052    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:51:56.312097 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.312010    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fc32fd55-9ef5-4dcb-9190-649e0fc82e59" (UID: "fc32fd55-9ef5-4dcb-9190-649e0fc82e59"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:51:56.313802 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.313772    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-dshm" (OuterVolumeSpecName: "dshm") pod "fc32fd55-9ef5-4dcb-9190-649e0fc82e59" (UID: "fc32fd55-9ef5-4dcb-9190-649e0fc82e59"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:51:56.313916 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.313840    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fc32fd55-9ef5-4dcb-9190-649e0fc82e59" (UID: "fc32fd55-9ef5-4dcb-9190-649e0fc82e59"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:51:56.313916 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.313845    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-kube-api-access-ssn26" (OuterVolumeSpecName: "kube-api-access-ssn26") pod "fc32fd55-9ef5-4dcb-9190-649e0fc82e59" (UID: "fc32fd55-9ef5-4dcb-9190-649e0fc82e59"). InnerVolumeSpecName "kube-api-access-ssn26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:51:56.412673 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.412620    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:51:56.412673 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.412669    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:51:56.412673 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.412679    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:51:56.412881 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.412688    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssn26\" (UniqueName: \"kubernetes.io/projected/fc32fd55-9ef5-4dcb-9190-649e0fc82e59-kube-api-access-ssn26\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:51:56.882574 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.882539    2578 generic.go:356] "Generic (PLEG): container finished" podID="fc32fd55-9ef5-4dcb-9190-649e0fc82e59" containerID="854043fab6842fd751ada846ac29085a7572b67c284b902ba510746afe386070" exitCode=0
Jul 21 16:51:56.882762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.882585    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"
Jul 21 16:51:56.882762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.882626    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp" event={"ID":"fc32fd55-9ef5-4dcb-9190-649e0fc82e59","Type":"ContainerDied","Data":"854043fab6842fd751ada846ac29085a7572b67c284b902ba510746afe386070"}
Jul 21 16:51:56.882762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.882689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp" event={"ID":"fc32fd55-9ef5-4dcb-9190-649e0fc82e59","Type":"ContainerDied","Data":"bfd4f4be467e5d6ca01b526ae5630aec666a5fe7359d902df55fb3814d94341b"}
Jul 21 16:51:56.882762 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.882712    2578 scope.go:117] "RemoveContainer" containerID="854043fab6842fd751ada846ac29085a7572b67c284b902ba510746afe386070"
Jul 21 16:51:56.892511 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.892491    2578 scope.go:117] "RemoveContainer" containerID="854043fab6842fd751ada846ac29085a7572b67c284b902ba510746afe386070"
Jul 21 16:51:56.893976 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:51:56.893943    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"854043fab6842fd751ada846ac29085a7572b67c284b902ba510746afe386070\": container with ID starting with 854043fab6842fd751ada846ac29085a7572b67c284b902ba510746afe386070 not found: ID does not exist" containerID="854043fab6842fd751ada846ac29085a7572b67c284b902ba510746afe386070"
Jul 21 16:51:56.894095 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.893985    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"854043fab6842fd751ada846ac29085a7572b67c284b902ba510746afe386070"} err="failed to get container status \"854043fab6842fd751ada846ac29085a7572b67c284b902ba510746afe386070\": rpc error: code = NotFound desc = could not find container \"854043fab6842fd751ada846ac29085a7572b67c284b902ba510746afe386070\": container with ID starting with 854043fab6842fd751ada846ac29085a7572b67c284b902ba510746afe386070 not found: ID does not exist"
Jul 21 16:51:56.903894 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.903871    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"]
Jul 21 16:51:56.907911 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.907888    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-860bd34a-kserve-5c95577d6c-z2vgp"]
Jul 21 16:51:56.992490 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:56.992442    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv" podUID="40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0" containerName="main" containerID="cri-o://d520d5ac552a6244332016a213fd1789c8ff8e756931cc9d49a057a8e2822244" gracePeriod=45
Jul 21 16:51:57.243655 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.243616    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:57.322603 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.322571    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-dshm\") pod \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") "
Jul 21 16:51:57.322777 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.322670    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-tls-certs\") pod \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") "
Jul 21 16:51:57.322777 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.322739    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-home\") pod \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") "
Jul 21 16:51:57.322864 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.322793    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-tmp-dir\") pod \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") "
Jul 21 16:51:57.322864 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.322832    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-model-cache\") pod \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") "
Jul 21 16:51:57.322864 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.322851    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2w95\" (UniqueName: \"kubernetes.io/projected/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-kube-api-access-l2w95\") pod \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\" (UID: \"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0\") "
Jul 21 16:51:57.323009 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.322985    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-home" (OuterVolumeSpecName: "home") pod "40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0" (UID: "40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:51:57.323129 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.323102    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0" (UID: "40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:51:57.323129 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.323113    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-model-cache" (OuterVolumeSpecName: "model-cache") pod "40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0" (UID: "40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:51:57.323267 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.323127    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:51:57.324760 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.324737    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0" (UID: "40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:51:57.324872 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.324852    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-dshm" (OuterVolumeSpecName: "dshm") pod "40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0" (UID: "40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:51:57.324914 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.324852    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-kube-api-access-l2w95" (OuterVolumeSpecName: "kube-api-access-l2w95") pod "40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0" (UID: "40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0"). InnerVolumeSpecName "kube-api-access-l2w95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:51:57.424334 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.424268    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:51:57.424334 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.424291    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2w95\" (UniqueName: \"kubernetes.io/projected/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-kube-api-access-l2w95\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:51:57.424334 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.424302    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:51:57.424334 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.424310    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:51:57.424334 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.424319    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:51:57.582412 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.582380    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc32fd55-9ef5-4dcb-9190-649e0fc82e59" path="/var/lib/kubelet/pods/fc32fd55-9ef5-4dcb-9190-649e0fc82e59/volumes"
Jul 21 16:51:57.889068 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.889035    2578 generic.go:356] "Generic (PLEG): container finished" podID="40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0" containerID="d520d5ac552a6244332016a213fd1789c8ff8e756931cc9d49a057a8e2822244" exitCode=0
Jul 21 16:51:57.889247 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.889076    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"
Jul 21 16:51:57.889247 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.889075    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv" event={"ID":"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0","Type":"ContainerDied","Data":"d520d5ac552a6244332016a213fd1789c8ff8e756931cc9d49a057a8e2822244"}
Jul 21 16:51:57.889247 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.889198    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv" event={"ID":"40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0","Type":"ContainerDied","Data":"82a37f8f4f180dd7d8363eb7f2933c9f747c5e631c7669be6b3f1ecbbb3ee452"}
Jul 21 16:51:57.889247 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.889217    2578 scope.go:117] "RemoveContainer" containerID="d520d5ac552a6244332016a213fd1789c8ff8e756931cc9d49a057a8e2822244"
Jul 21 16:51:57.897689 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.897665    2578 scope.go:117] "RemoveContainer" containerID="d520d5ac552a6244332016a213fd1789c8ff8e756931cc9d49a057a8e2822244"
Jul 21 16:51:57.897927 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:51:57.897907    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d520d5ac552a6244332016a213fd1789c8ff8e756931cc9d49a057a8e2822244\": container with ID starting with d520d5ac552a6244332016a213fd1789c8ff8e756931cc9d49a057a8e2822244 not found: ID does not exist" containerID="d520d5ac552a6244332016a213fd1789c8ff8e756931cc9d49a057a8e2822244"
Jul 21 16:51:57.897986 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.897934    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d520d5ac552a6244332016a213fd1789c8ff8e756931cc9d49a057a8e2822244"} err="failed to get container status \"d520d5ac552a6244332016a213fd1789c8ff8e756931cc9d49a057a8e2822244\": rpc error: code = NotFound desc = could not find container \"d520d5ac552a6244332016a213fd1789c8ff8e756931cc9d49a057a8e2822244\": container with ID starting with d520d5ac552a6244332016a213fd1789c8ff8e756931cc9d49a057a8e2822244 not found: ID does not exist"
Jul 21 16:51:57.904661 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.904612    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"]
Jul 21 16:51:57.908575 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:57.908554    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-860bd34a-kserve-6ddd447979-jskhv"]
Jul 21 16:51:59.582552 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:51:59.582519    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0" path="/var/lib/kubelet/pods/40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0/volumes"
Jul 21 16:55:23.829903 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.829811    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"]
Jul 21 16:55:23.830382 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.830229    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc32fd55-9ef5-4dcb-9190-649e0fc82e59" containerName="main"
Jul 21 16:55:23.830382 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.830242    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc32fd55-9ef5-4dcb-9190-649e0fc82e59" containerName="main"
Jul 21 16:55:23.830382 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.830255    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0" containerName="main"
Jul 21 16:55:23.830382 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.830264    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0" containerName="main"
Jul 21 16:55:23.830382 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.830358    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc32fd55-9ef5-4dcb-9190-649e0fc82e59" containerName="main"
Jul 21 16:55:23.830382 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.830372    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="40dc9a52-5322-4a8e-9d4b-9fcadd1fa4b0" containerName="main"
Jul 21 16:55:23.833381 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.833356    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:55:23.836249 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.836217    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-843df0de-serving-cert\""
Jul 21 16:55:23.849826 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.849788    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"]
Jul 21 16:55:23.877183 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.877147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b262dbf8-7cf3-428a-9de5-27cd89864a3e-maas-api-tls\") pod \"maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb\" (UID: \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:55:23.877183 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.877189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b262dbf8-7cf3-428a-9de5-27cd89864a3e-openshift-service-ca\") pod \"maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb\" (UID: \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:55:23.877382 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.877264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db6xn\" (UniqueName: \"kubernetes.io/projected/b262dbf8-7cf3-428a-9de5-27cd89864a3e-kube-api-access-db6xn\") pod \"maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb\" (UID: \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:55:23.978357 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.978322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b262dbf8-7cf3-428a-9de5-27cd89864a3e-openshift-service-ca\") pod \"maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb\" (UID: \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:55:23.978532 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.978388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db6xn\" (UniqueName: \"kubernetes.io/projected/b262dbf8-7cf3-428a-9de5-27cd89864a3e-kube-api-access-db6xn\") pod \"maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb\" (UID: \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:55:23.978532 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.978447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b262dbf8-7cf3-428a-9de5-27cd89864a3e-maas-api-tls\") pod \"maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb\" (UID: \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:55:23.978608 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:55:23.978537    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-serving-cert: secret "maas-api-e2e-ait-843df0de-serving-cert" not found
Jul 21 16:55:23.978608 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:55:23.978605    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b262dbf8-7cf3-428a-9de5-27cd89864a3e-maas-api-tls podName:b262dbf8-7cf3-428a-9de5-27cd89864a3e nodeName:}" failed. No retries permitted until 2026-07-21 16:55:24.478586089 +0000 UTC m=+1903.416894517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b262dbf8-7cf3-428a-9de5-27cd89864a3e-maas-api-tls") pod "maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb" (UID: "b262dbf8-7cf3-428a-9de5-27cd89864a3e") : secret "maas-api-e2e-ait-843df0de-serving-cert" not found
Jul 21 16:55:23.979002 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.978981    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b262dbf8-7cf3-428a-9de5-27cd89864a3e-openshift-service-ca\") pod \"maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb\" (UID: \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:55:23.988484 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:23.988460    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db6xn\" (UniqueName: \"kubernetes.io/projected/b262dbf8-7cf3-428a-9de5-27cd89864a3e-kube-api-access-db6xn\") pod \"maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb\" (UID: \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:55:24.483783 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:24.483747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b262dbf8-7cf3-428a-9de5-27cd89864a3e-maas-api-tls\") pod \"maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb\" (UID: \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:55:24.486061 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:24.486036    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b262dbf8-7cf3-428a-9de5-27cd89864a3e-maas-api-tls\") pod \"maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb\" (UID: \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:55:24.744608 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:24.744513    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:55:25.098040 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:25.098009    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"]
Jul 21 16:55:25.100454 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:55:25.100431    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb262dbf8_7cf3_428a_9de5_27cd89864a3e.slice/crio-e533566b565b2aed649a046ad5d38241861368a9a00b748c0f90a49d8e74ed0b WatchSource:0}: Error finding container e533566b565b2aed649a046ad5d38241861368a9a00b748c0f90a49d8e74ed0b: Status 404 returned error can't find the container with id e533566b565b2aed649a046ad5d38241861368a9a00b748c0f90a49d8e74ed0b
Jul 21 16:55:25.102317 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:25.102296    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:55:25.854988 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:25.854952    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb" event={"ID":"b262dbf8-7cf3-428a-9de5-27cd89864a3e","Type":"ContainerStarted","Data":"599919876adca795bce89292da2ab6c56b908da9e1107a39c2d63322113a99c9"}
Jul 21 16:55:25.855183 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:25.855011    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb" event={"ID":"b262dbf8-7cf3-428a-9de5-27cd89864a3e","Type":"ContainerStarted","Data":"e533566b565b2aed649a046ad5d38241861368a9a00b748c0f90a49d8e74ed0b"}
Jul 21 16:55:25.855183 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:25.855055    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:55:25.887682 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:25.887611    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb" podStartSLOduration=2.416060368 podStartE2EDuration="2.887593948s" totalImagesPullingTime="471.53358ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:55:25.886815895 +0000 UTC m=+1904.825124343" watchObservedRunningTime="2026-07-21 16:55:25.887593948 +0000 UTC m=+1904.825902395"
Jul 21 16:55:31.865921 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:31.865886    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:55:59.682384 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:59.682349    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"]
Jul 21 16:55:59.683278 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:59.682594    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb" podUID="b262dbf8-7cf3-428a-9de5-27cd89864a3e" containerName="maas-api" containerID="cri-o://599919876adca795bce89292da2ab6c56b908da9e1107a39c2d63322113a99c9" gracePeriod=30
Jul 21 16:55:59.930902 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:55:59.930878    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:56:00.011602 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.011523    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b262dbf8-7cf3-428a-9de5-27cd89864a3e-maas-api-tls\") pod \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\" (UID: \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\") "
Jul 21 16:56:00.011602 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.011575    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b262dbf8-7cf3-428a-9de5-27cd89864a3e-openshift-service-ca\") pod \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\" (UID: \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\") "
Jul 21 16:56:00.011893 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.011675    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db6xn\" (UniqueName: \"kubernetes.io/projected/b262dbf8-7cf3-428a-9de5-27cd89864a3e-kube-api-access-db6xn\") pod \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\" (UID: \"b262dbf8-7cf3-428a-9de5-27cd89864a3e\") "
Jul 21 16:56:00.012076 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.012048    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b262dbf8-7cf3-428a-9de5-27cd89864a3e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b262dbf8-7cf3-428a-9de5-27cd89864a3e" (UID: "b262dbf8-7cf3-428a-9de5-27cd89864a3e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:56:00.013789 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.013758    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b262dbf8-7cf3-428a-9de5-27cd89864a3e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b262dbf8-7cf3-428a-9de5-27cd89864a3e" (UID: "b262dbf8-7cf3-428a-9de5-27cd89864a3e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:56:00.013789 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.013755    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b262dbf8-7cf3-428a-9de5-27cd89864a3e-kube-api-access-db6xn" (OuterVolumeSpecName: "kube-api-access-db6xn") pod "b262dbf8-7cf3-428a-9de5-27cd89864a3e" (UID: "b262dbf8-7cf3-428a-9de5-27cd89864a3e"). InnerVolumeSpecName "kube-api-access-db6xn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:56:00.015202 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.015181    2578 generic.go:356] "Generic (PLEG): container finished" podID="b262dbf8-7cf3-428a-9de5-27cd89864a3e" containerID="599919876adca795bce89292da2ab6c56b908da9e1107a39c2d63322113a99c9" exitCode=0
Jul 21 16:56:00.015297 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.015229    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"
Jul 21 16:56:00.015297 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.015260    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb" event={"ID":"b262dbf8-7cf3-428a-9de5-27cd89864a3e","Type":"ContainerDied","Data":"599919876adca795bce89292da2ab6c56b908da9e1107a39c2d63322113a99c9"}
Jul 21 16:56:00.015397 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.015316    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb" event={"ID":"b262dbf8-7cf3-428a-9de5-27cd89864a3e","Type":"ContainerDied","Data":"e533566b565b2aed649a046ad5d38241861368a9a00b748c0f90a49d8e74ed0b"}
Jul 21 16:56:00.015397 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.015341    2578 scope.go:117] "RemoveContainer" containerID="599919876adca795bce89292da2ab6c56b908da9e1107a39c2d63322113a99c9"
Jul 21 16:56:00.033442 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.033425    2578 scope.go:117] "RemoveContainer" containerID="599919876adca795bce89292da2ab6c56b908da9e1107a39c2d63322113a99c9"
Jul 21 16:56:00.033717 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:56:00.033699    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"599919876adca795bce89292da2ab6c56b908da9e1107a39c2d63322113a99c9\": container with ID starting with 599919876adca795bce89292da2ab6c56b908da9e1107a39c2d63322113a99c9 not found: ID does not exist" containerID="599919876adca795bce89292da2ab6c56b908da9e1107a39c2d63322113a99c9"
Jul 21 16:56:00.033777 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.033727    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"599919876adca795bce89292da2ab6c56b908da9e1107a39c2d63322113a99c9"} err="failed to get container status \"599919876adca795bce89292da2ab6c56b908da9e1107a39c2d63322113a99c9\": rpc error: code = NotFound desc = could not find container \"599919876adca795bce89292da2ab6c56b908da9e1107a39c2d63322113a99c9\": container with ID starting with 599919876adca795bce89292da2ab6c56b908da9e1107a39c2d63322113a99c9 not found: ID does not exist"
Jul 21 16:56:00.042852 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.042830    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"]
Jul 21 16:56:00.046713 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.046691    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-843df0de-7bb74f8b8c-dznhb"]
Jul 21 16:56:00.112633 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.112608    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db6xn\" (UniqueName: \"kubernetes.io/projected/b262dbf8-7cf3-428a-9de5-27cd89864a3e-kube-api-access-db6xn\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:56:00.112633 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.112630    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b262dbf8-7cf3-428a-9de5-27cd89864a3e-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:56:00.112784 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:00.112667    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b262dbf8-7cf3-428a-9de5-27cd89864a3e-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:56:01.583528 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:01.583495    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b262dbf8-7cf3-428a-9de5-27cd89864a3e" path="/var/lib/kubelet/pods/b262dbf8-7cf3-428a-9de5-27cd89864a3e/volumes"
Jul 21 16:56:08.320995 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.320964    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"]
Jul 21 16:56:08.321375 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.321356    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b262dbf8-7cf3-428a-9de5-27cd89864a3e" containerName="maas-api"
Jul 21 16:56:08.321375 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.321369    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b262dbf8-7cf3-428a-9de5-27cd89864a3e" containerName="maas-api"
Jul 21 16:56:08.321458 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.321438    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b262dbf8-7cf3-428a-9de5-27cd89864a3e" containerName="maas-api"
Jul 21 16:56:08.325830 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.325814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:08.329162 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.329146    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-bbd93f74-serving-cert\""
Jul 21 16:56:08.341940 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.341914    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"]
Jul 21 16:56:08.399013 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.398975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c495529b-1847-4e84-b91a-7fca2b24696f-openshift-service-ca\") pod \"maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k\" (UID: \"c495529b-1847-4e84-b91a-7fca2b24696f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:08.399013 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.399012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg2bd\" (UniqueName: \"kubernetes.io/projected/c495529b-1847-4e84-b91a-7fca2b24696f-kube-api-access-dg2bd\") pod \"maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k\" (UID: \"c495529b-1847-4e84-b91a-7fca2b24696f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:08.399265 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.399169    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c495529b-1847-4e84-b91a-7fca2b24696f-maas-api-tls\") pod \"maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k\" (UID: \"c495529b-1847-4e84-b91a-7fca2b24696f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:08.500524 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.500493    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c495529b-1847-4e84-b91a-7fca2b24696f-maas-api-tls\") pod \"maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k\" (UID: \"c495529b-1847-4e84-b91a-7fca2b24696f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:08.500748 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.500545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c495529b-1847-4e84-b91a-7fca2b24696f-openshift-service-ca\") pod \"maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k\" (UID: \"c495529b-1847-4e84-b91a-7fca2b24696f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:08.500748 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.500566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg2bd\" (UniqueName: \"kubernetes.io/projected/c495529b-1847-4e84-b91a-7fca2b24696f-kube-api-access-dg2bd\") pod \"maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k\" (UID: \"c495529b-1847-4e84-b91a-7fca2b24696f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:08.501222 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.501195    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c495529b-1847-4e84-b91a-7fca2b24696f-openshift-service-ca\") pod \"maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k\" (UID: \"c495529b-1847-4e84-b91a-7fca2b24696f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:08.503004 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.502980    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c495529b-1847-4e84-b91a-7fca2b24696f-maas-api-tls\") pod \"maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k\" (UID: \"c495529b-1847-4e84-b91a-7fca2b24696f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:08.514750 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.514728    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg2bd\" (UniqueName: \"kubernetes.io/projected/c495529b-1847-4e84-b91a-7fca2b24696f-kube-api-access-dg2bd\") pod \"maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k\" (UID: \"c495529b-1847-4e84-b91a-7fca2b24696f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:08.635354 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.635319    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:08.769367 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:08.769342    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"]
Jul 21 16:56:08.771506 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:56:08.771476    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc495529b_1847_4e84_b91a_7fca2b24696f.slice/crio-a7a33b8b7d954d4907056e33c80813f88dbc6b6fb445a1aa7550a681b7d7503f WatchSource:0}: Error finding container a7a33b8b7d954d4907056e33c80813f88dbc6b6fb445a1aa7550a681b7d7503f: Status 404 returned error can't find the container with id a7a33b8b7d954d4907056e33c80813f88dbc6b6fb445a1aa7550a681b7d7503f
Jul 21 16:56:09.059013 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:09.058924    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k" event={"ID":"c495529b-1847-4e84-b91a-7fca2b24696f","Type":"ContainerStarted","Data":"a7a33b8b7d954d4907056e33c80813f88dbc6b6fb445a1aa7550a681b7d7503f"}
Jul 21 16:56:10.065136 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:10.065091    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k" event={"ID":"c495529b-1847-4e84-b91a-7fca2b24696f","Type":"ContainerStarted","Data":"81c415c5d2ad6046c29e964d5ee130fa8b8da0ec3c18356711414075a28c59fd"}
Jul 21 16:56:10.065516 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:10.065192    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:10.084185 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:10.084136    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k" podStartSLOduration=0.952858983 podStartE2EDuration="2.084121424s" totalImagesPullingTime="1.131262441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:56:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:56:10.082684677 +0000 UTC m=+1949.020993122" watchObservedRunningTime="2026-07-21 16:56:10.084121424 +0000 UTC m=+1949.022429872"
Jul 21 16:56:16.075035 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:16.075007    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:43.527082 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:43.527044    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"]
Jul 21 16:56:43.527602 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:43.527342    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k" podUID="c495529b-1847-4e84-b91a-7fca2b24696f" containerName="maas-api" containerID="cri-o://81c415c5d2ad6046c29e964d5ee130fa8b8da0ec3c18356711414075a28c59fd" gracePeriod=30
Jul 21 16:56:43.774061 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:43.774035    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:43.914446 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:43.914418    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dg2bd\" (UniqueName: \"kubernetes.io/projected/c495529b-1847-4e84-b91a-7fca2b24696f-kube-api-access-dg2bd\") pod \"c495529b-1847-4e84-b91a-7fca2b24696f\" (UID: \"c495529b-1847-4e84-b91a-7fca2b24696f\") "
Jul 21 16:56:43.914615 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:43.914490    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c495529b-1847-4e84-b91a-7fca2b24696f-maas-api-tls\") pod \"c495529b-1847-4e84-b91a-7fca2b24696f\" (UID: \"c495529b-1847-4e84-b91a-7fca2b24696f\") "
Jul 21 16:56:43.914615 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:43.914540    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c495529b-1847-4e84-b91a-7fca2b24696f-openshift-service-ca\") pod \"c495529b-1847-4e84-b91a-7fca2b24696f\" (UID: \"c495529b-1847-4e84-b91a-7fca2b24696f\") "
Jul 21 16:56:43.914961 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:43.914940    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c495529b-1847-4e84-b91a-7fca2b24696f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c495529b-1847-4e84-b91a-7fca2b24696f" (UID: "c495529b-1847-4e84-b91a-7fca2b24696f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:56:43.916511 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:43.916484    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c495529b-1847-4e84-b91a-7fca2b24696f-kube-api-access-dg2bd" (OuterVolumeSpecName: "kube-api-access-dg2bd") pod "c495529b-1847-4e84-b91a-7fca2b24696f" (UID: "c495529b-1847-4e84-b91a-7fca2b24696f"). InnerVolumeSpecName "kube-api-access-dg2bd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:56:43.916616 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:43.916559    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c495529b-1847-4e84-b91a-7fca2b24696f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c495529b-1847-4e84-b91a-7fca2b24696f" (UID: "c495529b-1847-4e84-b91a-7fca2b24696f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:56:44.015903 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:44.015867    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c495529b-1847-4e84-b91a-7fca2b24696f-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:56:44.015903 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:44.015900    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dg2bd\" (UniqueName: \"kubernetes.io/projected/c495529b-1847-4e84-b91a-7fca2b24696f-kube-api-access-dg2bd\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:56:44.016069 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:44.015910    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c495529b-1847-4e84-b91a-7fca2b24696f-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:56:44.223568 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:44.223475    2578 generic.go:356] "Generic (PLEG): container finished" podID="c495529b-1847-4e84-b91a-7fca2b24696f" containerID="81c415c5d2ad6046c29e964d5ee130fa8b8da0ec3c18356711414075a28c59fd" exitCode=0
Jul 21 16:56:44.223568 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:44.223526    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"
Jul 21 16:56:44.223568 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:44.223554    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k" event={"ID":"c495529b-1847-4e84-b91a-7fca2b24696f","Type":"ContainerDied","Data":"81c415c5d2ad6046c29e964d5ee130fa8b8da0ec3c18356711414075a28c59fd"}
Jul 21 16:56:44.223861 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:44.223605    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k" event={"ID":"c495529b-1847-4e84-b91a-7fca2b24696f","Type":"ContainerDied","Data":"a7a33b8b7d954d4907056e33c80813f88dbc6b6fb445a1aa7550a681b7d7503f"}
Jul 21 16:56:44.223861 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:44.223628    2578 scope.go:117] "RemoveContainer" containerID="81c415c5d2ad6046c29e964d5ee130fa8b8da0ec3c18356711414075a28c59fd"
Jul 21 16:56:44.232662 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:44.232625    2578 scope.go:117] "RemoveContainer" containerID="81c415c5d2ad6046c29e964d5ee130fa8b8da0ec3c18356711414075a28c59fd"
Jul 21 16:56:44.232911 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:56:44.232893    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81c415c5d2ad6046c29e964d5ee130fa8b8da0ec3c18356711414075a28c59fd\": container with ID starting with 81c415c5d2ad6046c29e964d5ee130fa8b8da0ec3c18356711414075a28c59fd not found: ID does not exist" containerID="81c415c5d2ad6046c29e964d5ee130fa8b8da0ec3c18356711414075a28c59fd"
Jul 21 16:56:44.232963 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:44.232920    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81c415c5d2ad6046c29e964d5ee130fa8b8da0ec3c18356711414075a28c59fd"} err="failed to get container status \"81c415c5d2ad6046c29e964d5ee130fa8b8da0ec3c18356711414075a28c59fd\": rpc error: code = NotFound desc = could not find container \"81c415c5d2ad6046c29e964d5ee130fa8b8da0ec3c18356711414075a28c59fd\": container with ID starting with 81c415c5d2ad6046c29e964d5ee130fa8b8da0ec3c18356711414075a28c59fd not found: ID does not exist"
Jul 21 16:56:44.246580 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:44.246556    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"]
Jul 21 16:56:44.250039 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:44.250016    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bbd93f74-6549c8c4df-zxk9k"]
Jul 21 16:56:45.582001 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:45.581960    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c495529b-1847-4e84-b91a-7fca2b24696f" path="/var/lib/kubelet/pods/c495529b-1847-4e84-b91a-7fca2b24696f/volumes"
Jul 21 16:56:51.564604 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.564568    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"]
Jul 21 16:56:51.564997 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.564950    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c495529b-1847-4e84-b91a-7fca2b24696f" containerName="maas-api"
Jul 21 16:56:51.564997 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.564964    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c495529b-1847-4e84-b91a-7fca2b24696f" containerName="maas-api"
Jul 21 16:56:51.565068 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.565048    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c495529b-1847-4e84-b91a-7fca2b24696f" containerName="maas-api"
Jul 21 16:56:51.568024 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.568007    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:56:51.570718 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.570697    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-03fff7e1-serving-cert\""
Jul 21 16:56:51.587202 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.587175    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"]
Jul 21 16:56:51.684267 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.684199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c81678a-1448-4cbf-88c9-cfb648984380-openshift-service-ca\") pod \"maas-api-e2e-ait-03fff7e1-79df998cc-84zbb\" (UID: \"4c81678a-1448-4cbf-88c9-cfb648984380\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:56:51.684267 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.684246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c81678a-1448-4cbf-88c9-cfb648984380-maas-api-tls\") pod \"maas-api-e2e-ait-03fff7e1-79df998cc-84zbb\" (UID: \"4c81678a-1448-4cbf-88c9-cfb648984380\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:56:51.684511 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.684351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlf64\" (UniqueName: \"kubernetes.io/projected/4c81678a-1448-4cbf-88c9-cfb648984380-kube-api-access-xlf64\") pod \"maas-api-e2e-ait-03fff7e1-79df998cc-84zbb\" (UID: \"4c81678a-1448-4cbf-88c9-cfb648984380\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:56:51.785214 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.785180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c81678a-1448-4cbf-88c9-cfb648984380-openshift-service-ca\") pod \"maas-api-e2e-ait-03fff7e1-79df998cc-84zbb\" (UID: \"4c81678a-1448-4cbf-88c9-cfb648984380\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:56:51.785214 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.785218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c81678a-1448-4cbf-88c9-cfb648984380-maas-api-tls\") pod \"maas-api-e2e-ait-03fff7e1-79df998cc-84zbb\" (UID: \"4c81678a-1448-4cbf-88c9-cfb648984380\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:56:51.785398 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.785272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlf64\" (UniqueName: \"kubernetes.io/projected/4c81678a-1448-4cbf-88c9-cfb648984380-kube-api-access-xlf64\") pod \"maas-api-e2e-ait-03fff7e1-79df998cc-84zbb\" (UID: \"4c81678a-1448-4cbf-88c9-cfb648984380\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:56:51.785919 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.785901    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c81678a-1448-4cbf-88c9-cfb648984380-openshift-service-ca\") pod \"maas-api-e2e-ait-03fff7e1-79df998cc-84zbb\" (UID: \"4c81678a-1448-4cbf-88c9-cfb648984380\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:56:51.787714 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.787683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c81678a-1448-4cbf-88c9-cfb648984380-maas-api-tls\") pod \"maas-api-e2e-ait-03fff7e1-79df998cc-84zbb\" (UID: \"4c81678a-1448-4cbf-88c9-cfb648984380\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:56:51.798191 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.798160    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlf64\" (UniqueName: \"kubernetes.io/projected/4c81678a-1448-4cbf-88c9-cfb648984380-kube-api-access-xlf64\") pod \"maas-api-e2e-ait-03fff7e1-79df998cc-84zbb\" (UID: \"4c81678a-1448-4cbf-88c9-cfb648984380\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:56:51.878248 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:51.878226    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:56:52.007832 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:52.007807    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"]
Jul 21 16:56:52.009957 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:56:52.009926    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c81678a_1448_4cbf_88c9_cfb648984380.slice/crio-554cc47a56cc6e88856b57198c0730fb9942eb7c890d978d6f5fd80e8cd2572a WatchSource:0}: Error finding container 554cc47a56cc6e88856b57198c0730fb9942eb7c890d978d6f5fd80e8cd2572a: Status 404 returned error can't find the container with id 554cc47a56cc6e88856b57198c0730fb9942eb7c890d978d6f5fd80e8cd2572a
Jul 21 16:56:52.260594 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:52.260506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb" event={"ID":"4c81678a-1448-4cbf-88c9-cfb648984380","Type":"ContainerStarted","Data":"554cc47a56cc6e88856b57198c0730fb9942eb7c890d978d6f5fd80e8cd2572a"}
Jul 21 16:56:53.266495 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:53.266455    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb" event={"ID":"4c81678a-1448-4cbf-88c9-cfb648984380","Type":"ContainerStarted","Data":"c562d0ae6911814c6557007557b5c18941598d3df8e502a4a316139855626b96"}
Jul 21 16:56:53.266959 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:53.266599    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:56:53.292617 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:53.292568    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb" podStartSLOduration=1.877989806 podStartE2EDuration="2.292552931s" totalImagesPullingTime="414.563125ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:56:53.28969751 +0000 UTC m=+1992.228005955" watchObservedRunningTime="2026-07-21 16:56:53.292552931 +0000 UTC m=+1992.230861379"
Jul 21 16:56:59.277331 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:56:59.277299    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:57:27.404440 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:27.404396    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"]
Jul 21 16:57:27.404967 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:27.404611    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb" podUID="4c81678a-1448-4cbf-88c9-cfb648984380" containerName="maas-api" containerID="cri-o://c562d0ae6911814c6557007557b5c18941598d3df8e502a4a316139855626b96" gracePeriod=30
Jul 21 16:57:27.656397 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:27.656342    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:57:27.706719 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:27.706694    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlf64\" (UniqueName: \"kubernetes.io/projected/4c81678a-1448-4cbf-88c9-cfb648984380-kube-api-access-xlf64\") pod \"4c81678a-1448-4cbf-88c9-cfb648984380\" (UID: \"4c81678a-1448-4cbf-88c9-cfb648984380\") "
Jul 21 16:57:27.706719 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:27.706726    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c81678a-1448-4cbf-88c9-cfb648984380-maas-api-tls\") pod \"4c81678a-1448-4cbf-88c9-cfb648984380\" (UID: \"4c81678a-1448-4cbf-88c9-cfb648984380\") "
Jul 21 16:57:27.706921 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:27.706818    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c81678a-1448-4cbf-88c9-cfb648984380-openshift-service-ca\") pod \"4c81678a-1448-4cbf-88c9-cfb648984380\" (UID: \"4c81678a-1448-4cbf-88c9-cfb648984380\") "
Jul 21 16:57:27.707248 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:27.707220    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c81678a-1448-4cbf-88c9-cfb648984380-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4c81678a-1448-4cbf-88c9-cfb648984380" (UID: "4c81678a-1448-4cbf-88c9-cfb648984380"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:57:27.708829 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:27.708802    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c81678a-1448-4cbf-88c9-cfb648984380-kube-api-access-xlf64" (OuterVolumeSpecName: "kube-api-access-xlf64") pod "4c81678a-1448-4cbf-88c9-cfb648984380" (UID: "4c81678a-1448-4cbf-88c9-cfb648984380"). InnerVolumeSpecName "kube-api-access-xlf64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:57:27.708921 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:27.708856    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c81678a-1448-4cbf-88c9-cfb648984380-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4c81678a-1448-4cbf-88c9-cfb648984380" (UID: "4c81678a-1448-4cbf-88c9-cfb648984380"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:57:27.808058 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:27.808033    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c81678a-1448-4cbf-88c9-cfb648984380-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:57:27.808058 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:27.808055    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlf64\" (UniqueName: \"kubernetes.io/projected/4c81678a-1448-4cbf-88c9-cfb648984380-kube-api-access-xlf64\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:57:27.808202 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:27.808064    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c81678a-1448-4cbf-88c9-cfb648984380-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:57:28.435141 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:28.435107    2578 generic.go:356] "Generic (PLEG): container finished" podID="4c81678a-1448-4cbf-88c9-cfb648984380" containerID="c562d0ae6911814c6557007557b5c18941598d3df8e502a4a316139855626b96" exitCode=0
Jul 21 16:57:28.435628 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:28.435138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb" event={"ID":"4c81678a-1448-4cbf-88c9-cfb648984380","Type":"ContainerDied","Data":"c562d0ae6911814c6557007557b5c18941598d3df8e502a4a316139855626b96"}
Jul 21 16:57:28.435628 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:28.435167    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"
Jul 21 16:57:28.435628 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:28.435229    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb" event={"ID":"4c81678a-1448-4cbf-88c9-cfb648984380","Type":"ContainerDied","Data":"554cc47a56cc6e88856b57198c0730fb9942eb7c890d978d6f5fd80e8cd2572a"}
Jul 21 16:57:28.435628 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:28.435262    2578 scope.go:117] "RemoveContainer" containerID="c562d0ae6911814c6557007557b5c18941598d3df8e502a4a316139855626b96"
Jul 21 16:57:28.443994 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:28.443978    2578 scope.go:117] "RemoveContainer" containerID="c562d0ae6911814c6557007557b5c18941598d3df8e502a4a316139855626b96"
Jul 21 16:57:28.444220 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:57:28.444203    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c562d0ae6911814c6557007557b5c18941598d3df8e502a4a316139855626b96\": container with ID starting with c562d0ae6911814c6557007557b5c18941598d3df8e502a4a316139855626b96 not found: ID does not exist" containerID="c562d0ae6911814c6557007557b5c18941598d3df8e502a4a316139855626b96"
Jul 21 16:57:28.444272 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:28.444228    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c562d0ae6911814c6557007557b5c18941598d3df8e502a4a316139855626b96"} err="failed to get container status \"c562d0ae6911814c6557007557b5c18941598d3df8e502a4a316139855626b96\": rpc error: code = NotFound desc = could not find container \"c562d0ae6911814c6557007557b5c18941598d3df8e502a4a316139855626b96\": container with ID starting with c562d0ae6911814c6557007557b5c18941598d3df8e502a4a316139855626b96 not found: ID does not exist"
Jul 21 16:57:28.455442 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:28.455421    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"]
Jul 21 16:57:28.459339 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:28.459319    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-03fff7e1-79df998cc-84zbb"]
Jul 21 16:57:29.582588 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:29.582558    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c81678a-1448-4cbf-88c9-cfb648984380" path="/var/lib/kubelet/pods/4c81678a-1448-4cbf-88c9-cfb648984380/volumes"
Jul 21 16:57:36.602018 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.601983    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"]
Jul 21 16:57:36.602466 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.602360    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c81678a-1448-4cbf-88c9-cfb648984380" containerName="maas-api"
Jul 21 16:57:36.602466 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.602372    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c81678a-1448-4cbf-88c9-cfb648984380" containerName="maas-api"
Jul 21 16:57:36.602466 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.602445    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c81678a-1448-4cbf-88c9-cfb648984380" containerName="maas-api"
Jul 21 16:57:36.606754 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.606731    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:57:36.609213 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.609197    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f9a50ebb-serving-cert\""
Jul 21 16:57:36.614714 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.614689    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"]
Jul 21 16:57:36.693586 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.693562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1ebd56-d08c-440f-a574-b6197054cd1f-openshift-service-ca\") pod \"maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9\" (UID: \"dd1ebd56-d08c-440f-a574-b6197054cd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:57:36.693729 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.693673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlwwv\" (UniqueName: \"kubernetes.io/projected/dd1ebd56-d08c-440f-a574-b6197054cd1f-kube-api-access-hlwwv\") pod \"maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9\" (UID: \"dd1ebd56-d08c-440f-a574-b6197054cd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:57:36.693729 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.693698    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd1ebd56-d08c-440f-a574-b6197054cd1f-maas-api-tls\") pod \"maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9\" (UID: \"dd1ebd56-d08c-440f-a574-b6197054cd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:57:36.794507 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.794478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlwwv\" (UniqueName: \"kubernetes.io/projected/dd1ebd56-d08c-440f-a574-b6197054cd1f-kube-api-access-hlwwv\") pod \"maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9\" (UID: \"dd1ebd56-d08c-440f-a574-b6197054cd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:57:36.794631 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.794512    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd1ebd56-d08c-440f-a574-b6197054cd1f-maas-api-tls\") pod \"maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9\" (UID: \"dd1ebd56-d08c-440f-a574-b6197054cd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:57:36.794631 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.794540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1ebd56-d08c-440f-a574-b6197054cd1f-openshift-service-ca\") pod \"maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9\" (UID: \"dd1ebd56-d08c-440f-a574-b6197054cd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:57:36.794742 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:57:36.794670    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-serving-cert: secret "maas-api-e2e-derive-f9a50ebb-serving-cert" not found
Jul 21 16:57:36.794742 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:57:36.794739    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1ebd56-d08c-440f-a574-b6197054cd1f-maas-api-tls podName:dd1ebd56-d08c-440f-a574-b6197054cd1f nodeName:}" failed. No retries permitted until 2026-07-21 16:57:37.294719096 +0000 UTC m=+2036.233027523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dd1ebd56-d08c-440f-a574-b6197054cd1f-maas-api-tls") pod "maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9" (UID: "dd1ebd56-d08c-440f-a574-b6197054cd1f") : secret "maas-api-e2e-derive-f9a50ebb-serving-cert" not found
Jul 21 16:57:36.795120 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.795102    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1ebd56-d08c-440f-a574-b6197054cd1f-openshift-service-ca\") pod \"maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9\" (UID: \"dd1ebd56-d08c-440f-a574-b6197054cd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:57:36.806047 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:36.806022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlwwv\" (UniqueName: \"kubernetes.io/projected/dd1ebd56-d08c-440f-a574-b6197054cd1f-kube-api-access-hlwwv\") pod \"maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9\" (UID: \"dd1ebd56-d08c-440f-a574-b6197054cd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:57:37.299079 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:37.299037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd1ebd56-d08c-440f-a574-b6197054cd1f-maas-api-tls\") pod \"maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9\" (UID: \"dd1ebd56-d08c-440f-a574-b6197054cd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:57:37.301423 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:37.301396    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd1ebd56-d08c-440f-a574-b6197054cd1f-maas-api-tls\") pod \"maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9\" (UID: \"dd1ebd56-d08c-440f-a574-b6197054cd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:57:37.517412 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:37.517384    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:57:37.648756 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:37.648731    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"]
Jul 21 16:57:37.650585 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:57:37.650555    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1ebd56_d08c_440f_a574_b6197054cd1f.slice/crio-82b827b1af5862b507839faae401271c818adbd0509a46215a10e1a8b072e600 WatchSource:0}: Error finding container 82b827b1af5862b507839faae401271c818adbd0509a46215a10e1a8b072e600: Status 404 returned error can't find the container with id 82b827b1af5862b507839faae401271c818adbd0509a46215a10e1a8b072e600
Jul 21 16:57:38.485021 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:38.484984    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9" event={"ID":"dd1ebd56-d08c-440f-a574-b6197054cd1f","Type":"ContainerStarted","Data":"2842111cc9941da116388317c56b76103cf7adec800a8ea2ec33d636c95521f4"}
Jul 21 16:57:38.485222 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:38.485036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9" event={"ID":"dd1ebd56-d08c-440f-a574-b6197054cd1f","Type":"ContainerStarted","Data":"82b827b1af5862b507839faae401271c818adbd0509a46215a10e1a8b072e600"}
Jul 21 16:57:38.485222 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:38.485117    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:57:38.504289 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:38.504238    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9" podStartSLOduration=2.187778398 podStartE2EDuration="2.5042213s" totalImagesPullingTime="316.442902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:57:38.503174527 +0000 UTC m=+2037.441482977" watchObservedRunningTime="2026-07-21 16:57:38.5042213 +0000 UTC m=+2037.442529746"
Jul 21 16:57:44.494848 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:57:44.494819    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:58:11.838574 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:11.838484    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"]
Jul 21 16:58:11.839241 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:11.838744    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9" podUID="dd1ebd56-d08c-440f-a574-b6197054cd1f" containerName="maas-api" containerID="cri-o://2842111cc9941da116388317c56b76103cf7adec800a8ea2ec33d636c95521f4" gracePeriod=30
Jul 21 16:58:12.088435 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.088412    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:58:12.210345 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.210305    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd1ebd56-d08c-440f-a574-b6197054cd1f-maas-api-tls\") pod \"dd1ebd56-d08c-440f-a574-b6197054cd1f\" (UID: \"dd1ebd56-d08c-440f-a574-b6197054cd1f\") "
Jul 21 16:58:12.210544 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.210432    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlwwv\" (UniqueName: \"kubernetes.io/projected/dd1ebd56-d08c-440f-a574-b6197054cd1f-kube-api-access-hlwwv\") pod \"dd1ebd56-d08c-440f-a574-b6197054cd1f\" (UID: \"dd1ebd56-d08c-440f-a574-b6197054cd1f\") "
Jul 21 16:58:12.210544 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.210479    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1ebd56-d08c-440f-a574-b6197054cd1f-openshift-service-ca\") pod \"dd1ebd56-d08c-440f-a574-b6197054cd1f\" (UID: \"dd1ebd56-d08c-440f-a574-b6197054cd1f\") "
Jul 21 16:58:12.210900 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.210873    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd1ebd56-d08c-440f-a574-b6197054cd1f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dd1ebd56-d08c-440f-a574-b6197054cd1f" (UID: "dd1ebd56-d08c-440f-a574-b6197054cd1f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:58:12.212381 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.212360    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd1ebd56-d08c-440f-a574-b6197054cd1f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dd1ebd56-d08c-440f-a574-b6197054cd1f" (UID: "dd1ebd56-d08c-440f-a574-b6197054cd1f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:58:12.212547 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.212521    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd1ebd56-d08c-440f-a574-b6197054cd1f-kube-api-access-hlwwv" (OuterVolumeSpecName: "kube-api-access-hlwwv") pod "dd1ebd56-d08c-440f-a574-b6197054cd1f" (UID: "dd1ebd56-d08c-440f-a574-b6197054cd1f"). InnerVolumeSpecName "kube-api-access-hlwwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:58:12.312152 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.312094    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd1ebd56-d08c-440f-a574-b6197054cd1f-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:58:12.312152 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.312147    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlwwv\" (UniqueName: \"kubernetes.io/projected/dd1ebd56-d08c-440f-a574-b6197054cd1f-kube-api-access-hlwwv\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:58:12.312152 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.312164    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1ebd56-d08c-440f-a574-b6197054cd1f-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 16:58:12.648326 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.648288    2578 generic.go:356] "Generic (PLEG): container finished" podID="dd1ebd56-d08c-440f-a574-b6197054cd1f" containerID="2842111cc9941da116388317c56b76103cf7adec800a8ea2ec33d636c95521f4" exitCode=0
Jul 21 16:58:12.648518 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.648331    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"
Jul 21 16:58:12.648518 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.648375    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9" event={"ID":"dd1ebd56-d08c-440f-a574-b6197054cd1f","Type":"ContainerDied","Data":"2842111cc9941da116388317c56b76103cf7adec800a8ea2ec33d636c95521f4"}
Jul 21 16:58:12.648518 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.648423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9" event={"ID":"dd1ebd56-d08c-440f-a574-b6197054cd1f","Type":"ContainerDied","Data":"82b827b1af5862b507839faae401271c818adbd0509a46215a10e1a8b072e600"}
Jul 21 16:58:12.648518 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.648447    2578 scope.go:117] "RemoveContainer" containerID="2842111cc9941da116388317c56b76103cf7adec800a8ea2ec33d636c95521f4"
Jul 21 16:58:12.657207 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.657191    2578 scope.go:117] "RemoveContainer" containerID="2842111cc9941da116388317c56b76103cf7adec800a8ea2ec33d636c95521f4"
Jul 21 16:58:12.657453 ip-10-0-130-171 kubenswrapper[2578]: E0721 16:58:12.657433    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2842111cc9941da116388317c56b76103cf7adec800a8ea2ec33d636c95521f4\": container with ID starting with 2842111cc9941da116388317c56b76103cf7adec800a8ea2ec33d636c95521f4 not found: ID does not exist" containerID="2842111cc9941da116388317c56b76103cf7adec800a8ea2ec33d636c95521f4"
Jul 21 16:58:12.657504 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.657461    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2842111cc9941da116388317c56b76103cf7adec800a8ea2ec33d636c95521f4"} err="failed to get container status \"2842111cc9941da116388317c56b76103cf7adec800a8ea2ec33d636c95521f4\": rpc error: code = NotFound desc = could not find container \"2842111cc9941da116388317c56b76103cf7adec800a8ea2ec33d636c95521f4\": container with ID starting with 2842111cc9941da116388317c56b76103cf7adec800a8ea2ec33d636c95521f4 not found: ID does not exist"
Jul 21 16:58:12.669311 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.669285    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"]
Jul 21 16:58:12.670975 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:12.670956    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f9a50ebb-5cf7694c5d-lfxh9"]
Jul 21 16:58:13.582651 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:58:13.582603    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd1ebd56-d08c-440f-a574-b6197054cd1f" path="/var/lib/kubelet/pods/dd1ebd56-d08c-440f-a574-b6197054cd1f/volumes"
Jul 21 16:59:59.184521 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.184479    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"]
Jul 21 16:59:59.185124 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.185094    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd1ebd56-d08c-440f-a574-b6197054cd1f" containerName="maas-api"
Jul 21 16:59:59.185124 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.185115    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd1ebd56-d08c-440f-a574-b6197054cd1f" containerName="maas-api"
Jul 21 16:59:59.185250 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.185206    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd1ebd56-d08c-440f-a574-b6197054cd1f" containerName="maas-api"
Jul 21 16:59:59.188178 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.188156    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 16:59:59.190391 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.190370    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-374c7b92-serving-cert\""
Jul 21 16:59:59.199260 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.199239    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"]
Jul 21 16:59:59.278843 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.278815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-maas-api-tls\") pod \"maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz\" (UID: \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 16:59:59.278978 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.278863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-openshift-service-ca\") pod \"maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz\" (UID: \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 16:59:59.278978 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.278941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtpf9\" (UniqueName: \"kubernetes.io/projected/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-kube-api-access-rtpf9\") pod \"maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz\" (UID: \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 16:59:59.380419 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.380384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtpf9\" (UniqueName: \"kubernetes.io/projected/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-kube-api-access-rtpf9\") pod \"maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz\" (UID: \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 16:59:59.380583 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.380433    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-maas-api-tls\") pod \"maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz\" (UID: \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 16:59:59.380583 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.380476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-openshift-service-ca\") pod \"maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz\" (UID: \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 16:59:59.381241 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.381216    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-openshift-service-ca\") pod \"maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz\" (UID: \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 16:59:59.382913 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.382887    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-maas-api-tls\") pod \"maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz\" (UID: \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 16:59:59.398455 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.398433    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtpf9\" (UniqueName: \"kubernetes.io/projected/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-kube-api-access-rtpf9\") pod \"maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz\" (UID: \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 16:59:59.499136 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.499036    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 16:59:59.633113 ip-10-0-130-171 kubenswrapper[2578]: I0721 16:59:59.633077    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"]
Jul 21 16:59:59.636130 ip-10-0-130-171 kubenswrapper[2578]: W0721 16:59:59.636103    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b806a8_1fa2_4e01_9f01_5b49bf0fdd9a.slice/crio-f8e05ec3f1dd043aeef969f7d1a36191222be78be133f3d04113c92c6d3ec945 WatchSource:0}: Error finding container f8e05ec3f1dd043aeef969f7d1a36191222be78be133f3d04113c92c6d3ec945: Status 404 returned error can't find the container with id f8e05ec3f1dd043aeef969f7d1a36191222be78be133f3d04113c92c6d3ec945
Jul 21 17:00:00.135142 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:00.135102    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744220-mqfgd"]
Jul 21 17:00:00.139839 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:00.139820    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744220-mqfgd"
Jul 21 17:00:00.143998 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:00.143968    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 17:00:00.146904 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:00.146847    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744220-mqfgd"]
Jul 21 17:00:00.151301 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:00.151280    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744220-mqfgd"
Jul 21 17:00:00.159907 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:00.159880    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz" event={"ID":"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a","Type":"ContainerStarted","Data":"f8e05ec3f1dd043aeef969f7d1a36191222be78be133f3d04113c92c6d3ec945"}
Jul 21 17:00:00.278375 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:00.278336    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744220-mqfgd"]
Jul 21 17:00:00.280610 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:00:00.280577    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod135cd884_970a_428f_a0d9_07a5eb7fd0b9.slice/crio-273b6355db68aa11d6d7cf1fbed9e8a3d798322a300e3116375069ed6795dc89 WatchSource:0}: Error finding container 273b6355db68aa11d6d7cf1fbed9e8a3d798322a300e3116375069ed6795dc89: Status 404 returned error can't find the container with id 273b6355db68aa11d6d7cf1fbed9e8a3d798322a300e3116375069ed6795dc89
Jul 21 17:00:01.167403 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:01.167357    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz" event={"ID":"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a","Type":"ContainerStarted","Data":"d214b22e6789ef6cea83b10f8df0417896c439d5aed9495de6c0ee6c667f2d79"}
Jul 21 17:00:01.167600 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:01.167494    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 17:00:01.168596 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:01.168571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744220-mqfgd" event={"ID":"135cd884-970a-428f-a0d9-07a5eb7fd0b9","Type":"ContainerStarted","Data":"273b6355db68aa11d6d7cf1fbed9e8a3d798322a300e3116375069ed6795dc89"}
Jul 21 17:00:01.187771 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:01.187727    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz" podStartSLOduration=1.474864466 podStartE2EDuration="2.187713495s" totalImagesPullingTime="712.849029ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:00:01.186133502 +0000 UTC m=+2180.124441974" watchObservedRunningTime="2026-07-21 17:00:01.187713495 +0000 UTC m=+2180.126021944"
Jul 21 17:00:05.190233 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:05.190134    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744220-mqfgd" event={"ID":"135cd884-970a-428f-a0d9-07a5eb7fd0b9","Type":"ContainerStarted","Data":"53ec1046b5d664f938571549ba6c6eb23bb7121b8fb7739b533c95d187b340d6"}
Jul 21 17:00:05.206922 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:05.206866    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744220-mqfgd" podStartSLOduration=0.865933477 podStartE2EDuration="5.206851366s" totalImagesPullingTime="4.340917889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:00:05.205924693 +0000 UTC m=+2184.144233146" watchObservedRunningTime="2026-07-21 17:00:05.206851366 +0000 UTC m=+2184.145159813"
Jul 21 17:00:06.196578 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:06.196542    2578 generic.go:356] "Generic (PLEG): container finished" podID="135cd884-970a-428f-a0d9-07a5eb7fd0b9" containerID="53ec1046b5d664f938571549ba6c6eb23bb7121b8fb7739b533c95d187b340d6" exitCode=0
Jul 21 17:00:06.196988 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:06.196613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744220-mqfgd" event={"ID":"135cd884-970a-428f-a0d9-07a5eb7fd0b9","Type":"ContainerDied","Data":"53ec1046b5d664f938571549ba6c6eb23bb7121b8fb7739b533c95d187b340d6"}
Jul 21 17:00:07.178896 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:07.178870    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 17:00:07.330256 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:07.330229    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744220-mqfgd"
Jul 21 17:00:08.209259 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:08.209226    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744220-mqfgd" event={"ID":"135cd884-970a-428f-a0d9-07a5eb7fd0b9","Type":"ContainerDied","Data":"273b6355db68aa11d6d7cf1fbed9e8a3d798322a300e3116375069ed6795dc89"}
Jul 21 17:00:08.209259 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:08.209257    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744220-mqfgd"
Jul 21 17:00:08.209484 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:08.209274    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="273b6355db68aa11d6d7cf1fbed9e8a3d798322a300e3116375069ed6795dc89"
Jul 21 17:00:11.098378 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:11.098338    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz"]
Jul 21 17:00:11.098789 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:11.098730    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="135cd884-970a-428f-a0d9-07a5eb7fd0b9" containerName="cleanup"
Jul 21 17:00:11.098789 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:11.098741    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="135cd884-970a-428f-a0d9-07a5eb7fd0b9" containerName="cleanup"
Jul 21 17:00:11.098863 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:11.098812    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="135cd884-970a-428f-a0d9-07a5eb7fd0b9" containerName="cleanup"
Jul 21 17:00:11.101942 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:11.101926    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz"
Jul 21 17:00:11.104338 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:11.104315    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 17:00:11.109763 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:11.109203    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz"]
Jul 21 17:00:11.185706 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:11.185663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-374c7b92-kxffz\" (UID: \"bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz"
Jul 21 17:00:11.286755 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:11.286714    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-374c7b92-kxffz\" (UID: \"bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz"
Jul 21 17:00:11.287323 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:11.287301    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-374c7b92-kxffz\" (UID: \"bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz"
Jul 21 17:00:11.414082 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:11.413999    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz"
Jul 21 17:00:11.542854 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:11.542793    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz"]
Jul 21 17:00:11.545824 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:00:11.545796    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfcabe07_6206_42b7_bf9e_2e2da9ffb9e0.slice/crio-43f2020b9b0d176b6187420306eecaf5eb196d38db276cac9135259d68f98ce5 WatchSource:0}: Error finding container 43f2020b9b0d176b6187420306eecaf5eb196d38db276cac9135259d68f98ce5: Status 404 returned error can't find the container with id 43f2020b9b0d176b6187420306eecaf5eb196d38db276cac9135259d68f98ce5
Jul 21 17:00:12.230115 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:12.230081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz" event={"ID":"bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0","Type":"ContainerStarted","Data":"60d1a317008d1d00569432cb64e8b833ae97043cefdbe7d54efb376c0225a02f"}
Jul 21 17:00:12.230460 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:12.230136    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz" event={"ID":"bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0","Type":"ContainerStarted","Data":"43f2020b9b0d176b6187420306eecaf5eb196d38db276cac9135259d68f98ce5"}
Jul 21 17:00:12.247020 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:12.246976    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz" podStartSLOduration=1.246960711 podStartE2EDuration="1.246960711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:00:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:00:12.244888538 +0000 UTC m=+2191.183196990" watchObservedRunningTime="2026-07-21 17:00:12.246960711 +0000 UTC m=+2191.185269158"
Jul 21 17:00:13.236206 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:13.236171    2578 generic.go:356] "Generic (PLEG): container finished" podID="bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0" containerID="60d1a317008d1d00569432cb64e8b833ae97043cefdbe7d54efb376c0225a02f" exitCode=0
Jul 21 17:00:13.236580 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:13.236260    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz" event={"ID":"bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0","Type":"ContainerDied","Data":"60d1a317008d1d00569432cb64e8b833ae97043cefdbe7d54efb376c0225a02f"}
Jul 21 17:00:14.377582 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:14.377557    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz"
Jul 21 17:00:14.516117 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:14.516015    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0-maas-api-service-ca\") pod \"bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0\" (UID: \"bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0\") "
Jul 21 17:00:14.516420 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:14.516393    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0" (UID: "bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:00:14.616987 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:14.616956    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0-maas-api-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:00:15.246764 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:15.246729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz" event={"ID":"bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0","Type":"ContainerDied","Data":"43f2020b9b0d176b6187420306eecaf5eb196d38db276cac9135259d68f98ce5"}
Jul 21 17:00:15.246981 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:15.246786    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43f2020b9b0d176b6187420306eecaf5eb196d38db276cac9135259d68f98ce5"
Jul 21 17:00:15.246981 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:15.246738    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz"
Jul 21 17:00:21.520140 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:21.520109    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"]
Jul 21 17:00:21.520594 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:21.520318    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz" podUID="43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a" containerName="maas-api" containerID="cri-o://d214b22e6789ef6cea83b10f8df0417896c439d5aed9495de6c0ee6c667f2d79" gracePeriod=30
Jul 21 17:00:21.776213 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:21.776159    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 17:00:21.882921 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:21.882892    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtpf9\" (UniqueName: \"kubernetes.io/projected/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-kube-api-access-rtpf9\") pod \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\" (UID: \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\") "
Jul 21 17:00:21.883089 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:21.882943    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-maas-api-tls\") pod \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\" (UID: \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\") "
Jul 21 17:00:21.883089 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:21.882988    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-openshift-service-ca\") pod \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\" (UID: \"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a\") "
Jul 21 17:00:21.883389 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:21.883364    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a" (UID: "43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:00:21.884806 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:21.884782    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-kube-api-access-rtpf9" (OuterVolumeSpecName: "kube-api-access-rtpf9") pod "43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a" (UID: "43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a"). InnerVolumeSpecName "kube-api-access-rtpf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:00:21.884940 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:21.884924    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a" (UID: "43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:00:21.984539 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:21.984514    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:00:21.984539 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:21.984535    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtpf9\" (UniqueName: \"kubernetes.io/projected/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-kube-api-access-rtpf9\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:00:21.984693 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:21.984545    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:00:22.281481 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:22.281445    2578 generic.go:356] "Generic (PLEG): container finished" podID="43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a" containerID="d214b22e6789ef6cea83b10f8df0417896c439d5aed9495de6c0ee6c667f2d79" exitCode=0
Jul 21 17:00:22.281681 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:22.281492    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"
Jul 21 17:00:22.281681 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:22.281531    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz" event={"ID":"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a","Type":"ContainerDied","Data":"d214b22e6789ef6cea83b10f8df0417896c439d5aed9495de6c0ee6c667f2d79"}
Jul 21 17:00:22.281681 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:22.281587    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz" event={"ID":"43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a","Type":"ContainerDied","Data":"f8e05ec3f1dd043aeef969f7d1a36191222be78be133f3d04113c92c6d3ec945"}
Jul 21 17:00:22.281681 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:22.281611    2578 scope.go:117] "RemoveContainer" containerID="d214b22e6789ef6cea83b10f8df0417896c439d5aed9495de6c0ee6c667f2d79"
Jul 21 17:00:22.290837 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:22.290821    2578 scope.go:117] "RemoveContainer" containerID="d214b22e6789ef6cea83b10f8df0417896c439d5aed9495de6c0ee6c667f2d79"
Jul 21 17:00:22.291066 ip-10-0-130-171 kubenswrapper[2578]: E0721 17:00:22.291052    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d214b22e6789ef6cea83b10f8df0417896c439d5aed9495de6c0ee6c667f2d79\": container with ID starting with d214b22e6789ef6cea83b10f8df0417896c439d5aed9495de6c0ee6c667f2d79 not found: ID does not exist" containerID="d214b22e6789ef6cea83b10f8df0417896c439d5aed9495de6c0ee6c667f2d79"
Jul 21 17:00:22.291112 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:22.291073    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d214b22e6789ef6cea83b10f8df0417896c439d5aed9495de6c0ee6c667f2d79"} err="failed to get container status \"d214b22e6789ef6cea83b10f8df0417896c439d5aed9495de6c0ee6c667f2d79\": rpc error: code = NotFound desc = could not find container \"d214b22e6789ef6cea83b10f8df0417896c439d5aed9495de6c0ee6c667f2d79\": container with ID starting with d214b22e6789ef6cea83b10f8df0417896c439d5aed9495de6c0ee6c667f2d79 not found: ID does not exist"
Jul 21 17:00:22.303743 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:22.303720    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"]
Jul 21 17:00:22.307943 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:22.307922    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-374c7b92-59fcb9fc89-g6rhz"]
Jul 21 17:00:23.582298 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:23.582265    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a" path="/var/lib/kubelet/pods/43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a/volumes"
Jul 21 17:00:26.174246 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:26.174208    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz"]
Jul 21 17:00:26.179082 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:26.179042    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-374c7b92-kxffz"]
Jul 21 17:00:27.583303 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:27.583265    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0" path="/var/lib/kubelet/pods/bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0/volumes"
Jul 21 17:00:55.384810 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.384775    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"]
Jul 21 17:00:55.385405 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.385388    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a" containerName="maas-api"
Jul 21 17:00:55.385456 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.385408    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a" containerName="maas-api"
Jul 21 17:00:55.385456 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.385422    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0" containerName="revoke-keys"
Jul 21 17:00:55.385456 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.385430    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0" containerName="revoke-keys"
Jul 21 17:00:55.385579 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.385525    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfcabe07-6206-42b7-bf9e-2e2da9ffb9e0" containerName="revoke-keys"
Jul 21 17:00:55.385579 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.385543    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="43b806a8-1fa2-4e01-9f01-5b49bf0fdd9a" containerName="maas-api"
Jul 21 17:00:55.388620 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.388604    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:00:55.391355 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.391336    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-650aed9b-serving-cert\""
Jul 21 17:00:55.399613 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.399589    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"]
Jul 21 17:00:55.486834 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.486800    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp9wg\" (UniqueName: \"kubernetes.io/projected/6f4a7811-8471-406b-bacd-547139691d66-kube-api-access-kp9wg\") pod \"maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j\" (UID: \"6f4a7811-8471-406b-bacd-547139691d66\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:00:55.487005 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.486888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4a7811-8471-406b-bacd-547139691d66-maas-api-tls\") pod \"maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j\" (UID: \"6f4a7811-8471-406b-bacd-547139691d66\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:00:55.487005 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.486953    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4a7811-8471-406b-bacd-547139691d66-openshift-service-ca\") pod \"maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j\" (UID: \"6f4a7811-8471-406b-bacd-547139691d66\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:00:55.587744 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.587713    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4a7811-8471-406b-bacd-547139691d66-maas-api-tls\") pod \"maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j\" (UID: \"6f4a7811-8471-406b-bacd-547139691d66\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:00:55.587901 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.587778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4a7811-8471-406b-bacd-547139691d66-openshift-service-ca\") pod \"maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j\" (UID: \"6f4a7811-8471-406b-bacd-547139691d66\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:00:55.587901 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.587807    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp9wg\" (UniqueName: \"kubernetes.io/projected/6f4a7811-8471-406b-bacd-547139691d66-kube-api-access-kp9wg\") pod \"maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j\" (UID: \"6f4a7811-8471-406b-bacd-547139691d66\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:00:55.588416 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.588391    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4a7811-8471-406b-bacd-547139691d66-openshift-service-ca\") pod \"maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j\" (UID: \"6f4a7811-8471-406b-bacd-547139691d66\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:00:55.590060 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.590032    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4a7811-8471-406b-bacd-547139691d66-maas-api-tls\") pod \"maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j\" (UID: \"6f4a7811-8471-406b-bacd-547139691d66\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:00:55.601283 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.601261    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp9wg\" (UniqueName: \"kubernetes.io/projected/6f4a7811-8471-406b-bacd-547139691d66-kube-api-access-kp9wg\") pod \"maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j\" (UID: \"6f4a7811-8471-406b-bacd-547139691d66\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:00:55.699772 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.699717    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:00:55.830537 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.830512    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"]
Jul 21 17:00:55.832669 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:00:55.832619    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4a7811_8471_406b_bacd_547139691d66.slice/crio-ebe42a5618b295a4493de0d1edc9cadfae56fcfb6bd7132b6e372d269eee1d06 WatchSource:0}: Error finding container ebe42a5618b295a4493de0d1edc9cadfae56fcfb6bd7132b6e372d269eee1d06: Status 404 returned error can't find the container with id ebe42a5618b295a4493de0d1edc9cadfae56fcfb6bd7132b6e372d269eee1d06
Jul 21 17:00:55.833963 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:55.833942    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:00:56.451217 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:56.451174    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j" event={"ID":"6f4a7811-8471-406b-bacd-547139691d66","Type":"ContainerStarted","Data":"ebe42a5618b295a4493de0d1edc9cadfae56fcfb6bd7132b6e372d269eee1d06"}
Jul 21 17:00:57.457330 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:57.457287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j" event={"ID":"6f4a7811-8471-406b-bacd-547139691d66","Type":"ContainerStarted","Data":"9fe7e7771a1e3cdc21cba4f78e027f18abd9ec48e8670d634e1f555f51f9651c"}
Jul 21 17:00:57.457741 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:57.457351    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:00:57.476223 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:00:57.476174    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j" podStartSLOduration=1.594188161 podStartE2EDuration="2.476158042s" totalImagesPullingTime="881.969881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:00:57.473455836 +0000 UTC m=+2236.411764283" watchObservedRunningTime="2026-07-21 17:00:57.476158042 +0000 UTC m=+2236.414466491"
Jul 21 17:01:03.468280 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:03.468249    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:01:33.277346 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:33.277312    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j"]
Jul 21 17:01:33.280903 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:33.280884    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j"
Jul 21 17:01:33.285474 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:33.285448    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 17:01:33.287663 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:33.287618    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j"]
Jul 21 17:01:33.328038 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:33.327998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82d6cf8a-7040-4c63-9953-4b9c01f07ddd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-650aed9b-5x52j\" (UID: \"82d6cf8a-7040-4c63-9953-4b9c01f07ddd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j"
Jul 21 17:01:33.429316 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:33.429277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82d6cf8a-7040-4c63-9953-4b9c01f07ddd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-650aed9b-5x52j\" (UID: \"82d6cf8a-7040-4c63-9953-4b9c01f07ddd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j"
Jul 21 17:01:33.429942 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:33.429921    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82d6cf8a-7040-4c63-9953-4b9c01f07ddd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-650aed9b-5x52j\" (UID: \"82d6cf8a-7040-4c63-9953-4b9c01f07ddd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j"
Jul 21 17:01:33.592505 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:33.592419    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j"
Jul 21 17:01:33.727287 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:33.727258    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j"]
Jul 21 17:01:33.728212 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:01:33.728189    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82d6cf8a_7040_4c63_9953_4b9c01f07ddd.slice/crio-f9f0b36f0de5a0d9271c2e536064c02c486c9f077ee6270db52eb2b5cdb2a1ad WatchSource:0}: Error finding container f9f0b36f0de5a0d9271c2e536064c02c486c9f077ee6270db52eb2b5cdb2a1ad: Status 404 returned error can't find the container with id f9f0b36f0de5a0d9271c2e536064c02c486c9f077ee6270db52eb2b5cdb2a1ad
Jul 21 17:01:34.635897 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:34.635860    2578 generic.go:356] "Generic (PLEG): container finished" podID="82d6cf8a-7040-4c63-9953-4b9c01f07ddd" containerID="5bb3056e5b0681839067bb3633915a2f6ed8b10e0d375c6d6345a20fe380cc0e" exitCode=0
Jul 21 17:01:34.636299 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:34.635942    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j" event={"ID":"82d6cf8a-7040-4c63-9953-4b9c01f07ddd","Type":"ContainerDied","Data":"5bb3056e5b0681839067bb3633915a2f6ed8b10e0d375c6d6345a20fe380cc0e"}
Jul 21 17:01:34.636299 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:34.635999    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j" event={"ID":"82d6cf8a-7040-4c63-9953-4b9c01f07ddd","Type":"ContainerStarted","Data":"f9f0b36f0de5a0d9271c2e536064c02c486c9f077ee6270db52eb2b5cdb2a1ad"}
Jul 21 17:01:35.767927 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:35.767905    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j"
Jul 21 17:01:35.854608 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:35.854575    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82d6cf8a-7040-4c63-9953-4b9c01f07ddd-maas-api-service-ca\") pod \"82d6cf8a-7040-4c63-9953-4b9c01f07ddd\" (UID: \"82d6cf8a-7040-4c63-9953-4b9c01f07ddd\") "
Jul 21 17:01:35.854942 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:35.854921    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82d6cf8a-7040-4c63-9953-4b9c01f07ddd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "82d6cf8a-7040-4c63-9953-4b9c01f07ddd" (UID: "82d6cf8a-7040-4c63-9953-4b9c01f07ddd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:01:35.955658 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:35.955541    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82d6cf8a-7040-4c63-9953-4b9c01f07ddd-maas-api-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:01:36.646113 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:36.646082    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j"
Jul 21 17:01:36.646306 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:36.646109    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j" event={"ID":"82d6cf8a-7040-4c63-9953-4b9c01f07ddd","Type":"ContainerDied","Data":"f9f0b36f0de5a0d9271c2e536064c02c486c9f077ee6270db52eb2b5cdb2a1ad"}
Jul 21 17:01:36.646306 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:36.646157    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9f0b36f0de5a0d9271c2e536064c02c486c9f077ee6270db52eb2b5cdb2a1ad"
Jul 21 17:01:48.997173 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:48.997135    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"]
Jul 21 17:01:48.997600 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:48.997343    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j" podUID="6f4a7811-8471-406b-bacd-547139691d66" containerName="maas-api" containerID="cri-o://9fe7e7771a1e3cdc21cba4f78e027f18abd9ec48e8670d634e1f555f51f9651c" gracePeriod=30
Jul 21 17:01:49.248960 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.248901    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:01:49.374462 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.374425    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp9wg\" (UniqueName: \"kubernetes.io/projected/6f4a7811-8471-406b-bacd-547139691d66-kube-api-access-kp9wg\") pod \"6f4a7811-8471-406b-bacd-547139691d66\" (UID: \"6f4a7811-8471-406b-bacd-547139691d66\") "
Jul 21 17:01:49.374696 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.374490    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4a7811-8471-406b-bacd-547139691d66-openshift-service-ca\") pod \"6f4a7811-8471-406b-bacd-547139691d66\" (UID: \"6f4a7811-8471-406b-bacd-547139691d66\") "
Jul 21 17:01:49.374696 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.374514    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4a7811-8471-406b-bacd-547139691d66-maas-api-tls\") pod \"6f4a7811-8471-406b-bacd-547139691d66\" (UID: \"6f4a7811-8471-406b-bacd-547139691d66\") "
Jul 21 17:01:49.374919 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.374890    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f4a7811-8471-406b-bacd-547139691d66-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6f4a7811-8471-406b-bacd-547139691d66" (UID: "6f4a7811-8471-406b-bacd-547139691d66"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:01:49.376631 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.376606    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f4a7811-8471-406b-bacd-547139691d66-kube-api-access-kp9wg" (OuterVolumeSpecName: "kube-api-access-kp9wg") pod "6f4a7811-8471-406b-bacd-547139691d66" (UID: "6f4a7811-8471-406b-bacd-547139691d66"). InnerVolumeSpecName "kube-api-access-kp9wg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:01:49.376631 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.376630    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f4a7811-8471-406b-bacd-547139691d66-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6f4a7811-8471-406b-bacd-547139691d66" (UID: "6f4a7811-8471-406b-bacd-547139691d66"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:01:49.476055 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.476018    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp9wg\" (UniqueName: \"kubernetes.io/projected/6f4a7811-8471-406b-bacd-547139691d66-kube-api-access-kp9wg\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:01:49.476055 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.476049    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4a7811-8471-406b-bacd-547139691d66-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:01:49.476055 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.476060    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4a7811-8471-406b-bacd-547139691d66-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:01:49.708537 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.708496    2578 generic.go:356] "Generic (PLEG): container finished" podID="6f4a7811-8471-406b-bacd-547139691d66" containerID="9fe7e7771a1e3cdc21cba4f78e027f18abd9ec48e8670d634e1f555f51f9651c" exitCode=0
Jul 21 17:01:49.708799 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.708550    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"
Jul 21 17:01:49.708799 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.708589    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j" event={"ID":"6f4a7811-8471-406b-bacd-547139691d66","Type":"ContainerDied","Data":"9fe7e7771a1e3cdc21cba4f78e027f18abd9ec48e8670d634e1f555f51f9651c"}
Jul 21 17:01:49.708799 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.708675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j" event={"ID":"6f4a7811-8471-406b-bacd-547139691d66","Type":"ContainerDied","Data":"ebe42a5618b295a4493de0d1edc9cadfae56fcfb6bd7132b6e372d269eee1d06"}
Jul 21 17:01:49.708799 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.708710    2578 scope.go:117] "RemoveContainer" containerID="9fe7e7771a1e3cdc21cba4f78e027f18abd9ec48e8670d634e1f555f51f9651c"
Jul 21 17:01:49.718105 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.718085    2578 scope.go:117] "RemoveContainer" containerID="9fe7e7771a1e3cdc21cba4f78e027f18abd9ec48e8670d634e1f555f51f9651c"
Jul 21 17:01:49.718424 ip-10-0-130-171 kubenswrapper[2578]: E0721 17:01:49.718404    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fe7e7771a1e3cdc21cba4f78e027f18abd9ec48e8670d634e1f555f51f9651c\": container with ID starting with 9fe7e7771a1e3cdc21cba4f78e027f18abd9ec48e8670d634e1f555f51f9651c not found: ID does not exist" containerID="9fe7e7771a1e3cdc21cba4f78e027f18abd9ec48e8670d634e1f555f51f9651c"
Jul 21 17:01:49.718479 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.718434    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe7e7771a1e3cdc21cba4f78e027f18abd9ec48e8670d634e1f555f51f9651c"} err="failed to get container status \"9fe7e7771a1e3cdc21cba4f78e027f18abd9ec48e8670d634e1f555f51f9651c\": rpc error: code = NotFound desc = could not find container \"9fe7e7771a1e3cdc21cba4f78e027f18abd9ec48e8670d634e1f555f51f9651c\": container with ID starting with 9fe7e7771a1e3cdc21cba4f78e027f18abd9ec48e8670d634e1f555f51f9651c not found: ID does not exist"
Jul 21 17:01:49.728069 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.728032    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"]
Jul 21 17:01:49.733078 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:49.733045    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-650aed9b-8cf56c9d8-6bm6j"]
Jul 21 17:01:51.582786 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:51.582753    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f4a7811-8471-406b-bacd-547139691d66" path="/var/lib/kubelet/pods/6f4a7811-8471-406b-bacd-547139691d66/volumes"
Jul 21 17:01:53.387155 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:53.387107    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j"]
Jul 21 17:01:53.390283 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:53.390245    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-650aed9b-5x52j"]
Jul 21 17:01:53.583086 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:01:53.583048    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82d6cf8a-7040-4c63-9953-4b9c01f07ddd" path="/var/lib/kubelet/pods/82d6cf8a-7040-4c63-9953-4b9c01f07ddd/volumes"
Jul 21 17:03:44.463297 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.463266    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"]
Jul 21 17:03:44.463801 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.463678    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82d6cf8a-7040-4c63-9953-4b9c01f07ddd" containerName="revoke-keys"
Jul 21 17:03:44.463801 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.463691    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="82d6cf8a-7040-4c63-9953-4b9c01f07ddd" containerName="revoke-keys"
Jul 21 17:03:44.463801 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.463718    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f4a7811-8471-406b-bacd-547139691d66" containerName="maas-api"
Jul 21 17:03:44.463801 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.463724    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f4a7811-8471-406b-bacd-547139691d66" containerName="maas-api"
Jul 21 17:03:44.463801 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.463782    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="82d6cf8a-7040-4c63-9953-4b9c01f07ddd" containerName="revoke-keys"
Jul 21 17:03:44.463801 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.463790    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f4a7811-8471-406b-bacd-547139691d66" containerName="maas-api"
Jul 21 17:03:44.466879 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.466859    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:03:44.469994 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.469968    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-2c9f37-serving-cert\""
Jul 21 17:03:44.478942 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.478911    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"]
Jul 21 17:03:44.552451 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.552417    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de99e27b-591b-4334-85cc-8e0fb19973b1-maas-api-tls\") pod \"maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v\" (UID: \"de99e27b-591b-4334-85cc-8e0fb19973b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:03:44.552654 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.552481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de99e27b-591b-4334-85cc-8e0fb19973b1-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v\" (UID: \"de99e27b-591b-4334-85cc-8e0fb19973b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:03:44.552654 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.552583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z9hw\" (UniqueName: \"kubernetes.io/projected/de99e27b-591b-4334-85cc-8e0fb19973b1-kube-api-access-4z9hw\") pod \"maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v\" (UID: \"de99e27b-591b-4334-85cc-8e0fb19973b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:03:44.653598 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.653557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de99e27b-591b-4334-85cc-8e0fb19973b1-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v\" (UID: \"de99e27b-591b-4334-85cc-8e0fb19973b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:03:44.653816 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.653621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z9hw\" (UniqueName: \"kubernetes.io/projected/de99e27b-591b-4334-85cc-8e0fb19973b1-kube-api-access-4z9hw\") pod \"maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v\" (UID: \"de99e27b-591b-4334-85cc-8e0fb19973b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:03:44.653816 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.653698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de99e27b-591b-4334-85cc-8e0fb19973b1-maas-api-tls\") pod \"maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v\" (UID: \"de99e27b-591b-4334-85cc-8e0fb19973b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:03:44.654329 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.654305    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de99e27b-591b-4334-85cc-8e0fb19973b1-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v\" (UID: \"de99e27b-591b-4334-85cc-8e0fb19973b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:03:44.656169 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.656148    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de99e27b-591b-4334-85cc-8e0fb19973b1-maas-api-tls\") pod \"maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v\" (UID: \"de99e27b-591b-4334-85cc-8e0fb19973b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:03:44.665420 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.665397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z9hw\" (UniqueName: \"kubernetes.io/projected/de99e27b-591b-4334-85cc-8e0fb19973b1-kube-api-access-4z9hw\") pod \"maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v\" (UID: \"de99e27b-591b-4334-85cc-8e0fb19973b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:03:44.778156 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.778057    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:03:44.926123 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:44.926097    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"]
Jul 21 17:03:44.928559 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:03:44.928528    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde99e27b_591b_4334_85cc_8e0fb19973b1.slice/crio-420eff283f6889a879df1bc79a215018adb2a91e6451469460df342fec80868a WatchSource:0}: Error finding container 420eff283f6889a879df1bc79a215018adb2a91e6451469460df342fec80868a: Status 404 returned error can't find the container with id 420eff283f6889a879df1bc79a215018adb2a91e6451469460df342fec80868a
Jul 21 17:03:45.278874 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:45.278836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v" event={"ID":"de99e27b-591b-4334-85cc-8e0fb19973b1","Type":"ContainerStarted","Data":"420eff283f6889a879df1bc79a215018adb2a91e6451469460df342fec80868a"}
Jul 21 17:03:46.285341 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:46.285304    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v" event={"ID":"de99e27b-591b-4334-85cc-8e0fb19973b1","Type":"ContainerStarted","Data":"3a75b10e5fe3fb9de225f6b130e75310bc8abc58c098c616e05978969b7476b7"}
Jul 21 17:03:46.285767 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:46.285436    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:03:46.304015 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:46.303921    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v" podStartSLOduration=1.183943078 podStartE2EDuration="2.303904678s" totalImagesPullingTime="1.1199616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:46.302334438 +0000 UTC m=+2405.240642887" watchObservedRunningTime="2026-07-21 17:03:46.303904678 +0000 UTC m=+2405.242213130"
Jul 21 17:03:52.295288 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:52.295252    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:03:52.718315 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:52.718275    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"]
Jul 21 17:03:52.721885 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:52.721861    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:03:52.724742 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:52.724713    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-8756ef-serving-cert\""
Jul 21 17:03:52.738393 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:52.738366    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"]
Jul 21 17:03:52.835158 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:52.835120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7jkg\" (UniqueName: \"kubernetes.io/projected/95436c46-4170-4fa7-98fb-96592f959f2d-kube-api-access-q7jkg\") pod \"maas-api-e2e-inf-b-8756ef-64488868db-2mggp\" (UID: \"95436c46-4170-4fa7-98fb-96592f959f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:03:52.835348 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:52.835247    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95436c46-4170-4fa7-98fb-96592f959f2d-maas-api-tls\") pod \"maas-api-e2e-inf-b-8756ef-64488868db-2mggp\" (UID: \"95436c46-4170-4fa7-98fb-96592f959f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:03:52.835348 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:52.835276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95436c46-4170-4fa7-98fb-96592f959f2d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8756ef-64488868db-2mggp\" (UID: \"95436c46-4170-4fa7-98fb-96592f959f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:03:52.936251 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:52.936215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7jkg\" (UniqueName: \"kubernetes.io/projected/95436c46-4170-4fa7-98fb-96592f959f2d-kube-api-access-q7jkg\") pod \"maas-api-e2e-inf-b-8756ef-64488868db-2mggp\" (UID: \"95436c46-4170-4fa7-98fb-96592f959f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:03:52.936434 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:52.936304    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95436c46-4170-4fa7-98fb-96592f959f2d-maas-api-tls\") pod \"maas-api-e2e-inf-b-8756ef-64488868db-2mggp\" (UID: \"95436c46-4170-4fa7-98fb-96592f959f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:03:52.936434 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:52.936325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95436c46-4170-4fa7-98fb-96592f959f2d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8756ef-64488868db-2mggp\" (UID: \"95436c46-4170-4fa7-98fb-96592f959f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:03:52.936969 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:52.936949    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95436c46-4170-4fa7-98fb-96592f959f2d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8756ef-64488868db-2mggp\" (UID: \"95436c46-4170-4fa7-98fb-96592f959f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:03:52.938923 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:52.938900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95436c46-4170-4fa7-98fb-96592f959f2d-maas-api-tls\") pod \"maas-api-e2e-inf-b-8756ef-64488868db-2mggp\" (UID: \"95436c46-4170-4fa7-98fb-96592f959f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:03:52.963271 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:52.963235    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7jkg\" (UniqueName: \"kubernetes.io/projected/95436c46-4170-4fa7-98fb-96592f959f2d-kube-api-access-q7jkg\") pod \"maas-api-e2e-inf-b-8756ef-64488868db-2mggp\" (UID: \"95436c46-4170-4fa7-98fb-96592f959f2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:03:53.032019 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:53.031931    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:03:53.174887 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:53.174855    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"]
Jul 21 17:03:53.177809 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:03:53.177773    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95436c46_4170_4fa7_98fb_96592f959f2d.slice/crio-09439323d4865e76501ee71cf5dd5af44c3263e47dfbc11c5aaf648f0b88f3e5 WatchSource:0}: Error finding container 09439323d4865e76501ee71cf5dd5af44c3263e47dfbc11c5aaf648f0b88f3e5: Status 404 returned error can't find the container with id 09439323d4865e76501ee71cf5dd5af44c3263e47dfbc11c5aaf648f0b88f3e5
Jul 21 17:03:53.320466 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:53.320378    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp" event={"ID":"95436c46-4170-4fa7-98fb-96592f959f2d","Type":"ContainerStarted","Data":"09439323d4865e76501ee71cf5dd5af44c3263e47dfbc11c5aaf648f0b88f3e5"}
Jul 21 17:03:54.326441 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:54.326400    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp" event={"ID":"95436c46-4170-4fa7-98fb-96592f959f2d","Type":"ContainerStarted","Data":"c5dd9ca5ae7a198bcd139a58de197fd81a2269efa7d7ef2b162f4fbaa6e8272e"}
Jul 21 17:03:54.326892 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:54.326543    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:03:54.347364 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:03:54.347287    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp" podStartSLOduration=1.691335017 podStartE2EDuration="2.34726697s" totalImagesPullingTime="655.931953ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:54.34687121 +0000 UTC m=+2413.285179658" watchObservedRunningTime="2026-07-21 17:03:54.34726697 +0000 UTC m=+2413.285575684"
Jul 21 17:04:00.337710 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:00.337670    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:04:08.596233 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.596198    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"]
Jul 21 17:04:08.599938 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.599919    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.602942 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.602917    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2c9f37\"/\"openshift-service-ca.crt\""
Jul 21 17:04:08.603075 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.602936    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2c9f37\"/\"kube-root-ca.crt\""
Jul 21 17:04:08.603075 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.602988    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2c9f37\"/\"test-model-2c9f37-kserve-self-signed-certs\""
Jul 21 17:04:08.603075 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.602926    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2c9f37\"/\"default-dockercfg-c8dx2\""
Jul 21 17:04:08.607091 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.607058    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"]
Jul 21 17:04:08.683836 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.683801    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2rtp\" (UniqueName: \"kubernetes.io/projected/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-kube-api-access-t2rtp\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.684025 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.683857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-tls-certs\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.684025 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.683920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-dshm\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.684025 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.683971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-home\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.684025 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.683997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-tmp-dir\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.684025 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.684017    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-model-cache\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.784963 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.784926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-dshm\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.785149 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.784990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-home\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.785149 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.785014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-tmp-dir\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.785149 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.785037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-model-cache\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.785149 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.785114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2rtp\" (UniqueName: \"kubernetes.io/projected/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-kube-api-access-t2rtp\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.785363 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.785167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-tls-certs\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.785512 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.785471    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-home\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.785512 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.785501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-tmp-dir\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.785607 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.785523    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-model-cache\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.787291 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.787271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-dshm\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.787503 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.787487    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-tls-certs\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.795078 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.795052    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2rtp\" (UniqueName: \"kubernetes.io/projected/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-kube-api-access-t2rtp\") pod \"test-model-2c9f37-kserve-fd747bf97-tz2zn\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") " pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:08.911124 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:08.911022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:09.049506 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:09.049480    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"]
Jul 21 17:04:09.053792 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:04:09.053760    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a3a87a5_9c5b_44a8_a1e0_186808eb538b.slice/crio-dbd54d6519e52412e18ce07338d9a4a926eef6261687299c2f1ef650e5a09b68 WatchSource:0}: Error finding container dbd54d6519e52412e18ce07338d9a4a926eef6261687299c2f1ef650e5a09b68: Status 404 returned error can't find the container with id dbd54d6519e52412e18ce07338d9a4a926eef6261687299c2f1ef650e5a09b68
Jul 21 17:04:09.401162 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:09.401128    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn" event={"ID":"3a3a87a5-9c5b-44a8-a1e0-186808eb538b","Type":"ContainerStarted","Data":"4ae350d430382eb0427ef9f85cbe4c171a19c478491116805af30b90a820dc6f"}
Jul 21 17:04:09.401162 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:09.401170    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn" event={"ID":"3a3a87a5-9c5b-44a8-a1e0-186808eb538b","Type":"ContainerStarted","Data":"dbd54d6519e52412e18ce07338d9a4a926eef6261687299c2f1ef650e5a09b68"}
Jul 21 17:04:18.911866 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:18.911828    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:18.912499 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:18.912100    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:18.924510 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:18.924484    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:04:18.943030 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:18.942975    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn" podStartSLOduration=10.942960024 podStartE2EDuration="10.942960024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:04:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:04:09.41828901 +0000 UTC m=+2428.356597460" watchObservedRunningTime="2026-07-21 17:04:18.942960024 +0000 UTC m=+2437.881268472"
Jul 21 17:04:19.464079 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:04:19.464042    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:05:11.680992 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:11.680952    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"]
Jul 21 17:05:12.758333 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:12.758296    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm"]
Jul 21 17:05:12.761954 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:12.761931    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm"
Jul 21 17:05:12.764193 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:12.764158    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 17:05:12.770461 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:12.770432    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm"]
Jul 21 17:05:12.889534 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:12.889492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f60d111-134a-4e53-9eb3-1a16ad01680b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm\" (UID: \"1f60d111-134a-4e53-9eb3-1a16ad01680b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm"
Jul 21 17:05:12.990262 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:12.990215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f60d111-134a-4e53-9eb3-1a16ad01680b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm\" (UID: \"1f60d111-134a-4e53-9eb3-1a16ad01680b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm"
Jul 21 17:05:12.990933 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:12.990911    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f60d111-134a-4e53-9eb3-1a16ad01680b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm\" (UID: \"1f60d111-134a-4e53-9eb3-1a16ad01680b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm"
Jul 21 17:05:13.073559 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:13.073465    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm"
Jul 21 17:05:13.215479 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:13.215452    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm"]
Jul 21 17:05:13.218012 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:05:13.217979    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f60d111_134a_4e53_9eb3_1a16ad01680b.slice/crio-a625e2e53c0fd0c8851ad9f7917fb6c0865b5dc1f1e388fd98bce5b992e100cd WatchSource:0}: Error finding container a625e2e53c0fd0c8851ad9f7917fb6c0865b5dc1f1e388fd98bce5b992e100cd: Status 404 returned error can't find the container with id a625e2e53c0fd0c8851ad9f7917fb6c0865b5dc1f1e388fd98bce5b992e100cd
Jul 21 17:05:13.712274 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:13.712180    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm" event={"ID":"1f60d111-134a-4e53-9eb3-1a16ad01680b","Type":"ContainerStarted","Data":"fa47fab99e6b5cfb52479da85f098fc9f7266371e32c98185bb3d50b84b66bba"}
Jul 21 17:05:13.712274 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:13.712237    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm" event={"ID":"1f60d111-134a-4e53-9eb3-1a16ad01680b","Type":"ContainerStarted","Data":"a625e2e53c0fd0c8851ad9f7917fb6c0865b5dc1f1e388fd98bce5b992e100cd"}
Jul 21 17:05:13.728453 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:13.728398    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm" podStartSLOduration=1.728382258 podStartE2EDuration="1.728382258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:05:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:05:13.726250797 +0000 UTC m=+2492.664559240" watchObservedRunningTime="2026-07-21 17:05:13.728382258 +0000 UTC m=+2492.666690706"
Jul 21 17:05:14.718534 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:14.718501    2578 generic.go:356] "Generic (PLEG): container finished" podID="1f60d111-134a-4e53-9eb3-1a16ad01680b" containerID="fa47fab99e6b5cfb52479da85f098fc9f7266371e32c98185bb3d50b84b66bba" exitCode=0
Jul 21 17:05:14.718984 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:14.718590    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm" event={"ID":"1f60d111-134a-4e53-9eb3-1a16ad01680b","Type":"ContainerDied","Data":"fa47fab99e6b5cfb52479da85f098fc9f7266371e32c98185bb3d50b84b66bba"}
Jul 21 17:05:15.872489 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:15.872456    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm"
Jul 21 17:05:16.022634 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:16.022517    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f60d111-134a-4e53-9eb3-1a16ad01680b-maas-api-service-ca\") pod \"1f60d111-134a-4e53-9eb3-1a16ad01680b\" (UID: \"1f60d111-134a-4e53-9eb3-1a16ad01680b\") "
Jul 21 17:05:16.023000 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:16.022967    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f60d111-134a-4e53-9eb3-1a16ad01680b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1f60d111-134a-4e53-9eb3-1a16ad01680b" (UID: "1f60d111-134a-4e53-9eb3-1a16ad01680b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:05:16.123739 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:16.123682    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f60d111-134a-4e53-9eb3-1a16ad01680b-maas-api-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:05:16.730395 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:16.730355    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm" event={"ID":"1f60d111-134a-4e53-9eb3-1a16ad01680b","Type":"ContainerDied","Data":"a625e2e53c0fd0c8851ad9f7917fb6c0865b5dc1f1e388fd98bce5b992e100cd"}
Jul 21 17:05:16.730395 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:16.730400    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm"
Jul 21 17:05:16.730670 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:16.730418    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a625e2e53c0fd0c8851ad9f7917fb6c0865b5dc1f1e388fd98bce5b992e100cd"
Jul 21 17:05:23.549118 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:23.549083    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"]
Jul 21 17:05:23.549575 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:23.549316    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v" podUID="de99e27b-591b-4334-85cc-8e0fb19973b1" containerName="maas-api" containerID="cri-o://3a75b10e5fe3fb9de225f6b130e75310bc8abc58c098c616e05978969b7476b7" gracePeriod=30
Jul 21 17:05:23.772213 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:23.772171    2578 generic.go:356] "Generic (PLEG): container finished" podID="de99e27b-591b-4334-85cc-8e0fb19973b1" containerID="3a75b10e5fe3fb9de225f6b130e75310bc8abc58c098c616e05978969b7476b7" exitCode=0
Jul 21 17:05:23.772371 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:23.772239    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v" event={"ID":"de99e27b-591b-4334-85cc-8e0fb19973b1","Type":"ContainerDied","Data":"3a75b10e5fe3fb9de225f6b130e75310bc8abc58c098c616e05978969b7476b7"}
Jul 21 17:05:23.807990 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:23.807925    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:05:23.887012 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:23.886975    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de99e27b-591b-4334-85cc-8e0fb19973b1-openshift-service-ca\") pod \"de99e27b-591b-4334-85cc-8e0fb19973b1\" (UID: \"de99e27b-591b-4334-85cc-8e0fb19973b1\") "
Jul 21 17:05:23.887216 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:23.887035    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de99e27b-591b-4334-85cc-8e0fb19973b1-maas-api-tls\") pod \"de99e27b-591b-4334-85cc-8e0fb19973b1\" (UID: \"de99e27b-591b-4334-85cc-8e0fb19973b1\") "
Jul 21 17:05:23.887216 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:23.887067    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z9hw\" (UniqueName: \"kubernetes.io/projected/de99e27b-591b-4334-85cc-8e0fb19973b1-kube-api-access-4z9hw\") pod \"de99e27b-591b-4334-85cc-8e0fb19973b1\" (UID: \"de99e27b-591b-4334-85cc-8e0fb19973b1\") "
Jul 21 17:05:23.887396 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:23.887371    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de99e27b-591b-4334-85cc-8e0fb19973b1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "de99e27b-591b-4334-85cc-8e0fb19973b1" (UID: "de99e27b-591b-4334-85cc-8e0fb19973b1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:05:23.889229 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:23.889204    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de99e27b-591b-4334-85cc-8e0fb19973b1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "de99e27b-591b-4334-85cc-8e0fb19973b1" (UID: "de99e27b-591b-4334-85cc-8e0fb19973b1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:05:23.889298 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:23.889276    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de99e27b-591b-4334-85cc-8e0fb19973b1-kube-api-access-4z9hw" (OuterVolumeSpecName: "kube-api-access-4z9hw") pod "de99e27b-591b-4334-85cc-8e0fb19973b1" (UID: "de99e27b-591b-4334-85cc-8e0fb19973b1"). InnerVolumeSpecName "kube-api-access-4z9hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:05:23.988366 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:23.988330    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de99e27b-591b-4334-85cc-8e0fb19973b1-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:05:23.988366 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:23.988361    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de99e27b-591b-4334-85cc-8e0fb19973b1-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:05:23.988366 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:23.988372    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4z9hw\" (UniqueName: \"kubernetes.io/projected/de99e27b-591b-4334-85cc-8e0fb19973b1-kube-api-access-4z9hw\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:05:24.779287 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:24.779254    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"
Jul 21 17:05:24.779790 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:24.779293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v" event={"ID":"de99e27b-591b-4334-85cc-8e0fb19973b1","Type":"ContainerDied","Data":"420eff283f6889a879df1bc79a215018adb2a91e6451469460df342fec80868a"}
Jul 21 17:05:24.779790 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:24.779358    2578 scope.go:117] "RemoveContainer" containerID="3a75b10e5fe3fb9de225f6b130e75310bc8abc58c098c616e05978969b7476b7"
Jul 21 17:05:24.803477 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:24.803449    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"]
Jul 21 17:05:24.807379 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:24.807354    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2c9f37-86b4989cc4-7hk7v"]
Jul 21 17:05:25.583816 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:25.583784    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de99e27b-591b-4334-85cc-8e0fb19973b1" path="/var/lib/kubelet/pods/de99e27b-591b-4334-85cc-8e0fb19973b1/volumes"
Jul 21 17:05:26.702381 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:26.702334    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn" podUID="3a3a87a5-9c5b-44a8-a1e0-186808eb538b" containerName="main" containerID="cri-o://4ae350d430382eb0427ef9f85cbe4c171a19c478491116805af30b90a820dc6f" gracePeriod=45
Jul 21 17:05:26.959120 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:26.959057    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:05:27.013466 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.013437    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2rtp\" (UniqueName: \"kubernetes.io/projected/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-kube-api-access-t2rtp\") pod \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") "
Jul 21 17:05:27.013634 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.013472    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-model-cache\") pod \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") "
Jul 21 17:05:27.013634 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.013510    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-dshm\") pod \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") "
Jul 21 17:05:27.013634 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.013560    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-home\") pod \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") "
Jul 21 17:05:27.013634 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.013613    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-tls-certs\") pod \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") "
Jul 21 17:05:27.013634 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.013656    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-tmp-dir\") pod \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\" (UID: \"3a3a87a5-9c5b-44a8-a1e0-186808eb538b\") "
Jul 21 17:05:27.013943 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.013801    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-model-cache" (OuterVolumeSpecName: "model-cache") pod "3a3a87a5-9c5b-44a8-a1e0-186808eb538b" (UID: "3a3a87a5-9c5b-44a8-a1e0-186808eb538b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:27.013943 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.013906    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-home" (OuterVolumeSpecName: "home") pod "3a3a87a5-9c5b-44a8-a1e0-186808eb538b" (UID: "3a3a87a5-9c5b-44a8-a1e0-186808eb538b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:27.013943 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.013922    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3a3a87a5-9c5b-44a8-a1e0-186808eb538b" (UID: "3a3a87a5-9c5b-44a8-a1e0-186808eb538b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:27.014120 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.014033    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:05:27.014120 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.014047    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:05:27.014120 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.014056    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:05:27.015838 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.015814    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-dshm" (OuterVolumeSpecName: "dshm") pod "3a3a87a5-9c5b-44a8-a1e0-186808eb538b" (UID: "3a3a87a5-9c5b-44a8-a1e0-186808eb538b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:27.015960 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.015870    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-kube-api-access-t2rtp" (OuterVolumeSpecName: "kube-api-access-t2rtp") pod "3a3a87a5-9c5b-44a8-a1e0-186808eb538b" (UID: "3a3a87a5-9c5b-44a8-a1e0-186808eb538b"). InnerVolumeSpecName "kube-api-access-t2rtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:05:27.015960 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.015926    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3a3a87a5-9c5b-44a8-a1e0-186808eb538b" (UID: "3a3a87a5-9c5b-44a8-a1e0-186808eb538b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:05:27.115162 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.115124    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2rtp\" (UniqueName: \"kubernetes.io/projected/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-kube-api-access-t2rtp\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:05:27.115162 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.115153    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:05:27.115162 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.115163    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a3a87a5-9c5b-44a8-a1e0-186808eb538b-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:05:27.797217 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.797178    2578 generic.go:356] "Generic (PLEG): container finished" podID="3a3a87a5-9c5b-44a8-a1e0-186808eb538b" containerID="4ae350d430382eb0427ef9f85cbe4c171a19c478491116805af30b90a820dc6f" exitCode=0
Jul 21 17:05:27.797742 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.797248    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn" event={"ID":"3a3a87a5-9c5b-44a8-a1e0-186808eb538b","Type":"ContainerDied","Data":"4ae350d430382eb0427ef9f85cbe4c171a19c478491116805af30b90a820dc6f"}
Jul 21 17:05:27.797742 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.797276    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn" event={"ID":"3a3a87a5-9c5b-44a8-a1e0-186808eb538b","Type":"ContainerDied","Data":"dbd54d6519e52412e18ce07338d9a4a926eef6261687299c2f1ef650e5a09b68"}
Jul 21 17:05:27.797742 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.797294    2578 scope.go:117] "RemoveContainer" containerID="4ae350d430382eb0427ef9f85cbe4c171a19c478491116805af30b90a820dc6f"
Jul 21 17:05:27.797742 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.797247    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"
Jul 21 17:05:27.806087 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.806066    2578 scope.go:117] "RemoveContainer" containerID="4ae350d430382eb0427ef9f85cbe4c171a19c478491116805af30b90a820dc6f"
Jul 21 17:05:27.806359 ip-10-0-130-171 kubenswrapper[2578]: E0721 17:05:27.806333    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ae350d430382eb0427ef9f85cbe4c171a19c478491116805af30b90a820dc6f\": container with ID starting with 4ae350d430382eb0427ef9f85cbe4c171a19c478491116805af30b90a820dc6f not found: ID does not exist" containerID="4ae350d430382eb0427ef9f85cbe4c171a19c478491116805af30b90a820dc6f"
Jul 21 17:05:27.806433 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.806369    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ae350d430382eb0427ef9f85cbe4c171a19c478491116805af30b90a820dc6f"} err="failed to get container status \"4ae350d430382eb0427ef9f85cbe4c171a19c478491116805af30b90a820dc6f\": rpc error: code = NotFound desc = could not find container \"4ae350d430382eb0427ef9f85cbe4c171a19c478491116805af30b90a820dc6f\": container with ID starting with 4ae350d430382eb0427ef9f85cbe4c171a19c478491116805af30b90a820dc6f not found: ID does not exist"
Jul 21 17:05:27.813774 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.813750    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"]
Jul 21 17:05:27.820562 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.820539    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2c9f37/test-model-2c9f37-kserve-fd747bf97-tz2zn"]
Jul 21 17:05:27.846570 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.846492    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm"]
Jul 21 17:05:27.850685 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:27.850661    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2c9f37-qkqtm"]
Jul 21 17:05:29.583035 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:29.582989    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f60d111-134a-4e53-9eb3-1a16ad01680b" path="/var/lib/kubelet/pods/1f60d111-134a-4e53-9eb3-1a16ad01680b/volumes"
Jul 21 17:05:29.583618 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:29.583596    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a3a87a5-9c5b-44a8-a1e0-186808eb538b" path="/var/lib/kubelet/pods/3a3a87a5-9c5b-44a8-a1e0-186808eb538b/volumes"
Jul 21 17:05:35.163904 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.163798    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb"]
Jul 21 17:05:35.164304 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.164233    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f60d111-134a-4e53-9eb3-1a16ad01680b" containerName="revoke-keys"
Jul 21 17:05:35.164304 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.164247    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f60d111-134a-4e53-9eb3-1a16ad01680b" containerName="revoke-keys"
Jul 21 17:05:35.164304 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.164258    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de99e27b-591b-4334-85cc-8e0fb19973b1" containerName="maas-api"
Jul 21 17:05:35.164304 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.164263    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="de99e27b-591b-4334-85cc-8e0fb19973b1" containerName="maas-api"
Jul 21 17:05:35.164304 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.164276    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3a87a5-9c5b-44a8-a1e0-186808eb538b" containerName="main"
Jul 21 17:05:35.164304 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.164282    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3a87a5-9c5b-44a8-a1e0-186808eb538b" containerName="main"
Jul 21 17:05:35.164498 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.164343    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f60d111-134a-4e53-9eb3-1a16ad01680b" containerName="revoke-keys"
Jul 21 17:05:35.164498 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.164356    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="de99e27b-591b-4334-85cc-8e0fb19973b1" containerName="maas-api"
Jul 21 17:05:35.164498 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.164364    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a3a87a5-9c5b-44a8-a1e0-186808eb538b" containerName="main"
Jul 21 17:05:35.168814 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.168795    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb"
Jul 21 17:05:35.171104 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.171076    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 17:05:35.178209 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.178179    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb"]
Jul 21 17:05:35.187571 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.187543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ad2b46a-c531-4e13-9daf-dcd65eddadd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb\" (UID: \"7ad2b46a-c531-4e13-9daf-dcd65eddadd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb"
Jul 21 17:05:35.288514 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.288470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ad2b46a-c531-4e13-9daf-dcd65eddadd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb\" (UID: \"7ad2b46a-c531-4e13-9daf-dcd65eddadd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb"
Jul 21 17:05:35.289093 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.289072    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ad2b46a-c531-4e13-9daf-dcd65eddadd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb\" (UID: \"7ad2b46a-c531-4e13-9daf-dcd65eddadd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb"
Jul 21 17:05:35.484359 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.484272    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb"
Jul 21 17:05:35.620591 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.620562    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb"]
Jul 21 17:05:35.623211 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:05:35.623176    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad2b46a_c531_4e13_9daf_dcd65eddadd6.slice/crio-80d859e052b3fc9bfa0d57facaa3abc24be24b114a06a69861c83fe7148b6d92 WatchSource:0}: Error finding container 80d859e052b3fc9bfa0d57facaa3abc24be24b114a06a69861c83fe7148b6d92: Status 404 returned error can't find the container with id 80d859e052b3fc9bfa0d57facaa3abc24be24b114a06a69861c83fe7148b6d92
Jul 21 17:05:35.840580 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:35.840552    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb" event={"ID":"7ad2b46a-c531-4e13-9daf-dcd65eddadd6","Type":"ContainerStarted","Data":"80d859e052b3fc9bfa0d57facaa3abc24be24b114a06a69861c83fe7148b6d92"}
Jul 21 17:05:36.849483 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:36.849446    2578 generic.go:356] "Generic (PLEG): container finished" podID="7ad2b46a-c531-4e13-9daf-dcd65eddadd6" containerID="77c499dcc7adb8222914b2aed635b5d9b600047b95478de416f44fe0d1d11e0f" exitCode=0
Jul 21 17:05:36.849884 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:36.849513    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb" event={"ID":"7ad2b46a-c531-4e13-9daf-dcd65eddadd6","Type":"ContainerDied","Data":"77c499dcc7adb8222914b2aed635b5d9b600047b95478de416f44fe0d1d11e0f"}
Jul 21 17:05:37.994923 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:37.994898    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb"
Jul 21 17:05:38.116203 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:38.116099    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ad2b46a-c531-4e13-9daf-dcd65eddadd6-maas-api-service-ca\") pod \"7ad2b46a-c531-4e13-9daf-dcd65eddadd6\" (UID: \"7ad2b46a-c531-4e13-9daf-dcd65eddadd6\") "
Jul 21 17:05:38.116494 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:38.116470    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ad2b46a-c531-4e13-9daf-dcd65eddadd6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7ad2b46a-c531-4e13-9daf-dcd65eddadd6" (UID: "7ad2b46a-c531-4e13-9daf-dcd65eddadd6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:05:38.217241 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:38.217200    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ad2b46a-c531-4e13-9daf-dcd65eddadd6-maas-api-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:05:38.862538 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:38.862480    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb" event={"ID":"7ad2b46a-c531-4e13-9daf-dcd65eddadd6","Type":"ContainerDied","Data":"80d859e052b3fc9bfa0d57facaa3abc24be24b114a06a69861c83fe7148b6d92"}
Jul 21 17:05:38.862749 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:38.862563    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80d859e052b3fc9bfa0d57facaa3abc24be24b114a06a69861c83fe7148b6d92"
Jul 21 17:05:38.862749 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:38.862514    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb"
Jul 21 17:05:46.033959 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.033915    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"]
Jul 21 17:05:46.034518 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.034176    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp" podUID="95436c46-4170-4fa7-98fb-96592f959f2d" containerName="maas-api" containerID="cri-o://c5dd9ca5ae7a198bcd139a58de197fd81a2269efa7d7ef2b162f4fbaa6e8272e" gracePeriod=30
Jul 21 17:05:46.289475 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.289409    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:05:46.393167 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.393123    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95436c46-4170-4fa7-98fb-96592f959f2d-maas-api-tls\") pod \"95436c46-4170-4fa7-98fb-96592f959f2d\" (UID: \"95436c46-4170-4fa7-98fb-96592f959f2d\") "
Jul 21 17:05:46.393381 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.393200    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95436c46-4170-4fa7-98fb-96592f959f2d-openshift-service-ca\") pod \"95436c46-4170-4fa7-98fb-96592f959f2d\" (UID: \"95436c46-4170-4fa7-98fb-96592f959f2d\") "
Jul 21 17:05:46.393381 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.393240    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7jkg\" (UniqueName: \"kubernetes.io/projected/95436c46-4170-4fa7-98fb-96592f959f2d-kube-api-access-q7jkg\") pod \"95436c46-4170-4fa7-98fb-96592f959f2d\" (UID: \"95436c46-4170-4fa7-98fb-96592f959f2d\") "
Jul 21 17:05:46.393606 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.393575    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95436c46-4170-4fa7-98fb-96592f959f2d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95436c46-4170-4fa7-98fb-96592f959f2d" (UID: "95436c46-4170-4fa7-98fb-96592f959f2d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:05:46.395358 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.395333    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95436c46-4170-4fa7-98fb-96592f959f2d-kube-api-access-q7jkg" (OuterVolumeSpecName: "kube-api-access-q7jkg") pod "95436c46-4170-4fa7-98fb-96592f959f2d" (UID: "95436c46-4170-4fa7-98fb-96592f959f2d"). InnerVolumeSpecName "kube-api-access-q7jkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:05:46.395504 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.395490    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95436c46-4170-4fa7-98fb-96592f959f2d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95436c46-4170-4fa7-98fb-96592f959f2d" (UID: "95436c46-4170-4fa7-98fb-96592f959f2d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:05:46.494850 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.494802    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7jkg\" (UniqueName: \"kubernetes.io/projected/95436c46-4170-4fa7-98fb-96592f959f2d-kube-api-access-q7jkg\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:05:46.494850 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.494847    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95436c46-4170-4fa7-98fb-96592f959f2d-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:05:46.495077 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.494864    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95436c46-4170-4fa7-98fb-96592f959f2d-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:05:46.910598 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.910559    2578 generic.go:356] "Generic (PLEG): container finished" podID="95436c46-4170-4fa7-98fb-96592f959f2d" containerID="c5dd9ca5ae7a198bcd139a58de197fd81a2269efa7d7ef2b162f4fbaa6e8272e" exitCode=0
Jul 21 17:05:46.910811 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.910606    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"
Jul 21 17:05:46.910811 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.910629    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp" event={"ID":"95436c46-4170-4fa7-98fb-96592f959f2d","Type":"ContainerDied","Data":"c5dd9ca5ae7a198bcd139a58de197fd81a2269efa7d7ef2b162f4fbaa6e8272e"}
Jul 21 17:05:46.910811 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.910698    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp" event={"ID":"95436c46-4170-4fa7-98fb-96592f959f2d","Type":"ContainerDied","Data":"09439323d4865e76501ee71cf5dd5af44c3263e47dfbc11c5aaf648f0b88f3e5"}
Jul 21 17:05:46.910811 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.910722    2578 scope.go:117] "RemoveContainer" containerID="c5dd9ca5ae7a198bcd139a58de197fd81a2269efa7d7ef2b162f4fbaa6e8272e"
Jul 21 17:05:46.920488 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.920466    2578 scope.go:117] "RemoveContainer" containerID="c5dd9ca5ae7a198bcd139a58de197fd81a2269efa7d7ef2b162f4fbaa6e8272e"
Jul 21 17:05:46.920766 ip-10-0-130-171 kubenswrapper[2578]: E0721 17:05:46.920744    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5dd9ca5ae7a198bcd139a58de197fd81a2269efa7d7ef2b162f4fbaa6e8272e\": container with ID starting with c5dd9ca5ae7a198bcd139a58de197fd81a2269efa7d7ef2b162f4fbaa6e8272e not found: ID does not exist" containerID="c5dd9ca5ae7a198bcd139a58de197fd81a2269efa7d7ef2b162f4fbaa6e8272e"
Jul 21 17:05:46.920850 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.920779    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5dd9ca5ae7a198bcd139a58de197fd81a2269efa7d7ef2b162f4fbaa6e8272e"} err="failed to get container status \"c5dd9ca5ae7a198bcd139a58de197fd81a2269efa7d7ef2b162f4fbaa6e8272e\": rpc error: code = NotFound desc = could not find container \"c5dd9ca5ae7a198bcd139a58de197fd81a2269efa7d7ef2b162f4fbaa6e8272e\": container with ID starting with c5dd9ca5ae7a198bcd139a58de197fd81a2269efa7d7ef2b162f4fbaa6e8272e not found: ID does not exist"
Jul 21 17:05:46.936047 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.936021    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"]
Jul 21 17:05:46.939179 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:46.939154    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8756ef-64488868db-2mggp"]
Jul 21 17:05:47.583701 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:47.583666    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95436c46-4170-4fa7-98fb-96592f959f2d" path="/var/lib/kubelet/pods/95436c46-4170-4fa7-98fb-96592f959f2d/volumes"
Jul 21 17:05:50.267118 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:50.267078    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb"]
Jul 21 17:05:50.271700 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:50.271667    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8756ef-lxhlb"]
Jul 21 17:05:51.583103 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:05:51.583058    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ad2b46a-c531-4e13-9daf-dcd65eddadd6" path="/var/lib/kubelet/pods/7ad2b46a-c531-4e13-9daf-dcd65eddadd6/volumes"
Jul 21 17:06:01.401418 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.401385    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"]
Jul 21 17:06:01.401823 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.401756    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95436c46-4170-4fa7-98fb-96592f959f2d" containerName="maas-api"
Jul 21 17:06:01.401823 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.401768    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="95436c46-4170-4fa7-98fb-96592f959f2d" containerName="maas-api"
Jul 21 17:06:01.401823 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.401793    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ad2b46a-c531-4e13-9daf-dcd65eddadd6" containerName="revoke-keys"
Jul 21 17:06:01.401823 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.401799    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ad2b46a-c531-4e13-9daf-dcd65eddadd6" containerName="revoke-keys"
Jul 21 17:06:01.401994 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.401859    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="95436c46-4170-4fa7-98fb-96592f959f2d" containerName="maas-api"
Jul 21 17:06:01.401994 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.401869    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ad2b46a-c531-4e13-9daf-dcd65eddadd6" containerName="revoke-keys"
Jul 21 17:06:01.405081 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.405060    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:01.407623 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.407603    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-d8794b-serving-cert\""
Jul 21 17:06:01.418463 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.418438    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"]
Jul 21 17:06:01.533260 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.533230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06c67cb-e65f-49cb-bda0-2025d195321b-openshift-service-ca\") pod \"maas-api-e2e-api-a-d8794b-5c86d8984c-b27db\" (UID: \"c06c67cb-e65f-49cb-bda0-2025d195321b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:01.533420 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.533365    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06c67cb-e65f-49cb-bda0-2025d195321b-maas-api-tls\") pod \"maas-api-e2e-api-a-d8794b-5c86d8984c-b27db\" (UID: \"c06c67cb-e65f-49cb-bda0-2025d195321b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:01.533420 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.533406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qnwc\" (UniqueName: \"kubernetes.io/projected/c06c67cb-e65f-49cb-bda0-2025d195321b-kube-api-access-9qnwc\") pod \"maas-api-e2e-api-a-d8794b-5c86d8984c-b27db\" (UID: \"c06c67cb-e65f-49cb-bda0-2025d195321b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:01.633851 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.633820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06c67cb-e65f-49cb-bda0-2025d195321b-maas-api-tls\") pod \"maas-api-e2e-api-a-d8794b-5c86d8984c-b27db\" (UID: \"c06c67cb-e65f-49cb-bda0-2025d195321b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:01.633851 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.633853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qnwc\" (UniqueName: \"kubernetes.io/projected/c06c67cb-e65f-49cb-bda0-2025d195321b-kube-api-access-9qnwc\") pod \"maas-api-e2e-api-a-d8794b-5c86d8984c-b27db\" (UID: \"c06c67cb-e65f-49cb-bda0-2025d195321b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:01.634049 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.633883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06c67cb-e65f-49cb-bda0-2025d195321b-openshift-service-ca\") pod \"maas-api-e2e-api-a-d8794b-5c86d8984c-b27db\" (UID: \"c06c67cb-e65f-49cb-bda0-2025d195321b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:01.634479 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.634459    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06c67cb-e65f-49cb-bda0-2025d195321b-openshift-service-ca\") pod \"maas-api-e2e-api-a-d8794b-5c86d8984c-b27db\" (UID: \"c06c67cb-e65f-49cb-bda0-2025d195321b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:01.636334 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.636310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06c67cb-e65f-49cb-bda0-2025d195321b-maas-api-tls\") pod \"maas-api-e2e-api-a-d8794b-5c86d8984c-b27db\" (UID: \"c06c67cb-e65f-49cb-bda0-2025d195321b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:01.656176 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.656111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qnwc\" (UniqueName: \"kubernetes.io/projected/c06c67cb-e65f-49cb-bda0-2025d195321b-kube-api-access-9qnwc\") pod \"maas-api-e2e-api-a-d8794b-5c86d8984c-b27db\" (UID: \"c06c67cb-e65f-49cb-bda0-2025d195321b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:01.715965 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.715940    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:01.883934 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.883907    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"]
Jul 21 17:06:01.887073 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:06:01.887044    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06c67cb_e65f_49cb_bda0_2025d195321b.slice/crio-29874689004b339c85c8c3d57c5efaafbdb74de74b409bd88d6b5cee47e6cdb7 WatchSource:0}: Error finding container 29874689004b339c85c8c3d57c5efaafbdb74de74b409bd88d6b5cee47e6cdb7: Status 404 returned error can't find the container with id 29874689004b339c85c8c3d57c5efaafbdb74de74b409bd88d6b5cee47e6cdb7
Jul 21 17:06:01.888480 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.888449    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:06:01.990962 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:01.990885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db" event={"ID":"c06c67cb-e65f-49cb-bda0-2025d195321b","Type":"ContainerStarted","Data":"29874689004b339c85c8c3d57c5efaafbdb74de74b409bd88d6b5cee47e6cdb7"}
Jul 21 17:06:02.997740 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:02.997707    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db" event={"ID":"c06c67cb-e65f-49cb-bda0-2025d195321b","Type":"ContainerStarted","Data":"96fb2ae11eb5e8d876ac4b851f26f3aeb9caa904cb1a502c367ced3873734fd2"}
Jul 21 17:06:02.998159 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:02.997765    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:09.009248 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.009211    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:09.035830 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.035769    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db" podStartSLOduration=7.432946792 podStartE2EDuration="8.035735719s" totalImagesPullingTime="602.788927ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:06:03.042973703 +0000 UTC m=+2541.981282152" watchObservedRunningTime="2026-07-21 17:06:09.035735719 +0000 UTC m=+2547.974044166"
Jul 21 17:06:09.517910 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.517875    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"]
Jul 21 17:06:09.521462 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.521445    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:06:09.527551 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.527526    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0f9eb0-serving-cert\""
Jul 21 17:06:09.610055 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.610030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7096d348-de64-48f6-a0a3-171ed3127e7a-maas-api-tls\") pod \"maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz\" (UID: \"7096d348-de64-48f6-a0a3-171ed3127e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:06:09.610196 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.610085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62sfv\" (UniqueName: \"kubernetes.io/projected/7096d348-de64-48f6-a0a3-171ed3127e7a-kube-api-access-62sfv\") pod \"maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz\" (UID: \"7096d348-de64-48f6-a0a3-171ed3127e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:06:09.610196 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.610177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7096d348-de64-48f6-a0a3-171ed3127e7a-openshift-service-ca\") pod \"maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz\" (UID: \"7096d348-de64-48f6-a0a3-171ed3127e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:06:09.688632 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.688606    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"]
Jul 21 17:06:09.711068 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.711046    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7096d348-de64-48f6-a0a3-171ed3127e7a-maas-api-tls\") pod \"maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz\" (UID: \"7096d348-de64-48f6-a0a3-171ed3127e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:06:09.711201 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.711079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62sfv\" (UniqueName: \"kubernetes.io/projected/7096d348-de64-48f6-a0a3-171ed3127e7a-kube-api-access-62sfv\") pod \"maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz\" (UID: \"7096d348-de64-48f6-a0a3-171ed3127e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:06:09.711271 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.711232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7096d348-de64-48f6-a0a3-171ed3127e7a-openshift-service-ca\") pod \"maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz\" (UID: \"7096d348-de64-48f6-a0a3-171ed3127e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:06:09.712011 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.711986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7096d348-de64-48f6-a0a3-171ed3127e7a-openshift-service-ca\") pod \"maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz\" (UID: \"7096d348-de64-48f6-a0a3-171ed3127e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:06:09.713739 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.713719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7096d348-de64-48f6-a0a3-171ed3127e7a-maas-api-tls\") pod \"maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz\" (UID: \"7096d348-de64-48f6-a0a3-171ed3127e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:06:09.772504 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.772446    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62sfv\" (UniqueName: \"kubernetes.io/projected/7096d348-de64-48f6-a0a3-171ed3127e7a-kube-api-access-62sfv\") pod \"maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz\" (UID: \"7096d348-de64-48f6-a0a3-171ed3127e7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:06:09.832268 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:09.832246    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:06:10.060935 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:10.060911    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"]
Jul 21 17:06:10.063253 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:06:10.063224    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7096d348_de64_48f6_a0a3_171ed3127e7a.slice/crio-be34f24cced7fa92f536d13313713d4814ca6f54b001bebe53e8dc3735b88eb2 WatchSource:0}: Error finding container be34f24cced7fa92f536d13313713d4814ca6f54b001bebe53e8dc3735b88eb2: Status 404 returned error can't find the container with id be34f24cced7fa92f536d13313713d4814ca6f54b001bebe53e8dc3735b88eb2
Jul 21 17:06:11.039663 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:11.039610    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz" event={"ID":"7096d348-de64-48f6-a0a3-171ed3127e7a","Type":"ContainerStarted","Data":"c542e7128f631dc6fdf487be9807d07d2fc4031e574e766fadfb3545586f40b9"}
Jul 21 17:06:11.039839 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:11.039679    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz" event={"ID":"7096d348-de64-48f6-a0a3-171ed3127e7a","Type":"ContainerStarted","Data":"be34f24cced7fa92f536d13313713d4814ca6f54b001bebe53e8dc3735b88eb2"}
Jul 21 17:06:11.039839 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:11.039772    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:06:11.091693 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:11.090810    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz" podStartSLOduration=1.7721642389999999 podStartE2EDuration="2.090790001s" totalImagesPullingTime="318.625762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:06:11.087404485 +0000 UTC m=+2550.025712935" watchObservedRunningTime="2026-07-21 17:06:11.090790001 +0000 UTC m=+2550.029098449"
Jul 21 17:06:17.050341 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:17.050310    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:06:37.304207 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:37.304171    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"]
Jul 21 17:06:37.304724 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:37.304443    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db" podUID="c06c67cb-e65f-49cb-bda0-2025d195321b" containerName="maas-api" containerID="cri-o://96fb2ae11eb5e8d876ac4b851f26f3aeb9caa904cb1a502c367ced3873734fd2" gracePeriod=30
Jul 21 17:06:37.543097 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:37.543071    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:37.647321 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:37.647276    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qnwc\" (UniqueName: \"kubernetes.io/projected/c06c67cb-e65f-49cb-bda0-2025d195321b-kube-api-access-9qnwc\") pod \"c06c67cb-e65f-49cb-bda0-2025d195321b\" (UID: \"c06c67cb-e65f-49cb-bda0-2025d195321b\") "
Jul 21 17:06:37.647502 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:37.647370    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06c67cb-e65f-49cb-bda0-2025d195321b-maas-api-tls\") pod \"c06c67cb-e65f-49cb-bda0-2025d195321b\" (UID: \"c06c67cb-e65f-49cb-bda0-2025d195321b\") "
Jul 21 17:06:37.647502 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:37.647392    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06c67cb-e65f-49cb-bda0-2025d195321b-openshift-service-ca\") pod \"c06c67cb-e65f-49cb-bda0-2025d195321b\" (UID: \"c06c67cb-e65f-49cb-bda0-2025d195321b\") "
Jul 21 17:06:37.647827 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:37.647801    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c06c67cb-e65f-49cb-bda0-2025d195321b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c06c67cb-e65f-49cb-bda0-2025d195321b" (UID: "c06c67cb-e65f-49cb-bda0-2025d195321b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:06:37.649463 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:37.649428    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c06c67cb-e65f-49cb-bda0-2025d195321b-kube-api-access-9qnwc" (OuterVolumeSpecName: "kube-api-access-9qnwc") pod "c06c67cb-e65f-49cb-bda0-2025d195321b" (UID: "c06c67cb-e65f-49cb-bda0-2025d195321b"). InnerVolumeSpecName "kube-api-access-9qnwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:06:37.649463 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:37.649426    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c06c67cb-e65f-49cb-bda0-2025d195321b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c06c67cb-e65f-49cb-bda0-2025d195321b" (UID: "c06c67cb-e65f-49cb-bda0-2025d195321b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:06:37.749007 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:37.748977    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qnwc\" (UniqueName: \"kubernetes.io/projected/c06c67cb-e65f-49cb-bda0-2025d195321b-kube-api-access-9qnwc\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:06:37.749007 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:37.749003    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06c67cb-e65f-49cb-bda0-2025d195321b-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:06:37.749007 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:37.749013    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06c67cb-e65f-49cb-bda0-2025d195321b-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:06:38.167527 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:38.167491    2578 generic.go:356] "Generic (PLEG): container finished" podID="c06c67cb-e65f-49cb-bda0-2025d195321b" containerID="96fb2ae11eb5e8d876ac4b851f26f3aeb9caa904cb1a502c367ced3873734fd2" exitCode=0
Jul 21 17:06:38.167739 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:38.167540    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"
Jul 21 17:06:38.167739 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:38.167581    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db" event={"ID":"c06c67cb-e65f-49cb-bda0-2025d195321b","Type":"ContainerDied","Data":"96fb2ae11eb5e8d876ac4b851f26f3aeb9caa904cb1a502c367ced3873734fd2"}
Jul 21 17:06:38.167739 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:38.167651    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db" event={"ID":"c06c67cb-e65f-49cb-bda0-2025d195321b","Type":"ContainerDied","Data":"29874689004b339c85c8c3d57c5efaafbdb74de74b409bd88d6b5cee47e6cdb7"}
Jul 21 17:06:38.167739 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:38.167669    2578 scope.go:117] "RemoveContainer" containerID="96fb2ae11eb5e8d876ac4b851f26f3aeb9caa904cb1a502c367ced3873734fd2"
Jul 21 17:06:38.177205 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:38.177182    2578 scope.go:117] "RemoveContainer" containerID="96fb2ae11eb5e8d876ac4b851f26f3aeb9caa904cb1a502c367ced3873734fd2"
Jul 21 17:06:38.177441 ip-10-0-130-171 kubenswrapper[2578]: E0721 17:06:38.177424    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96fb2ae11eb5e8d876ac4b851f26f3aeb9caa904cb1a502c367ced3873734fd2\": container with ID starting with 96fb2ae11eb5e8d876ac4b851f26f3aeb9caa904cb1a502c367ced3873734fd2 not found: ID does not exist" containerID="96fb2ae11eb5e8d876ac4b851f26f3aeb9caa904cb1a502c367ced3873734fd2"
Jul 21 17:06:38.177495 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:38.177450    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96fb2ae11eb5e8d876ac4b851f26f3aeb9caa904cb1a502c367ced3873734fd2"} err="failed to get container status \"96fb2ae11eb5e8d876ac4b851f26f3aeb9caa904cb1a502c367ced3873734fd2\": rpc error: code = NotFound desc = could not find container \"96fb2ae11eb5e8d876ac4b851f26f3aeb9caa904cb1a502c367ced3873734fd2\": container with ID starting with 96fb2ae11eb5e8d876ac4b851f26f3aeb9caa904cb1a502c367ced3873734fd2 not found: ID does not exist"
Jul 21 17:06:38.190609 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:38.190582    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"]
Jul 21 17:06:38.197132 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:38.197113    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d8794b-5c86d8984c-b27db"]
Jul 21 17:06:39.583294 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:39.583259    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c06c67cb-e65f-49cb-bda0-2025d195321b" path="/var/lib/kubelet/pods/c06c67cb-e65f-49cb-bda0-2025d195321b/volumes"
Jul 21 17:06:41.787886 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:41.787859    2578 scope.go:117] "RemoveContainer" containerID="60d1a317008d1d00569432cb64e8b833ae97043cefdbe7d54efb376c0225a02f"
Jul 21 17:06:49.095312 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:49.095275    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw"]
Jul 21 17:06:49.095794 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:49.095686    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c06c67cb-e65f-49cb-bda0-2025d195321b" containerName="maas-api"
Jul 21 17:06:49.095794 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:49.095698    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c06c67cb-e65f-49cb-bda0-2025d195321b" containerName="maas-api"
Jul 21 17:06:49.095794 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:49.095750    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c06c67cb-e65f-49cb-bda0-2025d195321b" containerName="maas-api"
Jul 21 17:06:49.098633 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:49.098606    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw"
Jul 21 17:06:49.099200 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:49.099168    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw"]
Jul 21 17:06:49.101125 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:49.101097    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 17:06:49.251941 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:49.251908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0d6a37-4d10-47a8-814f-ee9d459f3def-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw\" (UID: \"2f0d6a37-4d10-47a8-814f-ee9d459f3def\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw"
Jul 21 17:06:49.353170 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:49.353088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0d6a37-4d10-47a8-814f-ee9d459f3def-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw\" (UID: \"2f0d6a37-4d10-47a8-814f-ee9d459f3def\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw"
Jul 21 17:06:49.353695 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:49.353635    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0d6a37-4d10-47a8-814f-ee9d459f3def-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw\" (UID: \"2f0d6a37-4d10-47a8-814f-ee9d459f3def\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw"
Jul 21 17:06:49.409635 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:49.409608    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw"
Jul 21 17:06:49.548256 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:49.548227    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw"]
Jul 21 17:06:49.551581 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:06:49.551552    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0d6a37_4d10_47a8_814f_ee9d459f3def.slice/crio-36b3896703e466953f3a9e27270be2ed687bdc063be7082c295581cce6089242 WatchSource:0}: Error finding container 36b3896703e466953f3a9e27270be2ed687bdc063be7082c295581cce6089242: Status 404 returned error can't find the container with id 36b3896703e466953f3a9e27270be2ed687bdc063be7082c295581cce6089242
Jul 21 17:06:50.228852 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:50.228816    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw" event={"ID":"2f0d6a37-4d10-47a8-814f-ee9d459f3def","Type":"ContainerStarted","Data":"6ac1c2f0e9fa5e06785750716f6a4fb7c5910c7cff28fe9e6931807ab69f5463"}
Jul 21 17:06:50.229328 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:50.228871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw" event={"ID":"2f0d6a37-4d10-47a8-814f-ee9d459f3def","Type":"ContainerStarted","Data":"36b3896703e466953f3a9e27270be2ed687bdc063be7082c295581cce6089242"}
Jul 21 17:06:50.250864 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:50.250815    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw" podStartSLOduration=1.250795785 podStartE2EDuration="1.250795785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:06:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:06:50.248374613 +0000 UTC m=+2589.186683061" watchObservedRunningTime="2026-07-21 17:06:50.250795785 +0000 UTC m=+2589.189104234"
Jul 21 17:06:51.243082 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:51.243044    2578 generic.go:356] "Generic (PLEG): container finished" podID="2f0d6a37-4d10-47a8-814f-ee9d459f3def" containerID="6ac1c2f0e9fa5e06785750716f6a4fb7c5910c7cff28fe9e6931807ab69f5463" exitCode=0
Jul 21 17:06:51.243491 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:51.243136    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw" event={"ID":"2f0d6a37-4d10-47a8-814f-ee9d459f3def","Type":"ContainerDied","Data":"6ac1c2f0e9fa5e06785750716f6a4fb7c5910c7cff28fe9e6931807ab69f5463"}
Jul 21 17:06:52.386821 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:52.386796    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw"
Jul 21 17:06:52.478380 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:52.478343    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0d6a37-4d10-47a8-814f-ee9d459f3def-maas-api-service-ca\") pod \"2f0d6a37-4d10-47a8-814f-ee9d459f3def\" (UID: \"2f0d6a37-4d10-47a8-814f-ee9d459f3def\") "
Jul 21 17:06:52.478711 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:52.478690    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f0d6a37-4d10-47a8-814f-ee9d459f3def-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2f0d6a37-4d10-47a8-814f-ee9d459f3def" (UID: "2f0d6a37-4d10-47a8-814f-ee9d459f3def"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:06:52.579465 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:52.579391    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0d6a37-4d10-47a8-814f-ee9d459f3def-maas-api-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:06:53.259422 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:53.259391    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw"
Jul 21 17:06:53.259611 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:53.259392    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw" event={"ID":"2f0d6a37-4d10-47a8-814f-ee9d459f3def","Type":"ContainerDied","Data":"36b3896703e466953f3a9e27270be2ed687bdc063be7082c295581cce6089242"}
Jul 21 17:06:53.259611 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:06:53.259526    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36b3896703e466953f3a9e27270be2ed687bdc063be7082c295581cce6089242"
Jul 21 17:07:04.658594 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:04.658503    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"]
Jul 21 17:07:04.659107 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:04.658756    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz" podUID="7096d348-de64-48f6-a0a3-171ed3127e7a" containerName="maas-api" containerID="cri-o://c542e7128f631dc6fdf487be9807d07d2fc4031e574e766fadfb3545586f40b9" gracePeriod=30
Jul 21 17:07:04.915523 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:04.915458    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:07:04.983944 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:04.983915    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62sfv\" (UniqueName: \"kubernetes.io/projected/7096d348-de64-48f6-a0a3-171ed3127e7a-kube-api-access-62sfv\") pod \"7096d348-de64-48f6-a0a3-171ed3127e7a\" (UID: \"7096d348-de64-48f6-a0a3-171ed3127e7a\") "
Jul 21 17:07:04.984094 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:04.983999    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7096d348-de64-48f6-a0a3-171ed3127e7a-maas-api-tls\") pod \"7096d348-de64-48f6-a0a3-171ed3127e7a\" (UID: \"7096d348-de64-48f6-a0a3-171ed3127e7a\") "
Jul 21 17:07:04.984094 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:04.984041    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7096d348-de64-48f6-a0a3-171ed3127e7a-openshift-service-ca\") pod \"7096d348-de64-48f6-a0a3-171ed3127e7a\" (UID: \"7096d348-de64-48f6-a0a3-171ed3127e7a\") "
Jul 21 17:07:04.984424 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:04.984399    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7096d348-de64-48f6-a0a3-171ed3127e7a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7096d348-de64-48f6-a0a3-171ed3127e7a" (UID: "7096d348-de64-48f6-a0a3-171ed3127e7a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:07:04.985908 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:04.985876    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7096d348-de64-48f6-a0a3-171ed3127e7a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7096d348-de64-48f6-a0a3-171ed3127e7a" (UID: "7096d348-de64-48f6-a0a3-171ed3127e7a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:07:04.985908 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:04.985904    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7096d348-de64-48f6-a0a3-171ed3127e7a-kube-api-access-62sfv" (OuterVolumeSpecName: "kube-api-access-62sfv") pod "7096d348-de64-48f6-a0a3-171ed3127e7a" (UID: "7096d348-de64-48f6-a0a3-171ed3127e7a"). InnerVolumeSpecName "kube-api-access-62sfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:07:05.085221 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:05.085193    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7096d348-de64-48f6-a0a3-171ed3127e7a-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:07:05.085221 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:05.085217    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7096d348-de64-48f6-a0a3-171ed3127e7a-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:07:05.085221 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:05.085228    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62sfv\" (UniqueName: \"kubernetes.io/projected/7096d348-de64-48f6-a0a3-171ed3127e7a-kube-api-access-62sfv\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:07:05.320627 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:05.320541    2578 generic.go:356] "Generic (PLEG): container finished" podID="7096d348-de64-48f6-a0a3-171ed3127e7a" containerID="c542e7128f631dc6fdf487be9807d07d2fc4031e574e766fadfb3545586f40b9" exitCode=0
Jul 21 17:07:05.320627 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:05.320584    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"
Jul 21 17:07:05.320836 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:05.320634    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz" event={"ID":"7096d348-de64-48f6-a0a3-171ed3127e7a","Type":"ContainerDied","Data":"c542e7128f631dc6fdf487be9807d07d2fc4031e574e766fadfb3545586f40b9"}
Jul 21 17:07:05.320836 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:05.320723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz" event={"ID":"7096d348-de64-48f6-a0a3-171ed3127e7a","Type":"ContainerDied","Data":"be34f24cced7fa92f536d13313713d4814ca6f54b001bebe53e8dc3735b88eb2"}
Jul 21 17:07:05.320836 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:05.320746    2578 scope.go:117] "RemoveContainer" containerID="c542e7128f631dc6fdf487be9807d07d2fc4031e574e766fadfb3545586f40b9"
Jul 21 17:07:05.330503 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:05.330486    2578 scope.go:117] "RemoveContainer" containerID="c542e7128f631dc6fdf487be9807d07d2fc4031e574e766fadfb3545586f40b9"
Jul 21 17:07:05.330787 ip-10-0-130-171 kubenswrapper[2578]: E0721 17:07:05.330769    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c542e7128f631dc6fdf487be9807d07d2fc4031e574e766fadfb3545586f40b9\": container with ID starting with c542e7128f631dc6fdf487be9807d07d2fc4031e574e766fadfb3545586f40b9 not found: ID does not exist" containerID="c542e7128f631dc6fdf487be9807d07d2fc4031e574e766fadfb3545586f40b9"
Jul 21 17:07:05.330861 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:05.330793    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c542e7128f631dc6fdf487be9807d07d2fc4031e574e766fadfb3545586f40b9"} err="failed to get container status \"c542e7128f631dc6fdf487be9807d07d2fc4031e574e766fadfb3545586f40b9\": rpc error: code = NotFound desc = could not find container \"c542e7128f631dc6fdf487be9807d07d2fc4031e574e766fadfb3545586f40b9\": container with ID starting with c542e7128f631dc6fdf487be9807d07d2fc4031e574e766fadfb3545586f40b9 not found: ID does not exist"
Jul 21 17:07:05.346848 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:05.346828    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"]
Jul 21 17:07:05.356523 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:05.356502    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0f9eb0-577f497fc6-cthsz"]
Jul 21 17:07:05.582859 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:05.582778    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7096d348-de64-48f6-a0a3-171ed3127e7a" path="/var/lib/kubelet/pods/7096d348-de64-48f6-a0a3-171ed3127e7a/volumes"
Jul 21 17:07:09.243520 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:09.243482    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw"]
Jul 21 17:07:09.246058 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:09.246031    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f9eb0-skklw"]
Jul 21 17:07:09.582962 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:09.582885    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f0d6a37-4d10-47a8-814f-ee9d459f3def" path="/var/lib/kubelet/pods/2f0d6a37-4d10-47a8-814f-ee9d459f3def/volumes"
Jul 21 17:07:19.757310 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.757271    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"]
Jul 21 17:07:19.757909 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.757841    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7096d348-de64-48f6-a0a3-171ed3127e7a" containerName="maas-api"
Jul 21 17:07:19.757909 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.757862    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7096d348-de64-48f6-a0a3-171ed3127e7a" containerName="maas-api"
Jul 21 17:07:19.757909 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.757878    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0d6a37-4d10-47a8-814f-ee9d459f3def" containerName="revoke-keys"
Jul 21 17:07:19.757909 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.757887    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0d6a37-4d10-47a8-814f-ee9d459f3def" containerName="revoke-keys"
Jul 21 17:07:19.758124 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.758012    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7096d348-de64-48f6-a0a3-171ed3127e7a" containerName="maas-api"
Jul 21 17:07:19.758124 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.758026    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0d6a37-4d10-47a8-814f-ee9d459f3def" containerName="revoke-keys"
Jul 21 17:07:19.761142 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.761121    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:07:19.763503 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.763485    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-ef71cb-serving-cert\""
Jul 21 17:07:19.773941 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.773919    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"]
Jul 21 17:07:19.814565 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.814536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21146e2b-e0e5-40b0-a410-73d7e61f30ff-maas-api-tls\") pod \"maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8\" (UID: \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:07:19.814772 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.814580    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqlb4\" (UniqueName: \"kubernetes.io/projected/21146e2b-e0e5-40b0-a410-73d7e61f30ff-kube-api-access-lqlb4\") pod \"maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8\" (UID: \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:07:19.814772 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.814667    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21146e2b-e0e5-40b0-a410-73d7e61f30ff-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8\" (UID: \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:07:19.915808 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.915770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21146e2b-e0e5-40b0-a410-73d7e61f30ff-maas-api-tls\") pod \"maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8\" (UID: \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:07:19.915808 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.915813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqlb4\" (UniqueName: \"kubernetes.io/projected/21146e2b-e0e5-40b0-a410-73d7e61f30ff-kube-api-access-lqlb4\") pod \"maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8\" (UID: \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:07:19.916017 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.915837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21146e2b-e0e5-40b0-a410-73d7e61f30ff-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8\" (UID: \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:07:19.916017 ip-10-0-130-171 kubenswrapper[2578]: E0721 17:07:19.915940    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-serving-cert: secret "maas-api-e2e-shared-a-ef71cb-serving-cert" not found
Jul 21 17:07:19.916017 ip-10-0-130-171 kubenswrapper[2578]: E0721 17:07:19.916011    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21146e2b-e0e5-40b0-a410-73d7e61f30ff-maas-api-tls podName:21146e2b-e0e5-40b0-a410-73d7e61f30ff nodeName:}" failed. No retries permitted until 2026-07-21 17:07:20.415991046 +0000 UTC m=+2619.354299489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/21146e2b-e0e5-40b0-a410-73d7e61f30ff-maas-api-tls") pod "maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8" (UID: "21146e2b-e0e5-40b0-a410-73d7e61f30ff") : secret "maas-api-e2e-shared-a-ef71cb-serving-cert" not found
Jul 21 17:07:19.916430 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.916412    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21146e2b-e0e5-40b0-a410-73d7e61f30ff-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8\" (UID: \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:07:19.934096 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:19.934067    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqlb4\" (UniqueName: \"kubernetes.io/projected/21146e2b-e0e5-40b0-a410-73d7e61f30ff-kube-api-access-lqlb4\") pod \"maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8\" (UID: \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:07:20.420899 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:20.420861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21146e2b-e0e5-40b0-a410-73d7e61f30ff-maas-api-tls\") pod \"maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8\" (UID: \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:07:20.423281 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:20.423257    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21146e2b-e0e5-40b0-a410-73d7e61f30ff-maas-api-tls\") pod \"maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8\" (UID: \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:07:20.671151 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:20.671051    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:07:20.805250 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:20.805216    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"]
Jul 21 17:07:20.807803 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:07:20.807766    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21146e2b_e0e5_40b0_a410_73d7e61f30ff.slice/crio-cc3f1b0e755eab1719fddebfe539366a7e099187cd84fe0afd8eaff72e467818 WatchSource:0}: Error finding container cc3f1b0e755eab1719fddebfe539366a7e099187cd84fe0afd8eaff72e467818: Status 404 returned error can't find the container with id cc3f1b0e755eab1719fddebfe539366a7e099187cd84fe0afd8eaff72e467818
Jul 21 17:07:21.401941 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:21.401912    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8" event={"ID":"21146e2b-e0e5-40b0-a410-73d7e61f30ff","Type":"ContainerStarted","Data":"cc3f1b0e755eab1719fddebfe539366a7e099187cd84fe0afd8eaff72e467818"}
Jul 21 17:07:22.408357 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:22.408324    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8" event={"ID":"21146e2b-e0e5-40b0-a410-73d7e61f30ff","Type":"ContainerStarted","Data":"75a70db8cf345c3c2ad5f19b2135896395ff551f618f6b2cbfb2194ec51574bc"}
Jul 21 17:07:22.408851 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:22.408466    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:07:22.432816 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:22.432768    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8" podStartSLOduration=2.86854751 podStartE2EDuration="3.432752832s" totalImagesPullingTime="564.205322ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:07:22.430928586 +0000 UTC m=+2621.369237036" watchObservedRunningTime="2026-07-21 17:07:22.432752832 +0000 UTC m=+2621.371061280"
Jul 21 17:07:28.202873 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.202838    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"]
Jul 21 17:07:28.206480 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.206462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:07:28.214484 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.214460    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-b04ffb-serving-cert\""
Jul 21 17:07:28.233056 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.233030    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"]
Jul 21 17:07:28.293542 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.293516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddx2w\" (UniqueName: \"kubernetes.io/projected/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-kube-api-access-ddx2w\") pod \"maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj\" (UID: \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:07:28.293677 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.293556    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj\" (UID: \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:07:28.293727 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.293681    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-maas-api-tls\") pod \"maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj\" (UID: \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:07:28.394423 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.394385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-maas-api-tls\") pod \"maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj\" (UID: \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:07:28.394620 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.394435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddx2w\" (UniqueName: \"kubernetes.io/projected/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-kube-api-access-ddx2w\") pod \"maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj\" (UID: \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:07:28.394620 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.394551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj\" (UID: \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:07:28.395192 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.395174    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj\" (UID: \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:07:28.396833 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.396813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-maas-api-tls\") pod \"maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj\" (UID: \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:07:28.408140 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.408119    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddx2w\" (UniqueName: \"kubernetes.io/projected/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-kube-api-access-ddx2w\") pod \"maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj\" (UID: \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:07:28.421496 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.421478    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:07:28.516113 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.516040    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:07:28.679575 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:28.679543    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"]
Jul 21 17:07:28.681465 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:07:28.681428    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e663c22_b1d9_4c3c_82aa_f6a987ab6b3e.slice/crio-f35cb7d547eb2859ad02a9c4c7b63dcb97b6d699fca29ce25f38aeb036b59703 WatchSource:0}: Error finding container f35cb7d547eb2859ad02a9c4c7b63dcb97b6d699fca29ce25f38aeb036b59703: Status 404 returned error can't find the container with id f35cb7d547eb2859ad02a9c4c7b63dcb97b6d699fca29ce25f38aeb036b59703
Jul 21 17:07:29.445707 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:29.445671    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj" event={"ID":"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e","Type":"ContainerStarted","Data":"ca8ea214fe21e686d72cb85656fd6b738eba306fe384001726e36decffd78949"}
Jul 21 17:07:29.446099 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:29.445756    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj" event={"ID":"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e","Type":"ContainerStarted","Data":"f35cb7d547eb2859ad02a9c4c7b63dcb97b6d699fca29ce25f38aeb036b59703"}
Jul 21 17:07:29.446099 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:29.445793    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:07:29.466396 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:29.466343    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj" podStartSLOduration=1.1472692150000001 podStartE2EDuration="1.466328479s" totalImagesPullingTime="319.059264ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:07:29.466139171 +0000 UTC m=+2628.404447619" watchObservedRunningTime="2026-07-21 17:07:29.466328479 +0000 UTC m=+2628.404636924"
Jul 21 17:07:35.456469 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:35.456438    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:07:41.821077 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:07:41.820963    2578 scope.go:117] "RemoveContainer" containerID="5bb3056e5b0681839067bb3633915a2f6ed8b10e0d375c6d6345a20fe380cc0e"
Jul 21 17:08:42.510529 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.510446    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"]
Jul 21 17:08:42.513556 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.513538    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.520353 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.520325    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b04ffb\"/\"openshift-service-ca.crt\""
Jul 21 17:08:42.520472 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.520348    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b04ffb\"/\"default-dockercfg-784cf\""
Jul 21 17:08:42.520472 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.520388    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b04ffb\"/\"kube-root-ca.crt\""
Jul 21 17:08:42.521238 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.521219    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b04ffb\"/\"auth-test-model-b04ffb-kserve-self-signed-certs\""
Jul 21 17:08:42.530452 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.530431    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"]
Jul 21 17:08:42.559039 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.559004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-model-cache\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.559039 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.559035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-dshm\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.559282 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.559058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-tmp-dir\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.559282 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.559120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn4gk\" (UniqueName: \"kubernetes.io/projected/76dc3950-99e6-4c99-aba1-279ab9ed1d25-kube-api-access-fn4gk\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.559282 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.559153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-home\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.559427 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.559273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76dc3950-99e6-4c99-aba1-279ab9ed1d25-tls-certs\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.660598 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.660566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn4gk\" (UniqueName: \"kubernetes.io/projected/76dc3950-99e6-4c99-aba1-279ab9ed1d25-kube-api-access-fn4gk\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.660764 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.660608    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-home\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.660828 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.660753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76dc3950-99e6-4c99-aba1-279ab9ed1d25-tls-certs\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.660865 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.660830    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-model-cache\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.660865 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.660857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-dshm\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.660964 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.660889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-tmp-dir\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.661182 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.661159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-home\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.661258 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.661190    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-model-cache\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.661258 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.661211    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-tmp-dir\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.663068 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.663042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-dshm\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.663229 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.663211    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76dc3950-99e6-4c99-aba1-279ab9ed1d25-tls-certs\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.669920 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.669900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn4gk\" (UniqueName: \"kubernetes.io/projected/76dc3950-99e6-4c99-aba1-279ab9ed1d25-kube-api-access-fn4gk\") pod \"auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") " pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.822457 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.822389    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:42.962404 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:42.962376    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"]
Jul 21 17:08:42.964739 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:08:42.964712    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76dc3950_99e6_4c99_aba1_279ab9ed1d25.slice/crio-ea7bec498ed2f886ea19b67208635d4b9a4fe27ff0dff2884b5acbacea46c3e6 WatchSource:0}: Error finding container ea7bec498ed2f886ea19b67208635d4b9a4fe27ff0dff2884b5acbacea46c3e6: Status 404 returned error can't find the container with id ea7bec498ed2f886ea19b67208635d4b9a4fe27ff0dff2884b5acbacea46c3e6
Jul 21 17:08:43.805391 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:43.805354    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4" event={"ID":"76dc3950-99e6-4c99-aba1-279ab9ed1d25","Type":"ContainerStarted","Data":"fffd419b884103aedce31e9b2f0f6f385db025dc95c4ac0be1fe6a99c895f786"}
Jul 21 17:08:43.805391 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:43.805396    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4" event={"ID":"76dc3950-99e6-4c99-aba1-279ab9ed1d25","Type":"ContainerStarted","Data":"ea7bec498ed2f886ea19b67208635d4b9a4fe27ff0dff2884b5acbacea46c3e6"}
Jul 21 17:08:43.828266 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:43.828208    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4" podStartSLOduration=1.828189933 podStartE2EDuration="1.828189933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:43.8252795 +0000 UTC m=+2702.763587950" watchObservedRunningTime="2026-07-21 17:08:43.828189933 +0000 UTC m=+2702.766498384"
Jul 21 17:08:52.823104 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:52.823055    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:52.823104 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:52.823111    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:52.835675 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:52.835630    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:08:52.864617 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:08:52.864589    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:10:38.376983 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:38.376895    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"]
Jul 21 17:10:49.810060 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:49.810024    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"]
Jul 21 17:10:49.813902 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:49.813881    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:49.821951 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:49.821932    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ef71cb\"/\"default-dockercfg-fgdcv\""
Jul 21 17:10:49.822059 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:49.821958    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ef71cb\"/\"openshift-service-ca.crt\""
Jul 21 17:10:49.822059 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:49.821936    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ef71cb\"/\"kube-root-ca.crt\""
Jul 21 17:10:49.822059 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:49.821985    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ef71cb\"/\"sub-test-model-ef71cb-kserve-self-signed-certs\""
Jul 21 17:10:49.826999 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:49.826978    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"]
Jul 21 17:10:49.900259 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:49.900224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df2c8eef-9887-4ab8-9f38-11e26aac3b83-tls-certs\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:49.900436 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:49.900264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-dshm\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:49.900436 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:49.900335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-home\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:49.900436 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:49.900392    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjgft\" (UniqueName: \"kubernetes.io/projected/df2c8eef-9887-4ab8-9f38-11e26aac3b83-kube-api-access-qjgft\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:49.900436 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:49.900416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-model-cache\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:49.900574 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:49.900498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-tmp-dir\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:50.001078 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.001043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-dshm\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:50.001265 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.001092    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-home\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:50.001265 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.001154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjgft\" (UniqueName: \"kubernetes.io/projected/df2c8eef-9887-4ab8-9f38-11e26aac3b83-kube-api-access-qjgft\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:50.001265 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.001187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-model-cache\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:50.001459 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.001274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-tmp-dir\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:50.001459 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.001333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df2c8eef-9887-4ab8-9f38-11e26aac3b83-tls-certs\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:50.001563 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.001509    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-home\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:50.001603 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.001583    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-model-cache\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:50.001714 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.001697    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-tmp-dir\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:50.003318 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.003292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-dshm\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:50.003723 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.003706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df2c8eef-9887-4ab8-9f38-11e26aac3b83-tls-certs\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:50.014263 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.011517    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjgft\" (UniqueName: \"kubernetes.io/projected/df2c8eef-9887-4ab8-9f38-11e26aac3b83-kube-api-access-qjgft\") pod \"sub-test-model-ef71cb-kserve-5b99649d67-sxp69\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") " pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:50.123455 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.123412    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:10:50.254175 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.253949    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"]
Jul 21 17:10:50.256627 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:10:50.256600    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf2c8eef_9887_4ab8_9f38_11e26aac3b83.slice/crio-200cf2c717e30a2aef23a955e78bb5d73c7ead8bf932bc5936a90ed268d1f109 WatchSource:0}: Error finding container 200cf2c717e30a2aef23a955e78bb5d73c7ead8bf932bc5936a90ed268d1f109: Status 404 returned error can't find the container with id 200cf2c717e30a2aef23a955e78bb5d73c7ead8bf932bc5936a90ed268d1f109
Jul 21 17:10:50.432464 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.432369    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69" event={"ID":"df2c8eef-9887-4ab8-9f38-11e26aac3b83","Type":"ContainerStarted","Data":"1bc5de08f950de54ff1f1b3ca14f8f3713e40e59a902db335e56d59a48e9ac68"}
Jul 21 17:10:50.432464 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.432415    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69" event={"ID":"df2c8eef-9887-4ab8-9f38-11e26aac3b83","Type":"ContainerStarted","Data":"200cf2c717e30a2aef23a955e78bb5d73c7ead8bf932bc5936a90ed268d1f109"}
Jul 21 17:10:50.455162 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:50.455105    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69" podStartSLOduration=1.455087677 podStartE2EDuration="1.455087677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:10:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:10:50.453473619 +0000 UTC m=+2829.391782066" watchObservedRunningTime="2026-07-21 17:10:50.455087677 +0000 UTC m=+2829.393396129"
Jul 21 17:10:53.396711 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.396670    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4" podUID="76dc3950-99e6-4c99-aba1-279ab9ed1d25" containerName="main" containerID="cri-o://fffd419b884103aedce31e9b2f0f6f385db025dc95c4ac0be1fe6a99c895f786" gracePeriod=45
Jul 21 17:10:53.649763 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.649702    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:10:53.735666 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.735622    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-dshm\") pod \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") "
Jul 21 17:10:53.735797 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.735672    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-home\") pod \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") "
Jul 21 17:10:53.735797 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.735699    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-tmp-dir\") pod \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") "
Jul 21 17:10:53.735797 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.735723    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76dc3950-99e6-4c99-aba1-279ab9ed1d25-tls-certs\") pod \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") "
Jul 21 17:10:53.735797 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.735757    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn4gk\" (UniqueName: \"kubernetes.io/projected/76dc3950-99e6-4c99-aba1-279ab9ed1d25-kube-api-access-fn4gk\") pod \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") "
Jul 21 17:10:53.735961 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.735865    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-model-cache\") pod \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\" (UID: \"76dc3950-99e6-4c99-aba1-279ab9ed1d25\") "
Jul 21 17:10:53.736020 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.735962    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "76dc3950-99e6-4c99-aba1-279ab9ed1d25" (UID: "76dc3950-99e6-4c99-aba1-279ab9ed1d25"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:10:53.736020 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.735979    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-home" (OuterVolumeSpecName: "home") pod "76dc3950-99e6-4c99-aba1-279ab9ed1d25" (UID: "76dc3950-99e6-4c99-aba1-279ab9ed1d25"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:10:53.736184 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.736162    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-model-cache" (OuterVolumeSpecName: "model-cache") pod "76dc3950-99e6-4c99-aba1-279ab9ed1d25" (UID: "76dc3950-99e6-4c99-aba1-279ab9ed1d25"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:10:53.736265 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.736230    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:10:53.736265 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.736244    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:10:53.736265 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.736254    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:10:53.737684 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.737662    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-dshm" (OuterVolumeSpecName: "dshm") pod "76dc3950-99e6-4c99-aba1-279ab9ed1d25" (UID: "76dc3950-99e6-4c99-aba1-279ab9ed1d25"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:10:53.738124 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.738103    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76dc3950-99e6-4c99-aba1-279ab9ed1d25-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "76dc3950-99e6-4c99-aba1-279ab9ed1d25" (UID: "76dc3950-99e6-4c99-aba1-279ab9ed1d25"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:10:53.738189 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.738119    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76dc3950-99e6-4c99-aba1-279ab9ed1d25-kube-api-access-fn4gk" (OuterVolumeSpecName: "kube-api-access-fn4gk") pod "76dc3950-99e6-4c99-aba1-279ab9ed1d25" (UID: "76dc3950-99e6-4c99-aba1-279ab9ed1d25"). InnerVolumeSpecName "kube-api-access-fn4gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:10:53.837165 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.837143    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76dc3950-99e6-4c99-aba1-279ab9ed1d25-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:10:53.837165 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.837163    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76dc3950-99e6-4c99-aba1-279ab9ed1d25-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:10:53.837289 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:53.837173    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn4gk\" (UniqueName: \"kubernetes.io/projected/76dc3950-99e6-4c99-aba1-279ab9ed1d25-kube-api-access-fn4gk\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:10:54.451752 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:54.451722    2578 generic.go:356] "Generic (PLEG): container finished" podID="76dc3950-99e6-4c99-aba1-279ab9ed1d25" containerID="fffd419b884103aedce31e9b2f0f6f385db025dc95c4ac0be1fe6a99c895f786" exitCode=0
Jul 21 17:10:54.452141 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:54.451763    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"
Jul 21 17:10:54.452141 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:54.451807    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4" event={"ID":"76dc3950-99e6-4c99-aba1-279ab9ed1d25","Type":"ContainerDied","Data":"fffd419b884103aedce31e9b2f0f6f385db025dc95c4ac0be1fe6a99c895f786"}
Jul 21 17:10:54.452141 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:54.451853    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4" event={"ID":"76dc3950-99e6-4c99-aba1-279ab9ed1d25","Type":"ContainerDied","Data":"ea7bec498ed2f886ea19b67208635d4b9a4fe27ff0dff2884b5acbacea46c3e6"}
Jul 21 17:10:54.452141 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:54.451875    2578 scope.go:117] "RemoveContainer" containerID="fffd419b884103aedce31e9b2f0f6f385db025dc95c4ac0be1fe6a99c895f786"
Jul 21 17:10:54.461456 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:54.461438    2578 scope.go:117] "RemoveContainer" containerID="fffd419b884103aedce31e9b2f0f6f385db025dc95c4ac0be1fe6a99c895f786"
Jul 21 17:10:54.461725 ip-10-0-130-171 kubenswrapper[2578]: E0721 17:10:54.461700    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fffd419b884103aedce31e9b2f0f6f385db025dc95c4ac0be1fe6a99c895f786\": container with ID starting with fffd419b884103aedce31e9b2f0f6f385db025dc95c4ac0be1fe6a99c895f786 not found: ID does not exist" containerID="fffd419b884103aedce31e9b2f0f6f385db025dc95c4ac0be1fe6a99c895f786"
Jul 21 17:10:54.461831 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:54.461737    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fffd419b884103aedce31e9b2f0f6f385db025dc95c4ac0be1fe6a99c895f786"} err="failed to get container status \"fffd419b884103aedce31e9b2f0f6f385db025dc95c4ac0be1fe6a99c895f786\": rpc error: code = NotFound desc = could not find container \"fffd419b884103aedce31e9b2f0f6f385db025dc95c4ac0be1fe6a99c895f786\": container with ID starting with fffd419b884103aedce31e9b2f0f6f385db025dc95c4ac0be1fe6a99c895f786 not found: ID does not exist"
Jul 21 17:10:54.475538 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:54.475514    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"]
Jul 21 17:10:54.482786 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:54.482765    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b04ffb/auth-test-model-b04ffb-kserve-79b94bdb75-h6lh4"]
Jul 21 17:10:55.582812 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:10:55.582785    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76dc3950-99e6-4c99-aba1-279ab9ed1d25" path="/var/lib/kubelet/pods/76dc3950-99e6-4c99-aba1-279ab9ed1d25/volumes"
Jul 21 17:11:00.124255 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:11:00.124225    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:11:00.124736 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:11:00.124272    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:11:00.136674 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:11:00.136650    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:11:00.492899 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:11:00.492820    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:11:41.872394 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:11:41.872316    2578 scope.go:117] "RemoveContainer" containerID="77c499dcc7adb8222914b2aed635b5d9b600047b95478de416f44fe0d1d11e0f"
Jul 21 17:11:41.881441 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:11:41.881421    2578 scope.go:117] "RemoveContainer" containerID="fa47fab99e6b5cfb52479da85f098fc9f7266371e32c98185bb3d50b84b66bba"
Jul 21 17:12:07.433541 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:07.433507    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"]
Jul 21 17:12:20.600471 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.600435    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"]
Jul 21 17:12:20.600976 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.600889    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76dc3950-99e6-4c99-aba1-279ab9ed1d25" containerName="main"
Jul 21 17:12:20.600976 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.600902    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="76dc3950-99e6-4c99-aba1-279ab9ed1d25" containerName="main"
Jul 21 17:12:20.601059 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.600979    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="76dc3950-99e6-4c99-aba1-279ab9ed1d25" containerName="main"
Jul 21 17:12:20.604037 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.604020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.606459 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.606439    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ef71cb\"/\"rate-test-model-ef71cb-kserve-self-signed-certs\""
Jul 21 17:12:20.613212 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.613188    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"]
Jul 21 17:12:20.618222 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.618191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-home\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.618320 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.618248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd43fafa-e84d-4993-b5e0-eb417e13085b-tls-certs\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.618366 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.618323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-dshm\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.618427 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.618371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpq49\" (UniqueName: \"kubernetes.io/projected/cd43fafa-e84d-4993-b5e0-eb417e13085b-kube-api-access-mpq49\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.618481 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.618424    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-model-cache\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.618481 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.618469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-tmp-dir\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.719918 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.719875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-model-cache\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.719918 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.719918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-tmp-dir\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.720170 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.719951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-home\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.720170 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.719987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd43fafa-e84d-4993-b5e0-eb417e13085b-tls-certs\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.720170 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.720023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-dshm\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.720170 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.720063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpq49\" (UniqueName: \"kubernetes.io/projected/cd43fafa-e84d-4993-b5e0-eb417e13085b-kube-api-access-mpq49\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.720374 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.720287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-model-cache\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.720374 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.720355    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-tmp-dir\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.720483 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.720373    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-home\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.722385 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.722358    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-dshm\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.722504 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.722483    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd43fafa-e84d-4993-b5e0-eb417e13085b-tls-certs\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.729443 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.729420    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpq49\" (UniqueName: \"kubernetes.io/projected/cd43fafa-e84d-4993-b5e0-eb417e13085b-kube-api-access-mpq49\") pod \"rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") " pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:20.914071 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:20.913976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:21.058605 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:21.058578    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"]
Jul 21 17:12:21.060722 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:12:21.060686    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd43fafa_e84d_4993_b5e0_eb417e13085b.slice/crio-15cd6e0000ca5e1b8d54a986949a374cdff3c0f5a45fd76ca72ca889432bc71e WatchSource:0}: Error finding container 15cd6e0000ca5e1b8d54a986949a374cdff3c0f5a45fd76ca72ca889432bc71e: Status 404 returned error can't find the container with id 15cd6e0000ca5e1b8d54a986949a374cdff3c0f5a45fd76ca72ca889432bc71e
Jul 21 17:12:21.868995 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:21.868955    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd" event={"ID":"cd43fafa-e84d-4993-b5e0-eb417e13085b","Type":"ContainerStarted","Data":"30094d88488560c1ec1f5027c2a9dece341d9734d26a54a1b6d7feb67ba8c740"}
Jul 21 17:12:21.868995 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:21.868999    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd" event={"ID":"cd43fafa-e84d-4993-b5e0-eb417e13085b","Type":"ContainerStarted","Data":"15cd6e0000ca5e1b8d54a986949a374cdff3c0f5a45fd76ca72ca889432bc71e"}
Jul 21 17:12:21.885649 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:21.885585    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd" podStartSLOduration=1.885567998 podStartE2EDuration="1.885567998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:12:21.884982442 +0000 UTC m=+2920.823290903" watchObservedRunningTime="2026-07-21 17:12:21.885567998 +0000 UTC m=+2920.823876446"
Jul 21 17:12:22.453675 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.453616    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69" podUID="df2c8eef-9887-4ab8-9f38-11e26aac3b83" containerName="main" containerID="cri-o://1bc5de08f950de54ff1f1b3ca14f8f3713e40e59a902db335e56d59a48e9ac68" gracePeriod=45
Jul 21 17:12:22.717356 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.717287    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:12:22.738036 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.738005    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-model-cache\") pod \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") "
Jul 21 17:12:22.738221 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.738071    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-dshm\") pod \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") "
Jul 21 17:12:22.738221 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.738111    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df2c8eef-9887-4ab8-9f38-11e26aac3b83-tls-certs\") pod \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") "
Jul 21 17:12:22.738221 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.738133    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-tmp-dir\") pod \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") "
Jul 21 17:12:22.738410 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.738324    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-model-cache" (OuterVolumeSpecName: "model-cache") pod "df2c8eef-9887-4ab8-9f38-11e26aac3b83" (UID: "df2c8eef-9887-4ab8-9f38-11e26aac3b83"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:12:22.738410 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.738369    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "df2c8eef-9887-4ab8-9f38-11e26aac3b83" (UID: "df2c8eef-9887-4ab8-9f38-11e26aac3b83"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:12:22.738410 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.738406    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-home\") pod \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") "
Jul 21 17:12:22.738556 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.738498    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjgft\" (UniqueName: \"kubernetes.io/projected/df2c8eef-9887-4ab8-9f38-11e26aac3b83-kube-api-access-qjgft\") pod \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\" (UID: \"df2c8eef-9887-4ab8-9f38-11e26aac3b83\") "
Jul 21 17:12:22.738752 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.738724    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-home" (OuterVolumeSpecName: "home") pod "df2c8eef-9887-4ab8-9f38-11e26aac3b83" (UID: "df2c8eef-9887-4ab8-9f38-11e26aac3b83"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:12:22.739389 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.739316    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:12:22.739389 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.739345    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:12:22.739389 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.739359    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:12:22.740739 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.740712    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-dshm" (OuterVolumeSpecName: "dshm") pod "df2c8eef-9887-4ab8-9f38-11e26aac3b83" (UID: "df2c8eef-9887-4ab8-9f38-11e26aac3b83"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:12:22.740920 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.740900    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df2c8eef-9887-4ab8-9f38-11e26aac3b83-kube-api-access-qjgft" (OuterVolumeSpecName: "kube-api-access-qjgft") pod "df2c8eef-9887-4ab8-9f38-11e26aac3b83" (UID: "df2c8eef-9887-4ab8-9f38-11e26aac3b83"). InnerVolumeSpecName "kube-api-access-qjgft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:12:22.740990 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.740962    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df2c8eef-9887-4ab8-9f38-11e26aac3b83-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "df2c8eef-9887-4ab8-9f38-11e26aac3b83" (UID: "df2c8eef-9887-4ab8-9f38-11e26aac3b83"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:12:22.840747 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.840706    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df2c8eef-9887-4ab8-9f38-11e26aac3b83-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:12:22.840747 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.840739    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df2c8eef-9887-4ab8-9f38-11e26aac3b83-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:12:22.840747 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.840753    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjgft\" (UniqueName: \"kubernetes.io/projected/df2c8eef-9887-4ab8-9f38-11e26aac3b83-kube-api-access-qjgft\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:12:22.874950 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.874914    2578 generic.go:356] "Generic (PLEG): container finished" podID="df2c8eef-9887-4ab8-9f38-11e26aac3b83" containerID="1bc5de08f950de54ff1f1b3ca14f8f3713e40e59a902db335e56d59a48e9ac68" exitCode=0
Jul 21 17:12:22.875411 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.874957    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"
Jul 21 17:12:22.875411 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.875000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69" event={"ID":"df2c8eef-9887-4ab8-9f38-11e26aac3b83","Type":"ContainerDied","Data":"1bc5de08f950de54ff1f1b3ca14f8f3713e40e59a902db335e56d59a48e9ac68"}
Jul 21 17:12:22.875411 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.875045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69" event={"ID":"df2c8eef-9887-4ab8-9f38-11e26aac3b83","Type":"ContainerDied","Data":"200cf2c717e30a2aef23a955e78bb5d73c7ead8bf932bc5936a90ed268d1f109"}
Jul 21 17:12:22.875411 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.875062    2578 scope.go:117] "RemoveContainer" containerID="1bc5de08f950de54ff1f1b3ca14f8f3713e40e59a902db335e56d59a48e9ac68"
Jul 21 17:12:22.887257 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.885183    2578 scope.go:117] "RemoveContainer" containerID="1bc5de08f950de54ff1f1b3ca14f8f3713e40e59a902db335e56d59a48e9ac68"
Jul 21 17:12:22.888384 ip-10-0-130-171 kubenswrapper[2578]: E0721 17:12:22.888350    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bc5de08f950de54ff1f1b3ca14f8f3713e40e59a902db335e56d59a48e9ac68\": container with ID starting with 1bc5de08f950de54ff1f1b3ca14f8f3713e40e59a902db335e56d59a48e9ac68 not found: ID does not exist" containerID="1bc5de08f950de54ff1f1b3ca14f8f3713e40e59a902db335e56d59a48e9ac68"
Jul 21 17:12:22.888501 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.888393    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bc5de08f950de54ff1f1b3ca14f8f3713e40e59a902db335e56d59a48e9ac68"} err="failed to get container status \"1bc5de08f950de54ff1f1b3ca14f8f3713e40e59a902db335e56d59a48e9ac68\": rpc error: code = NotFound desc = could not find container \"1bc5de08f950de54ff1f1b3ca14f8f3713e40e59a902db335e56d59a48e9ac68\": container with ID starting with 1bc5de08f950de54ff1f1b3ca14f8f3713e40e59a902db335e56d59a48e9ac68 not found: ID does not exist"
Jul 21 17:12:22.904033 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.903988    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"]
Jul 21 17:12:22.909085 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:22.909059    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/sub-test-model-ef71cb-kserve-5b99649d67-sxp69"]
Jul 21 17:12:23.583228 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:23.583193    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df2c8eef-9887-4ab8-9f38-11e26aac3b83" path="/var/lib/kubelet/pods/df2c8eef-9887-4ab8-9f38-11e26aac3b83/volumes"
Jul 21 17:12:30.914748 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:30.914704    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:30.915510 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:30.914761    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:30.927466 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:30.927444    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:12:31.930907 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:12:31.930869    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:13:29.431737 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:29.431631    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"]
Jul 21 17:13:40.233239 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:40.233205    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7715-140054353035600"]
Jul 21 17:13:40.233612 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:40.233579    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df2c8eef-9887-4ab8-9f38-11e26aac3b83" containerName="main"
Jul 21 17:13:40.233612 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:40.233592    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="df2c8eef-9887-4ab8-9f38-11e26aac3b83" containerName="main"
Jul 21 17:13:40.233703 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:40.233686    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="df2c8eef-9887-4ab8-9f38-11e26aac3b83" containerName="main"
Jul 21 17:13:40.241489 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:40.241226    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353035600"
Jul 21 17:13:40.243798 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:40.243774    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7715-140054353035600"]
Jul 21 17:13:40.244398 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:40.244377    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x2hln\""
Jul 21 17:13:40.361554 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:40.361523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nprxv\" (UniqueName: \"kubernetes.io/projected/dc58f7a4-6a2d-4339-8027-f13777a8f72d-kube-api-access-nprxv\") pod \"test-curl-7715-140054353035600\" (UID: \"dc58f7a4-6a2d-4339-8027-f13777a8f72d\") " pod="opendatahub/test-curl-7715-140054353035600"
Jul 21 17:13:40.462129 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:40.462092    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nprxv\" (UniqueName: \"kubernetes.io/projected/dc58f7a4-6a2d-4339-8027-f13777a8f72d-kube-api-access-nprxv\") pod \"test-curl-7715-140054353035600\" (UID: \"dc58f7a4-6a2d-4339-8027-f13777a8f72d\") " pod="opendatahub/test-curl-7715-140054353035600"
Jul 21 17:13:40.472584 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:40.472550    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nprxv\" (UniqueName: \"kubernetes.io/projected/dc58f7a4-6a2d-4339-8027-f13777a8f72d-kube-api-access-nprxv\") pod \"test-curl-7715-140054353035600\" (UID: \"dc58f7a4-6a2d-4339-8027-f13777a8f72d\") " pod="opendatahub/test-curl-7715-140054353035600"
Jul 21 17:13:40.552593 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:40.552524    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353035600"
Jul 21 17:13:40.891963 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:40.891937    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7715-140054353035600"]
Jul 21 17:13:40.894793 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:13:40.894767    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc58f7a4_6a2d_4339_8027_f13777a8f72d.slice/crio-b4b52ed0d2742083f577bc694dbeb01f29e54dc86d187ba9d683edc4edcb9f9b WatchSource:0}: Error finding container b4b52ed0d2742083f577bc694dbeb01f29e54dc86d187ba9d683edc4edcb9f9b: Status 404 returned error can't find the container with id b4b52ed0d2742083f577bc694dbeb01f29e54dc86d187ba9d683edc4edcb9f9b
Jul 21 17:13:40.895997 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:40.895977    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:13:41.271484 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:41.271390    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7715-140054353035600" event={"ID":"dc58f7a4-6a2d-4339-8027-f13777a8f72d","Type":"ContainerStarted","Data":"b4b52ed0d2742083f577bc694dbeb01f29e54dc86d187ba9d683edc4edcb9f9b"}
Jul 21 17:13:41.919787 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:41.919762    2578 scope.go:117] "RemoveContainer" containerID="6ac1c2f0e9fa5e06785750716f6a4fb7c5910c7cff28fe9e6931807ab69f5463"
Jul 21 17:13:42.278135 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:42.278049    2578 generic.go:356] "Generic (PLEG): container finished" podID="dc58f7a4-6a2d-4339-8027-f13777a8f72d" containerID="ce01939de4f5af4635c31b5e92d30d62a307b96a588f571da99063bb06bc69b4" exitCode=0
Jul 21 17:13:42.278519 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:42.278139    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7715-140054353035600" event={"ID":"dc58f7a4-6a2d-4339-8027-f13777a8f72d","Type":"ContainerDied","Data":"ce01939de4f5af4635c31b5e92d30d62a307b96a588f571da99063bb06bc69b4"}
Jul 21 17:13:43.420745 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:43.420708    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353035600"
Jul 21 17:13:43.458595 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:43.458546    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7715-140054353035600_dc58f7a4-6a2d-4339-8027-f13777a8f72d/test-curl-7715-140054353035600/0.log"
Jul 21 17:13:43.482265 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:43.482234    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7715-140054353035600"]
Jul 21 17:13:43.486198 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:43.486165    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7715-140054353035600"]
Jul 21 17:13:43.489716 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:43.489697    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nprxv\" (UniqueName: \"kubernetes.io/projected/dc58f7a4-6a2d-4339-8027-f13777a8f72d-kube-api-access-nprxv\") pod \"dc58f7a4-6a2d-4339-8027-f13777a8f72d\" (UID: \"dc58f7a4-6a2d-4339-8027-f13777a8f72d\") "
Jul 21 17:13:43.491875 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:43.491849    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc58f7a4-6a2d-4339-8027-f13777a8f72d-kube-api-access-nprxv" (OuterVolumeSpecName: "kube-api-access-nprxv") pod "dc58f7a4-6a2d-4339-8027-f13777a8f72d" (UID: "dc58f7a4-6a2d-4339-8027-f13777a8f72d"). InnerVolumeSpecName "kube-api-access-nprxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:13:43.583158 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:43.583080    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc58f7a4-6a2d-4339-8027-f13777a8f72d" path="/var/lib/kubelet/pods/dc58f7a4-6a2d-4339-8027-f13777a8f72d/volumes"
Jul 21 17:13:43.593485 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:43.593450    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nprxv\" (UniqueName: \"kubernetes.io/projected/dc58f7a4-6a2d-4339-8027-f13777a8f72d-kube-api-access-nprxv\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:13:44.288579 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.288547    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353035600"
Jul 21 17:13:44.288579 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.288572    2578 scope.go:117] "RemoveContainer" containerID="ce01939de4f5af4635c31b5e92d30d62a307b96a588f571da99063bb06bc69b4"
Jul 21 17:13:44.450815 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.450779    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd" podUID="cd43fafa-e84d-4993-b5e0-eb417e13085b" containerName="main" containerID="cri-o://30094d88488560c1ec1f5027c2a9dece341d9734d26a54a1b6d7feb67ba8c740" gracePeriod=45
Jul 21 17:13:44.703465 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.703440    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:13:44.800578 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.800550    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd43fafa-e84d-4993-b5e0-eb417e13085b-tls-certs\") pod \"cd43fafa-e84d-4993-b5e0-eb417e13085b\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") "
Jul 21 17:13:44.800728 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.800606    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-home\") pod \"cd43fafa-e84d-4993-b5e0-eb417e13085b\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") "
Jul 21 17:13:44.800728 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.800661    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpq49\" (UniqueName: \"kubernetes.io/projected/cd43fafa-e84d-4993-b5e0-eb417e13085b-kube-api-access-mpq49\") pod \"cd43fafa-e84d-4993-b5e0-eb417e13085b\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") "
Jul 21 17:13:44.800728 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.800684    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-model-cache\") pod \"cd43fafa-e84d-4993-b5e0-eb417e13085b\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") "
Jul 21 17:13:44.800728 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.800707    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-tmp-dir\") pod \"cd43fafa-e84d-4993-b5e0-eb417e13085b\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") "
Jul 21 17:13:44.800950 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.800741    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-dshm\") pod \"cd43fafa-e84d-4993-b5e0-eb417e13085b\" (UID: \"cd43fafa-e84d-4993-b5e0-eb417e13085b\") "
Jul 21 17:13:44.800950 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.800904    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-home" (OuterVolumeSpecName: "home") pod "cd43fafa-e84d-4993-b5e0-eb417e13085b" (UID: "cd43fafa-e84d-4993-b5e0-eb417e13085b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:13:44.801057 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.800996    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-model-cache" (OuterVolumeSpecName: "model-cache") pod "cd43fafa-e84d-4993-b5e0-eb417e13085b" (UID: "cd43fafa-e84d-4993-b5e0-eb417e13085b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:13:44.801057 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.801012    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cd43fafa-e84d-4993-b5e0-eb417e13085b" (UID: "cd43fafa-e84d-4993-b5e0-eb417e13085b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:13:44.801057 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.801041    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:13:44.802690 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.802659    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd43fafa-e84d-4993-b5e0-eb417e13085b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cd43fafa-e84d-4993-b5e0-eb417e13085b" (UID: "cd43fafa-e84d-4993-b5e0-eb417e13085b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:13:44.802783 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.802710    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-dshm" (OuterVolumeSpecName: "dshm") pod "cd43fafa-e84d-4993-b5e0-eb417e13085b" (UID: "cd43fafa-e84d-4993-b5e0-eb417e13085b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:13:44.802783 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.802717    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd43fafa-e84d-4993-b5e0-eb417e13085b-kube-api-access-mpq49" (OuterVolumeSpecName: "kube-api-access-mpq49") pod "cd43fafa-e84d-4993-b5e0-eb417e13085b" (UID: "cd43fafa-e84d-4993-b5e0-eb417e13085b"). InnerVolumeSpecName "kube-api-access-mpq49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:13:44.901423 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.901400    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd43fafa-e84d-4993-b5e0-eb417e13085b-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:13:44.901423 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.901421    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpq49\" (UniqueName: \"kubernetes.io/projected/cd43fafa-e84d-4993-b5e0-eb417e13085b-kube-api-access-mpq49\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:13:44.901568 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.901431    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:13:44.901568 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.901442    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:13:44.901568 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:44.901449    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd43fafa-e84d-4993-b5e0-eb417e13085b-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:13:45.294525 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:45.294442    2578 generic.go:356] "Generic (PLEG): container finished" podID="cd43fafa-e84d-4993-b5e0-eb417e13085b" containerID="30094d88488560c1ec1f5027c2a9dece341d9734d26a54a1b6d7feb67ba8c740" exitCode=0
Jul 21 17:13:45.294525 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:45.294480    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"
Jul 21 17:13:45.294525 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:45.294486    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd" event={"ID":"cd43fafa-e84d-4993-b5e0-eb417e13085b","Type":"ContainerDied","Data":"30094d88488560c1ec1f5027c2a9dece341d9734d26a54a1b6d7feb67ba8c740"}
Jul 21 17:13:45.294788 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:45.294529    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd" event={"ID":"cd43fafa-e84d-4993-b5e0-eb417e13085b","Type":"ContainerDied","Data":"15cd6e0000ca5e1b8d54a986949a374cdff3c0f5a45fd76ca72ca889432bc71e"}
Jul 21 17:13:45.294788 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:45.294549    2578 scope.go:117] "RemoveContainer" containerID="30094d88488560c1ec1f5027c2a9dece341d9734d26a54a1b6d7feb67ba8c740"
Jul 21 17:13:45.303476 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:45.303460    2578 scope.go:117] "RemoveContainer" containerID="30094d88488560c1ec1f5027c2a9dece341d9734d26a54a1b6d7feb67ba8c740"
Jul 21 17:13:45.303741 ip-10-0-130-171 kubenswrapper[2578]: E0721 17:13:45.303723    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30094d88488560c1ec1f5027c2a9dece341d9734d26a54a1b6d7feb67ba8c740\": container with ID starting with 30094d88488560c1ec1f5027c2a9dece341d9734d26a54a1b6d7feb67ba8c740 not found: ID does not exist" containerID="30094d88488560c1ec1f5027c2a9dece341d9734d26a54a1b6d7feb67ba8c740"
Jul 21 17:13:45.303814 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:45.303749    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30094d88488560c1ec1f5027c2a9dece341d9734d26a54a1b6d7feb67ba8c740"} err="failed to get container status \"30094d88488560c1ec1f5027c2a9dece341d9734d26a54a1b6d7feb67ba8c740\": rpc error: code = NotFound desc = could not find container \"30094d88488560c1ec1f5027c2a9dece341d9734d26a54a1b6d7feb67ba8c740\": container with ID starting with 30094d88488560c1ec1f5027c2a9dece341d9734d26a54a1b6d7feb67ba8c740 not found: ID does not exist"
Jul 21 17:13:45.316540 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:45.316518    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"]
Jul 21 17:13:45.320888 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:45.320869    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ef71cb/rate-test-model-ef71cb-kserve-7c5649dc5-9ndsd"]
Jul 21 17:13:45.582360 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:45.582264    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd43fafa-e84d-4993-b5e0-eb417e13085b" path="/var/lib/kubelet/pods/cd43fafa-e84d-4993-b5e0-eb417e13085b/volumes"
Jul 21 17:13:46.288777 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.288741    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7715-140054353122336"]
Jul 21 17:13:46.289179 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.289165    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc58f7a4-6a2d-4339-8027-f13777a8f72d" containerName="test-curl-7715-140054353035600"
Jul 21 17:13:46.289227 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.289181    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc58f7a4-6a2d-4339-8027-f13777a8f72d" containerName="test-curl-7715-140054353035600"
Jul 21 17:13:46.289227 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.289210    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd43fafa-e84d-4993-b5e0-eb417e13085b" containerName="main"
Jul 21 17:13:46.289227 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.289216    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd43fafa-e84d-4993-b5e0-eb417e13085b" containerName="main"
Jul 21 17:13:46.289318 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.289277    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd43fafa-e84d-4993-b5e0-eb417e13085b" containerName="main"
Jul 21 17:13:46.289318 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.289289    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc58f7a4-6a2d-4339-8027-f13777a8f72d" containerName="test-curl-7715-140054353035600"
Jul 21 17:13:46.293512 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.293495    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:46.296800 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.296767    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x2hln\""
Jul 21 17:13:46.309244 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.309221    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7715-140054353122336"]
Jul 21 17:13:46.312322 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.312300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgpw2\" (UniqueName: \"kubernetes.io/projected/5765c37b-0a80-403c-93ad-2b05ffdc1766-kube-api-access-wgpw2\") pod \"test-curl-7715-140054353122336\" (UID: \"5765c37b-0a80-403c-93ad-2b05ffdc1766\") " pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:46.413136 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.413102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgpw2\" (UniqueName: \"kubernetes.io/projected/5765c37b-0a80-403c-93ad-2b05ffdc1766-kube-api-access-wgpw2\") pod \"test-curl-7715-140054353122336\" (UID: \"5765c37b-0a80-403c-93ad-2b05ffdc1766\") " pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:46.423658 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.423623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgpw2\" (UniqueName: \"kubernetes.io/projected/5765c37b-0a80-403c-93ad-2b05ffdc1766-kube-api-access-wgpw2\") pod \"test-curl-7715-140054353122336\" (UID: \"5765c37b-0a80-403c-93ad-2b05ffdc1766\") " pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:46.603240 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.603212    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:46.733204 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:46.733177    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7715-140054353122336"]
Jul 21 17:13:46.734982 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:13:46.734943    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5765c37b_0a80_403c_93ad_2b05ffdc1766.slice/crio-866b8110cc450809cc0dcb02c00a8d373922b3b7527ef0209aac476c2935a862 WatchSource:0}: Error finding container 866b8110cc450809cc0dcb02c00a8d373922b3b7527ef0209aac476c2935a862: Status 404 returned error can't find the container with id 866b8110cc450809cc0dcb02c00a8d373922b3b7527ef0209aac476c2935a862
Jul 21 17:13:47.308179 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:47.308092    2578 generic.go:356] "Generic (PLEG): container finished" podID="5765c37b-0a80-403c-93ad-2b05ffdc1766" containerID="761e3efe4c76e46b75f9d79d77244d1cd30737c5170144b300258a4ca168aa64" exitCode=0
Jul 21 17:13:47.308179 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:47.308133    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7715-140054353122336" event={"ID":"5765c37b-0a80-403c-93ad-2b05ffdc1766","Type":"ContainerDied","Data":"761e3efe4c76e46b75f9d79d77244d1cd30737c5170144b300258a4ca168aa64"}
Jul 21 17:13:47.308179 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:47.308164    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7715-140054353122336" event={"ID":"5765c37b-0a80-403c-93ad-2b05ffdc1766","Type":"ContainerStarted","Data":"866b8110cc450809cc0dcb02c00a8d373922b3b7527ef0209aac476c2935a862"}
Jul 21 17:13:48.447812 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.447782    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:48.475558 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.475533    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7715-140054353122336_5765c37b-0a80-403c-93ad-2b05ffdc1766/test-curl-7715-140054353122336/0.log"
Jul 21 17:13:48.500193 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.500163    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7715-140054353122336"]
Jul 21 17:13:48.507131 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.507108    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7715-140054353122336"]
Jul 21 17:13:48.532604 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.532578    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgpw2\" (UniqueName: \"kubernetes.io/projected/5765c37b-0a80-403c-93ad-2b05ffdc1766-kube-api-access-wgpw2\") pod \"5765c37b-0a80-403c-93ad-2b05ffdc1766\" (UID: \"5765c37b-0a80-403c-93ad-2b05ffdc1766\") "
Jul 21 17:13:48.534704 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.534679    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5765c37b-0a80-403c-93ad-2b05ffdc1766-kube-api-access-wgpw2" (OuterVolumeSpecName: "kube-api-access-wgpw2") pod "5765c37b-0a80-403c-93ad-2b05ffdc1766" (UID: "5765c37b-0a80-403c-93ad-2b05ffdc1766"). InnerVolumeSpecName "kube-api-access-wgpw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:13:48.634151 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.634114    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgpw2\" (UniqueName: \"kubernetes.io/projected/5765c37b-0a80-403c-93ad-2b05ffdc1766-kube-api-access-wgpw2\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:13:48.697500 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.697466    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v"]
Jul 21 17:13:48.697880 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.697865    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5765c37b-0a80-403c-93ad-2b05ffdc1766" containerName="test-curl-7715-140054353122336"
Jul 21 17:13:48.697880 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.697881    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5765c37b-0a80-403c-93ad-2b05ffdc1766" containerName="test-curl-7715-140054353122336"
Jul 21 17:13:48.697973 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.697960    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5765c37b-0a80-403c-93ad-2b05ffdc1766" containerName="test-curl-7715-140054353122336"
Jul 21 17:13:48.701139 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.701124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v"
Jul 21 17:13:48.705923 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.705902    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 17:13:48.712957 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.712932    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v"]
Jul 21 17:13:48.735245 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.735212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b39804-0e67-4144-b16a-9aaf03f3211a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v\" (UID: \"65b39804-0e67-4144-b16a-9aaf03f3211a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v"
Jul 21 17:13:48.835910 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.835876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b39804-0e67-4144-b16a-9aaf03f3211a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v\" (UID: \"65b39804-0e67-4144-b16a-9aaf03f3211a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v"
Jul 21 17:13:48.836530 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:48.836511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b39804-0e67-4144-b16a-9aaf03f3211a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v\" (UID: \"65b39804-0e67-4144-b16a-9aaf03f3211a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v"
Jul 21 17:13:49.012456 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:49.012372    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v"
Jul 21 17:13:49.147880 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:49.147851    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v"]
Jul 21 17:13:49.149814 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:13:49.149787    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b39804_0e67_4144_b16a_9aaf03f3211a.slice/crio-260f508d163b79e07d058ec0b0adba01e1e5153f8f5f93076d4b3211b7685363 WatchSource:0}: Error finding container 260f508d163b79e07d058ec0b0adba01e1e5153f8f5f93076d4b3211b7685363: Status 404 returned error can't find the container with id 260f508d163b79e07d058ec0b0adba01e1e5153f8f5f93076d4b3211b7685363
Jul 21 17:13:49.321555 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:49.321470    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="866b8110cc450809cc0dcb02c00a8d373922b3b7527ef0209aac476c2935a862"
Jul 21 17:13:49.321555 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:49.321481    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:49.322924 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:49.322887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v" event={"ID":"65b39804-0e67-4144-b16a-9aaf03f3211a","Type":"ContainerStarted","Data":"260f508d163b79e07d058ec0b0adba01e1e5153f8f5f93076d4b3211b7685363"}
Jul 21 17:13:49.349177 ip-10-0-130-171 kubenswrapper[2578]: E0721 17:13:49.349145    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7715-140054353122336\" is forbidden: User \"system:node:ip-10-0-130-171.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-171.ec2.internal' and this object" podUID="5765c37b-0a80-403c-93ad-2b05ffdc1766" pod="opendatahub/test-curl-7715-140054353122336"
Jul 21 17:13:49.582766 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:49.582687    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5765c37b-0a80-403c-93ad-2b05ffdc1766" path="/var/lib/kubelet/pods/5765c37b-0a80-403c-93ad-2b05ffdc1766/volumes"
Jul 21 17:13:50.329445 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:50.329405    2578 generic.go:356] "Generic (PLEG): container finished" podID="65b39804-0e67-4144-b16a-9aaf03f3211a" containerID="329b8b340de81dd53d9f28d56364e167e291fd45c2c6883d4e7364a02a7cc616" exitCode=0
Jul 21 17:13:50.329631 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:50.329492    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v" event={"ID":"65b39804-0e67-4144-b16a-9aaf03f3211a","Type":"ContainerDied","Data":"329b8b340de81dd53d9f28d56364e167e291fd45c2c6883d4e7364a02a7cc616"}
Jul 21 17:13:51.465917 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:51.465889    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v"
Jul 21 17:13:51.564446 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:51.564419    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b39804-0e67-4144-b16a-9aaf03f3211a-maas-api-service-ca\") pod \"65b39804-0e67-4144-b16a-9aaf03f3211a\" (UID: \"65b39804-0e67-4144-b16a-9aaf03f3211a\") "
Jul 21 17:13:51.564818 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:51.564794    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b39804-0e67-4144-b16a-9aaf03f3211a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "65b39804-0e67-4144-b16a-9aaf03f3211a" (UID: "65b39804-0e67-4144-b16a-9aaf03f3211a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:13:51.666000 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:51.665966    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b39804-0e67-4144-b16a-9aaf03f3211a-maas-api-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:13:52.340904 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:52.340860    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v"
Jul 21 17:13:52.341107 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:52.340864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v" event={"ID":"65b39804-0e67-4144-b16a-9aaf03f3211a","Type":"ContainerDied","Data":"260f508d163b79e07d058ec0b0adba01e1e5153f8f5f93076d4b3211b7685363"}
Jul 21 17:13:52.341107 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:52.340986    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="260f508d163b79e07d058ec0b0adba01e1e5153f8f5f93076d4b3211b7685363"
Jul 21 17:13:59.147528 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:59.147491    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"]
Jul 21 17:13:59.147978 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:59.147789    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8" podUID="21146e2b-e0e5-40b0-a410-73d7e61f30ff" containerName="maas-api" containerID="cri-o://75a70db8cf345c3c2ad5f19b2135896395ff551f618f6b2cbfb2194ec51574bc" gracePeriod=30
Jul 21 17:13:59.397394 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:59.397366    2578 generic.go:356] "Generic (PLEG): container finished" podID="21146e2b-e0e5-40b0-a410-73d7e61f30ff" containerID="75a70db8cf345c3c2ad5f19b2135896395ff551f618f6b2cbfb2194ec51574bc" exitCode=0
Jul 21 17:13:59.397564 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:59.397434    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8" event={"ID":"21146e2b-e0e5-40b0-a410-73d7e61f30ff","Type":"ContainerDied","Data":"75a70db8cf345c3c2ad5f19b2135896395ff551f618f6b2cbfb2194ec51574bc"}
Jul 21 17:13:59.416903 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:59.416879    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:13:59.533880 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:59.533851    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqlb4\" (UniqueName: \"kubernetes.io/projected/21146e2b-e0e5-40b0-a410-73d7e61f30ff-kube-api-access-lqlb4\") pod \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\" (UID: \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\") "
Jul 21 17:13:59.534088 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:59.533930    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21146e2b-e0e5-40b0-a410-73d7e61f30ff-maas-api-tls\") pod \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\" (UID: \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\") "
Jul 21 17:13:59.534088 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:59.533951    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21146e2b-e0e5-40b0-a410-73d7e61f30ff-openshift-service-ca\") pod \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\" (UID: \"21146e2b-e0e5-40b0-a410-73d7e61f30ff\") "
Jul 21 17:13:59.534397 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:59.534370    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21146e2b-e0e5-40b0-a410-73d7e61f30ff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "21146e2b-e0e5-40b0-a410-73d7e61f30ff" (UID: "21146e2b-e0e5-40b0-a410-73d7e61f30ff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:13:59.535924 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:59.535902    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21146e2b-e0e5-40b0-a410-73d7e61f30ff-kube-api-access-lqlb4" (OuterVolumeSpecName: "kube-api-access-lqlb4") pod "21146e2b-e0e5-40b0-a410-73d7e61f30ff" (UID: "21146e2b-e0e5-40b0-a410-73d7e61f30ff"). InnerVolumeSpecName "kube-api-access-lqlb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:13:59.536172 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:59.536146    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21146e2b-e0e5-40b0-a410-73d7e61f30ff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "21146e2b-e0e5-40b0-a410-73d7e61f30ff" (UID: "21146e2b-e0e5-40b0-a410-73d7e61f30ff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:13:59.634911 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:59.634862    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21146e2b-e0e5-40b0-a410-73d7e61f30ff-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:13:59.634911 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:59.634893    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21146e2b-e0e5-40b0-a410-73d7e61f30ff-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:13:59.634911 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:13:59.634908    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqlb4\" (UniqueName: \"kubernetes.io/projected/21146e2b-e0e5-40b0-a410-73d7e61f30ff-kube-api-access-lqlb4\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:14:00.403466 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:00.403432    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8" event={"ID":"21146e2b-e0e5-40b0-a410-73d7e61f30ff","Type":"ContainerDied","Data":"cc3f1b0e755eab1719fddebfe539366a7e099187cd84fe0afd8eaff72e467818"}
Jul 21 17:14:00.404047 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:00.403489    2578 scope.go:117] "RemoveContainer" containerID="75a70db8cf345c3c2ad5f19b2135896395ff551f618f6b2cbfb2194ec51574bc"
Jul 21 17:14:00.404047 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:00.403444    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"
Jul 21 17:14:00.431354 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:00.431324    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"]
Jul 21 17:14:00.438612 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:00.438584    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ef71cb-64c789dbd8-2xdn8"]
Jul 21 17:14:01.582629 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:01.582592    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21146e2b-e0e5-40b0-a410-73d7e61f30ff" path="/var/lib/kubelet/pods/21146e2b-e0e5-40b0-a410-73d7e61f30ff/volumes"
Jul 21 17:14:03.801288 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:03.801255    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v"]
Jul 21 17:14:03.803522 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:03.803498    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ef71cb-xgt8v"]
Jul 21 17:14:05.582444 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:05.582401    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65b39804-0e67-4144-b16a-9aaf03f3211a" path="/var/lib/kubelet/pods/65b39804-0e67-4144-b16a-9aaf03f3211a/volumes"
Jul 21 17:14:11.144862 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.144824    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb"]
Jul 21 17:14:11.145248 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.145211    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65b39804-0e67-4144-b16a-9aaf03f3211a" containerName="revoke-keys"
Jul 21 17:14:11.145248 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.145222    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="65b39804-0e67-4144-b16a-9aaf03f3211a" containerName="revoke-keys"
Jul 21 17:14:11.145248 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.145236    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21146e2b-e0e5-40b0-a410-73d7e61f30ff" containerName="maas-api"
Jul 21 17:14:11.145248 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.145243    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="21146e2b-e0e5-40b0-a410-73d7e61f30ff" containerName="maas-api"
Jul 21 17:14:11.145385 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.145294    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="21146e2b-e0e5-40b0-a410-73d7e61f30ff" containerName="maas-api"
Jul 21 17:14:11.145385 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.145304    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="65b39804-0e67-4144-b16a-9aaf03f3211a" containerName="revoke-keys"
Jul 21 17:14:11.149860 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.149842    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb"
Jul 21 17:14:11.152459 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.152428    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v8mqg\""
Jul 21 17:14:11.160080 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.160053    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb"]
Jul 21 17:14:11.239465 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.239430    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e25fcfe1-b845-44c2-af4b-7c158dde2e6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb\" (UID: \"e25fcfe1-b845-44c2-af4b-7c158dde2e6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb"
Jul 21 17:14:11.340242 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.340200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e25fcfe1-b845-44c2-af4b-7c158dde2e6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb\" (UID: \"e25fcfe1-b845-44c2-af4b-7c158dde2e6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb"
Jul 21 17:14:11.340909 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.340885    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e25fcfe1-b845-44c2-af4b-7c158dde2e6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb\" (UID: \"e25fcfe1-b845-44c2-af4b-7c158dde2e6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb"
Jul 21 17:14:11.460765 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.460692    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb"
Jul 21 17:14:11.592118 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:11.592075    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb"]
Jul 21 17:14:11.594068 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:14:11.594045    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25fcfe1_b845_44c2_af4b_7c158dde2e6a.slice/crio-cce18eb89eb17a25f7409b3c76db6eccf6d581ad78cd5f587c742220a1bd0f11 WatchSource:0}: Error finding container cce18eb89eb17a25f7409b3c76db6eccf6d581ad78cd5f587c742220a1bd0f11: Status 404 returned error can't find the container with id cce18eb89eb17a25f7409b3c76db6eccf6d581ad78cd5f587c742220a1bd0f11
Jul 21 17:14:12.460513 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:12.460485    2578 generic.go:356] "Generic (PLEG): container finished" podID="e25fcfe1-b845-44c2-af4b-7c158dde2e6a" containerID="0aed3b1ccf7f5100f6f18e8ed88d8d95eedec0e6e42ff62261cd7590b7f516e6" exitCode=0
Jul 21 17:14:12.460848 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:12.460529    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb" event={"ID":"e25fcfe1-b845-44c2-af4b-7c158dde2e6a","Type":"ContainerDied","Data":"0aed3b1ccf7f5100f6f18e8ed88d8d95eedec0e6e42ff62261cd7590b7f516e6"}
Jul 21 17:14:12.460848 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:12.460571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb" event={"ID":"e25fcfe1-b845-44c2-af4b-7c158dde2e6a","Type":"ContainerStarted","Data":"cce18eb89eb17a25f7409b3c76db6eccf6d581ad78cd5f587c742220a1bd0f11"}
Jul 21 17:14:13.598660 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:13.598623    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb"
Jul 21 17:14:13.659186 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:13.659157    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e25fcfe1-b845-44c2-af4b-7c158dde2e6a-maas-api-service-ca\") pod \"e25fcfe1-b845-44c2-af4b-7c158dde2e6a\" (UID: \"e25fcfe1-b845-44c2-af4b-7c158dde2e6a\") "
Jul 21 17:14:13.665244 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:13.659846    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e25fcfe1-b845-44c2-af4b-7c158dde2e6a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e25fcfe1-b845-44c2-af4b-7c158dde2e6a" (UID: "e25fcfe1-b845-44c2-af4b-7c158dde2e6a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:14:13.760537 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:13.760459    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e25fcfe1-b845-44c2-af4b-7c158dde2e6a-maas-api-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:14:14.471257 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:14.471226    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb"
Jul 21 17:14:14.471438 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:14.471256    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb" event={"ID":"e25fcfe1-b845-44c2-af4b-7c158dde2e6a","Type":"ContainerDied","Data":"cce18eb89eb17a25f7409b3c76db6eccf6d581ad78cd5f587c742220a1bd0f11"}
Jul 21 17:14:14.471438 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:14.471329    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cce18eb89eb17a25f7409b3c76db6eccf6d581ad78cd5f587c742220a1bd0f11"
Jul 21 17:14:21.697221 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:21.697186    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"]
Jul 21 17:14:21.697729 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:21.697390    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj" podUID="9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e" containerName="maas-api" containerID="cri-o://ca8ea214fe21e686d72cb85656fd6b738eba306fe384001726e36decffd78949" gracePeriod=30
Jul 21 17:14:21.940064 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:21.940040    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:14:22.031873 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.031772    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-maas-api-tls\") pod \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\" (UID: \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\") "
Jul 21 17:14:22.031873 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.031829    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-openshift-service-ca\") pod \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\" (UID: \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\") "
Jul 21 17:14:22.032068 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.032003    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddx2w\" (UniqueName: \"kubernetes.io/projected/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-kube-api-access-ddx2w\") pod \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\" (UID: \"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e\") "
Jul 21 17:14:22.032141 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.032124    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e" (UID: "9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:14:22.032347 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.032326    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:14:22.033832 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.033801    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e" (UID: "9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:14:22.033903 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.033861    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-kube-api-access-ddx2w" (OuterVolumeSpecName: "kube-api-access-ddx2w") pod "9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e" (UID: "9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e"). InnerVolumeSpecName "kube-api-access-ddx2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:14:22.132826 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.132797    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddx2w\" (UniqueName: \"kubernetes.io/projected/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-kube-api-access-ddx2w\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:14:22.132826 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.132822    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Jul 21 17:14:22.510722 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.510693    2578 generic.go:356] "Generic (PLEG): container finished" podID="9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e" containerID="ca8ea214fe21e686d72cb85656fd6b738eba306fe384001726e36decffd78949" exitCode=0
Jul 21 17:14:22.510899 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.510736    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"
Jul 21 17:14:22.510899 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.510750    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj" event={"ID":"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e","Type":"ContainerDied","Data":"ca8ea214fe21e686d72cb85656fd6b738eba306fe384001726e36decffd78949"}
Jul 21 17:14:22.510899 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.510794    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj" event={"ID":"9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e","Type":"ContainerDied","Data":"f35cb7d547eb2859ad02a9c4c7b63dcb97b6d699fca29ce25f38aeb036b59703"}
Jul 21 17:14:22.510899 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.510816    2578 scope.go:117] "RemoveContainer" containerID="ca8ea214fe21e686d72cb85656fd6b738eba306fe384001726e36decffd78949"
Jul 21 17:14:22.519632 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.519615    2578 scope.go:117] "RemoveContainer" containerID="ca8ea214fe21e686d72cb85656fd6b738eba306fe384001726e36decffd78949"
Jul 21 17:14:22.519904 ip-10-0-130-171 kubenswrapper[2578]: E0721 17:14:22.519884    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca8ea214fe21e686d72cb85656fd6b738eba306fe384001726e36decffd78949\": container with ID starting with ca8ea214fe21e686d72cb85656fd6b738eba306fe384001726e36decffd78949 not found: ID does not exist" containerID="ca8ea214fe21e686d72cb85656fd6b738eba306fe384001726e36decffd78949"
Jul 21 17:14:22.519973 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.519912    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8ea214fe21e686d72cb85656fd6b738eba306fe384001726e36decffd78949"} err="failed to get container status \"ca8ea214fe21e686d72cb85656fd6b738eba306fe384001726e36decffd78949\": rpc error: code = NotFound desc = could not find container \"ca8ea214fe21e686d72cb85656fd6b738eba306fe384001726e36decffd78949\": container with ID starting with ca8ea214fe21e686d72cb85656fd6b738eba306fe384001726e36decffd78949 not found: ID does not exist"
Jul 21 17:14:22.534839 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.534814    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"]
Jul 21 17:14:22.541136 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:22.541114    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b04ffb-546d464b9-7s5rj"]
Jul 21 17:14:23.582534 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:23.582499    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e" path="/var/lib/kubelet/pods/9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e/volumes"
Jul 21 17:14:26.222802 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:26.222765    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb"]
Jul 21 17:14:26.225967 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:26.225939    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b04ffb-8wtnb"]
Jul 21 17:14:27.582732 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:27.582694    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e25fcfe1-b845-44c2-af4b-7c158dde2e6a" path="/var/lib/kubelet/pods/e25fcfe1-b845-44c2-af4b-7c158dde2e6a/volumes"
Jul 21 17:14:33.399836 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:33.399801    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c5cd97c6b-7gjqs_19d671a0-1917-46e0-98ee-f300c750e6f9/authorino/0.log"
Jul 21 17:14:39.279670 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:39.279622    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw_87027c35-a390-4a15-8974-ed0fcc5d5e81/copy-manifests/0.log"
Jul 21 17:14:39.285884 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:39.285846    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw_87027c35-a390-4a15-8974-ed0fcc5d5e81/manager/0.log"
Jul 21 17:14:39.873122 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:39.873086    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-586b44c766-mmjwr_4e28c73f-1e5e-441b-80c0-609fd49b06d0/maas-api/0.log"
Jul 21 17:14:40.101701 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:40.101671    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744220-mqfgd_135cd884-970a-428f-a0d9-07a5eb7fd0b9/cleanup/0.log"
Jul 21 17:14:40.207733 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:40.207672    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-fpbtb_1be6aac8-1ccf-4027-9f09-a275c605db0b/postgres/0.log"
Jul 21 17:14:41.474616 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:41.474585    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c5cd97c6b-7gjqs_19d671a0-1917-46e0-98ee-f300c750e6f9/authorino/0.log"
Jul 21 17:14:43.058474 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:43.058444    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54864c54db-ht5cz_af4d4bc5-9002-4506-8df6-51a2647d6adc/kube-auth-proxy/0.log"
Jul 21 17:14:43.176804 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:43.176773    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2ttxt_54412d7d-1b0e-45d0-acee-ff70727ddc61/istio-proxy/1.log"
Jul 21 17:14:43.292412 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:43.292376    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-gp6vw_a20993eb-8122-4092-85f7-e44abd3d7fed/payload-pre-processing/0.log"
Jul 21 17:14:43.868658 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:43.868604    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-sptlv_8dde2ab9-c66f-40a5-ba95-6faf9ece8297/main/0.log"
Jul 21 17:14:43.986883 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:43.986849    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-4lxr9_64bfbbc4-f650-487b-a403-e7b5ed9759cf/main/0.log"
Jul 21 17:14:49.989910 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:49.989871    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-79c4t/must-gather-jzbnd"]
Jul 21 17:14:49.990317 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:49.990269    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e25fcfe1-b845-44c2-af4b-7c158dde2e6a" containerName="revoke-keys"
Jul 21 17:14:49.990317 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:49.990282    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e25fcfe1-b845-44c2-af4b-7c158dde2e6a" containerName="revoke-keys"
Jul 21 17:14:49.990317 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:49.990296    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e" containerName="maas-api"
Jul 21 17:14:49.990317 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:49.990302    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e" containerName="maas-api"
Jul 21 17:14:49.990451 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:49.990355    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e25fcfe1-b845-44c2-af4b-7c158dde2e6a" containerName="revoke-keys"
Jul 21 17:14:49.990451 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:49.990365    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e663c22-b1d9-4c3c-82aa-f6a987ab6b3e" containerName="maas-api"
Jul 21 17:14:49.994859 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:49.994842    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79c4t/must-gather-jzbnd"
Jul 21 17:14:49.997780 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:49.997755    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-79c4t\"/\"default-dockercfg-cd55w\""
Jul 21 17:14:49.998088 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:49.998070    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-79c4t\"/\"kube-root-ca.crt\""
Jul 21 17:14:49.998460 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:49.998445    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-79c4t\"/\"openshift-service-ca.crt\""
Jul 21 17:14:50.011152 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:50.011125    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79c4t/must-gather-jzbnd"]
Jul 21 17:14:50.085173 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:50.085137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0627816f-db26-4f86-b4ee-efe8fa2dc461-must-gather-output\") pod \"must-gather-jzbnd\" (UID: \"0627816f-db26-4f86-b4ee-efe8fa2dc461\") " pod="openshift-must-gather-79c4t/must-gather-jzbnd"
Jul 21 17:14:50.085346 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:50.085203    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7s6p\" (UniqueName: \"kubernetes.io/projected/0627816f-db26-4f86-b4ee-efe8fa2dc461-kube-api-access-b7s6p\") pod \"must-gather-jzbnd\" (UID: \"0627816f-db26-4f86-b4ee-efe8fa2dc461\") " pod="openshift-must-gather-79c4t/must-gather-jzbnd"
Jul 21 17:14:50.186496 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:50.186451    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0627816f-db26-4f86-b4ee-efe8fa2dc461-must-gather-output\") pod \"must-gather-jzbnd\" (UID: \"0627816f-db26-4f86-b4ee-efe8fa2dc461\") " pod="openshift-must-gather-79c4t/must-gather-jzbnd"
Jul 21 17:14:50.186714 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:50.186528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7s6p\" (UniqueName: \"kubernetes.io/projected/0627816f-db26-4f86-b4ee-efe8fa2dc461-kube-api-access-b7s6p\") pod \"must-gather-jzbnd\" (UID: \"0627816f-db26-4f86-b4ee-efe8fa2dc461\") " pod="openshift-must-gather-79c4t/must-gather-jzbnd"
Jul 21 17:14:50.186867 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:50.186848    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0627816f-db26-4f86-b4ee-efe8fa2dc461-must-gather-output\") pod \"must-gather-jzbnd\" (UID: \"0627816f-db26-4f86-b4ee-efe8fa2dc461\") " pod="openshift-must-gather-79c4t/must-gather-jzbnd"
Jul 21 17:14:50.200710 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:50.200681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7s6p\" (UniqueName: \"kubernetes.io/projected/0627816f-db26-4f86-b4ee-efe8fa2dc461-kube-api-access-b7s6p\") pod \"must-gather-jzbnd\" (UID: \"0627816f-db26-4f86-b4ee-efe8fa2dc461\") " pod="openshift-must-gather-79c4t/must-gather-jzbnd"
Jul 21 17:14:50.304444 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:50.304359    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79c4t/must-gather-jzbnd"
Jul 21 17:14:50.431586 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:50.431563    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79c4t/must-gather-jzbnd"]
Jul 21 17:14:50.433717 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:14:50.433679    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0627816f_db26_4f86_b4ee_efe8fa2dc461.slice/crio-ebf20cd25742cad3b1a69306690340a1d4505b45ad64045d8779efc642fcd2df WatchSource:0}: Error finding container ebf20cd25742cad3b1a69306690340a1d4505b45ad64045d8779efc642fcd2df: Status 404 returned error can't find the container with id ebf20cd25742cad3b1a69306690340a1d4505b45ad64045d8779efc642fcd2df
Jul 21 17:14:50.639084 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:50.639048    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79c4t/must-gather-jzbnd" event={"ID":"0627816f-db26-4f86-b4ee-efe8fa2dc461","Type":"ContainerStarted","Data":"ebf20cd25742cad3b1a69306690340a1d4505b45ad64045d8779efc642fcd2df"}
Jul 21 17:14:51.647961 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:51.647863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79c4t/must-gather-jzbnd" event={"ID":"0627816f-db26-4f86-b4ee-efe8fa2dc461","Type":"ContainerStarted","Data":"427cdfd47ed01165a159ff09392fcb5e2c135a43220372315ec8fa0d2a2a113b"}
Jul 21 17:14:51.647961 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:51.647908    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79c4t/must-gather-jzbnd" event={"ID":"0627816f-db26-4f86-b4ee-efe8fa2dc461","Type":"ContainerStarted","Data":"7fea3b4e62d47094d8ed6f317d5b2dc16507da366d2f88352b2f1dc4e14ca805"}
Jul 21 17:14:51.666969 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:51.666901    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-79c4t/must-gather-jzbnd" podStartSLOduration=1.7466515230000002 podStartE2EDuration="2.666878403s" totalImagesPullingTime="920.22688ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:14:51.664220966 +0000 UTC m=+3070.602529426" watchObservedRunningTime="2026-07-21 17:14:51.666878403 +0000 UTC m=+3070.605186854"
Jul 21 17:14:53.002418 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:53.002354    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hmkpw_7e7475db-35a1-407c-818d-b31ecf085e31/global-pull-secret-syncer/0.log"
Jul 21 17:14:53.203683 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:53.203625    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n4pk5_c4678365-f754-41cd-8612-f9a45b1d35bc/konnectivity-agent/0.log"
Jul 21 17:14:53.231758 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:53.231727    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-171.ec2.internal_27f23970c7fcce5fec0df5f62c34e32e/haproxy/0.log"
Jul 21 17:14:58.841671 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:14:58.839152    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c5cd97c6b-7gjqs_19d671a0-1917-46e0-98ee-f300c750e6f9/authorino/0.log"
Jul 21 17:15:01.196097 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.196053    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-2sg9j_26ebd4b4-5145-471d-91a3-df86b81641ad/cluster-monitoring-operator/0.log"
Jul 21 17:15:01.226194 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.226147    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-xzr58_5ff34ef7-59df-4a3f-baf3-c2811578ade8/kube-state-metrics/0.log"
Jul 21 17:15:01.246077 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.246031    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-xzr58_5ff34ef7-59df-4a3f-baf3-c2811578ade8/kube-rbac-proxy-main/0.log"
Jul 21 17:15:01.273616 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.273586    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-xzr58_5ff34ef7-59df-4a3f-baf3-c2811578ade8/kube-rbac-proxy-self/0.log"
Jul 21 17:15:01.391482 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.391450    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cqd7p_22d077db-f6eb-4694-bf82-e04645da4827/node-exporter/0.log"
Jul 21 17:15:01.420219 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.420191    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cqd7p_22d077db-f6eb-4694-bf82-e04645da4827/kube-rbac-proxy/0.log"
Jul 21 17:15:01.448785 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.448689    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cqd7p_22d077db-f6eb-4694-bf82-e04645da4827/init-textfile/0.log"
Jul 21 17:15:01.663834 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.663806    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bvz5l_43702191-d958-45d3-9e72-b383bf98d285/kube-rbac-proxy-main/0.log"
Jul 21 17:15:01.689711 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.689679    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bvz5l_43702191-d958-45d3-9e72-b383bf98d285/kube-rbac-proxy-self/0.log"
Jul 21 17:15:01.716819 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.716742    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bvz5l_43702191-d958-45d3-9e72-b383bf98d285/openshift-state-metrics/0.log"
Jul 21 17:15:01.761497 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.761462    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_139a6da4-062c-4905-892d-6018d6db2dfb/prometheus/0.log"
Jul 21 17:15:01.786351 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.786317    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_139a6da4-062c-4905-892d-6018d6db2dfb/config-reloader/0.log"
Jul 21 17:15:01.817376 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.817341    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_139a6da4-062c-4905-892d-6018d6db2dfb/thanos-sidecar/0.log"
Jul 21 17:15:01.841941 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.841887    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_139a6da4-062c-4905-892d-6018d6db2dfb/kube-rbac-proxy-web/0.log"
Jul 21 17:15:01.863961 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.863929    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_139a6da4-062c-4905-892d-6018d6db2dfb/kube-rbac-proxy/0.log"
Jul 21 17:15:01.894235 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.894197    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_139a6da4-062c-4905-892d-6018d6db2dfb/kube-rbac-proxy-thanos/0.log"
Jul 21 17:15:01.921586 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:01.921554    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_139a6da4-062c-4905-892d-6018d6db2dfb/init-config-reloader/0.log"
Jul 21 17:15:02.004050 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:02.003961    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-f96ng_e8e4db0d-f382-4071-b02d-13cc30b80305/prometheus-operator-admission-webhook/0.log"
Jul 21 17:15:02.148259 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:02.148231    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-748cbf9467-znfdf_bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8/thanos-query/0.log"
Jul 21 17:15:02.171766 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:02.171735    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-748cbf9467-znfdf_bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8/kube-rbac-proxy-web/0.log"
Jul 21 17:15:02.193168 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:02.193132    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-748cbf9467-znfdf_bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8/kube-rbac-proxy/0.log"
Jul 21 17:15:02.216161 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:02.216129    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-748cbf9467-znfdf_bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8/prom-label-proxy/0.log"
Jul 21 17:15:02.242351 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:02.242322    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-748cbf9467-znfdf_bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8/kube-rbac-proxy-rules/0.log"
Jul 21 17:15:02.264251 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:02.264169    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-748cbf9467-znfdf_bd14d0d8-cb10-4e20-8ea9-0eb1dcddade8/kube-rbac-proxy-metrics/0.log"
Jul 21 17:15:03.229710 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.229677    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"]
Jul 21 17:15:03.235842 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.235811    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.243870 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.243838    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"]
Jul 21 17:15:03.341461 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.341412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e58b84a-dd46-4533-986a-2fe9ec411270-sys\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.341680 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.341533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e58b84a-dd46-4533-986a-2fe9ec411270-proc\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.341680 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.341599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e58b84a-dd46-4533-986a-2fe9ec411270-lib-modules\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.341680 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.341630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsz2g\" (UniqueName: \"kubernetes.io/projected/8e58b84a-dd46-4533-986a-2fe9ec411270-kube-api-access-hsz2g\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.341882 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.341766    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e58b84a-dd46-4533-986a-2fe9ec411270-podres\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.443362 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.443314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsz2g\" (UniqueName: \"kubernetes.io/projected/8e58b84a-dd46-4533-986a-2fe9ec411270-kube-api-access-hsz2g\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.443589 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.443450    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e58b84a-dd46-4533-986a-2fe9ec411270-podres\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.443589 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.443509    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e58b84a-dd46-4533-986a-2fe9ec411270-sys\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.443589 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.443556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e58b84a-dd46-4533-986a-2fe9ec411270-proc\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.443831 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.443594    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e58b84a-dd46-4533-986a-2fe9ec411270-lib-modules\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.443831 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.443779    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e58b84a-dd46-4533-986a-2fe9ec411270-lib-modules\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.443962 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.443844    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e58b84a-dd46-4533-986a-2fe9ec411270-proc\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.443962 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.443854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e58b84a-dd46-4533-986a-2fe9ec411270-sys\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.443962 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.443928    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e58b84a-dd46-4533-986a-2fe9ec411270-podres\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.453213 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.453160    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsz2g\" (UniqueName: \"kubernetes.io/projected/8e58b84a-dd46-4533-986a-2fe9ec411270-kube-api-access-hsz2g\") pod \"perf-node-gather-daemonset-skqxj\" (UID: \"8e58b84a-dd46-4533-986a-2fe9ec411270\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.553757 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.553668    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:03.722163 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.722116    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"]
Jul 21 17:15:03.726225 ip-10-0-130-171 kubenswrapper[2578]: W0721 17:15:03.726180    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8e58b84a_dd46_4533_986a_2fe9ec411270.slice/crio-4e63eb1238a26638ca4ab57b3fda36b2d7dd1b021fda831cc01ca99e9ea34dbb WatchSource:0}: Error finding container 4e63eb1238a26638ca4ab57b3fda36b2d7dd1b021fda831cc01ca99e9ea34dbb: Status 404 returned error can't find the container with id 4e63eb1238a26638ca4ab57b3fda36b2d7dd1b021fda831cc01ca99e9ea34dbb
Jul 21 17:15:03.744732 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:03.744695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj" event={"ID":"8e58b84a-dd46-4533-986a-2fe9ec411270","Type":"ContainerStarted","Data":"4e63eb1238a26638ca4ab57b3fda36b2d7dd1b021fda831cc01ca99e9ea34dbb"}
Jul 21 17:15:04.508342 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:04.508220    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-wfs6v_18981a60-fae7-495a-b8f3-a5510af00008/download-server/0.log"
Jul 21 17:15:04.751154 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:04.751111    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj" event={"ID":"8e58b84a-dd46-4533-986a-2fe9ec411270","Type":"ContainerStarted","Data":"1ada601c0483d8d6ba67aaacc23e2dca40d9cf86a13831e733d438ff9600e677"}
Jul 21 17:15:04.751364 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:04.751191    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:04.793048 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:04.792940    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj" podStartSLOduration=1.792918829 podStartE2EDuration="1.792918829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:15:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:15:04.791873273 +0000 UTC m=+3083.730181724" watchObservedRunningTime="2026-07-21 17:15:04.792918829 +0000 UTC m=+3083.731227277"
Jul 21 17:15:06.239559 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:06.239527    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kwf4m_31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3/dns/0.log"
Jul 21 17:15:06.262681 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:06.262657    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kwf4m_31c7c8eb-8cc1-4c7b-a2dd-288b1f395ab3/kube-rbac-proxy/0.log"
Jul 21 17:15:06.360534 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:06.360505    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p9cm5_6b6bf757-0749-4e3c-bbab-3af15a0cf5ea/dns-node-resolver/0.log"
Jul 21 17:15:07.024089 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:07.024059    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jkq4v_449f52bf-433c-402e-ba3b-5dd3179bd1a7/node-ca/0.log"
Jul 21 17:15:08.269158 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:08.269125    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54864c54db-ht5cz_af4d4bc5-9002-4506-8df6-51a2647d6adc/kube-auth-proxy/0.log"
Jul 21 17:15:08.299744 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:08.299701    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2ttxt_54412d7d-1b0e-45d0-acee-ff70727ddc61/istio-proxy/0.log"
Jul 21 17:15:08.335108 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:08.335080    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2ttxt_54412d7d-1b0e-45d0-acee-ff70727ddc61/istio-proxy/1.log"
Jul 21 17:15:08.369465 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:08.369437    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-gp6vw_a20993eb-8122-4092-85f7-e44abd3d7fed/payload-pre-processing/0.log"
Jul 21 17:15:09.126284 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:09.126256    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6xqhs_036bafe7-16e7-414a-ba6b-743635dd7852/serve-healthcheck-canary/0.log"
Jul 21 17:15:09.741967 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:09.741930    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kd6cb_a0c1a9dc-f7b4-492a-9b95-320c242f1997/kube-rbac-proxy/0.log"
Jul 21 17:15:09.764700 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:09.764670    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kd6cb_a0c1a9dc-f7b4-492a-9b95-320c242f1997/exporter/0.log"
Jul 21 17:15:09.789313 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:09.789288    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kd6cb_a0c1a9dc-f7b4-492a-9b95-320c242f1997/extractor/0.log"
Jul 21 17:15:10.770587 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:10.770545    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-skqxj"
Jul 21 17:15:12.773588 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:12.773551    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw_87027c35-a390-4a15-8974-ed0fcc5d5e81/manager/0.log"
Jul 21 17:15:12.806430 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:12.806399    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4b6f8cb5-f6knw_87027c35-a390-4a15-8974-ed0fcc5d5e81/copy-manifests/0.log"
Jul 21 17:15:13.901438 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:13.901403    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54864c54db-ht5cz_af4d4bc5-9002-4506-8df6-51a2647d6adc/kube-auth-proxy/0.log"
Jul 21 17:15:13.923585 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:13.923552    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2ttxt_54412d7d-1b0e-45d0-acee-ff70727ddc61/istio-proxy/0.log"
Jul 21 17:15:13.957376 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:13.957338    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2ttxt_54412d7d-1b0e-45d0-acee-ff70727ddc61/istio-proxy/1.log"
Jul 21 17:15:13.989944 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:13.989909    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-gp6vw_a20993eb-8122-4092-85f7-e44abd3d7fed/payload-pre-processing/0.log"
Jul 21 17:15:14.252998 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:14.252916    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76d8f8b6b-tg4hv_b394d66b-58aa-4265-b86f-0c91636a0b6b/manager/0.log"
Jul 21 17:15:15.681506 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:15.681481    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54864c54db-ht5cz_af4d4bc5-9002-4506-8df6-51a2647d6adc/kube-auth-proxy/0.log"
Jul 21 17:15:15.702141 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:15.702109    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2ttxt_54412d7d-1b0e-45d0-acee-ff70727ddc61/istio-proxy/0.log"
Jul 21 17:15:15.739485 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:15.739441    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-2ttxt_54412d7d-1b0e-45d0-acee-ff70727ddc61/istio-proxy/1.log"
Jul 21 17:15:15.767660 ip-10-0-130-171 kubenswrapper[2578]: I0721 17:15:15.767604    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-gp6vw_a20993eb-8122-4092-85f7-e44abd3d7fed/payload-pre-processing/0.log"