Jul 07 14:58:34.991670 ip-10-0-132-187 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 14:58:34.991681 ip-10-0-132-187 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 14:58:34.991690 ip-10-0-132-187 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 14:58:34.991975 ip-10-0-132-187 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 14:58:45.124426 ip-10-0-132-187 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 14:58:45.124444 ip-10-0-132-187 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0e9675885a404e0d91e273cc17c170b5 --
Jul 07 15:00:38.856516 ip-10-0-132-187 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 15:00:39.221774 ip-10-0-132-187 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:00:39.221774 ip-10-0-132-187 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 15:00:39.221774 ip-10-0-132-187 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:00:39.221774 ip-10-0-132-187 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 15:00:39.221774 ip-10-0-132-187 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:00:39.221774 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.202643    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 15:00:39.221774 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.209982    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:00:39.221774 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210000    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:00:39.221774 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210004    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:00:39.221774 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210011    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:00:39.221774 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210015    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:00:39.221774 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210018    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:00:39.221774 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210021    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:00:39.221774 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210025    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210031    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210034    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210037    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210040    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210043    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210046    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210049    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210052    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210055    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210059    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210063    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210066    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210069    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210075    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210077    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210080    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210084    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210087    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:00:39.222587 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210091    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210095    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210099    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210102    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210106    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210130    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210134    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210140    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210144    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210147    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210151    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210155    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210158    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210162    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210165    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210168    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210171    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210174    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210177    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210182    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:00:39.223130 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210185    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210187    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210190    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210195    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210199    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210202    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210205    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210207    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210210    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210213    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210216    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210221    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210224    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210227    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210229    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210232    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210235    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210238    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210240    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210243    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:00:39.223645 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210246    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210249    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210252    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210255    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210260    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210263    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210265    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210268    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210271    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210273    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210276    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210279    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210282    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210285    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210287    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210294    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210297    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210300    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210302    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210305    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:00:39.224240 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210308    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210311    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210314    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210316    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210319    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210322    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210325    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210328    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210333    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210336    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210339    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210342    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.210345    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211839    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211847    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211850    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211856    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211859    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211862    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:00:39.224743 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211864    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211868    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211871    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211873    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211876    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211880    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211882    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211885    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211888    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211891    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211896    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211899    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211902    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211905    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211908    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211910    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211914    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211917    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211922    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:00:39.225327 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211927    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211930    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211933    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211939    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211942    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211945    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211948    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211951    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211954    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211957    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211960    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211963    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211966    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211969    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211972    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211974    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211979    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211982    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211984    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211987    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:00:39.225862 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211990    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211993    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211995    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.211998    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212001    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212004    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212006    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212009    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212014    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212016    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212019    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212025    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212028    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212033    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212036    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212039    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212042    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212045    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212048    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:00:39.226434 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212051    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212056    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212059    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212062    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212065    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212069    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212073    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212076    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212079    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212082    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212085    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212088    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212091    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212099    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212103    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212106    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212123    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212126    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212130    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:00:39.226939 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212132    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212135    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212138    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212141    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212143    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212150    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212155    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212158    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212161    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212164    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212167    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212169    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212172    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212175    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212178    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212181    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212873    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212879    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212883    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212886    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:00:39.227496 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212889    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212893    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212895    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212898    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212901    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212904    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212906    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212912    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212915    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212917    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212920    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212922    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212925    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212928    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212931    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212933    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212936    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212941    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212943    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212948    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:00:39.228126 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212953    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212955    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212960    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212963    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212967    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212971    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212974    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212976    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212979    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212984    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212987    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212990    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212995    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.212998    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213000    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213003    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213006    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213009    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213011    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:00:39.228815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213014    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213016    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213019    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213021    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213024    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213027    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213032    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213035    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213037    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213039    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213044    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213047    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213051    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213054    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213056    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213059    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213062    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213068    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213072    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:00:39.229337 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213075    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213078    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213080    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213083    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213086    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213089    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213092    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213094    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213097    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213100    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213103    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213123    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213126    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213129    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213131    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213134    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213137    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213140    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213143    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213145    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:00:39.230056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213148    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213150    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213153    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213157    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213162    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213168    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213171    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213174    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213176    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213179    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213182    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213184    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213187    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213190    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213193    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213198    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.213200    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213362    2574 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213371    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213377    2574 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213382    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 15:00:39.230692 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213387    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213390    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213414    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213532    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213538    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213541    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213544    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213557    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213561    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213564    2574 flags.go:64] FLAG: --cgroup-root=""
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213567    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213570    2574 flags.go:64] FLAG: --client-ca-file=""
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213573    2574 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213577    2574 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213584    2574 flags.go:64] FLAG: --cluster-domain=""
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213587    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213592    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213595    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213599    2574 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213603    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213606    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213609    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213612    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213615    2574 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 15:00:39.231333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213618    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213621    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213625    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213627    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213632    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213635    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213638    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213641    2574 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213644    2574 flags.go:64] FLAG: --enable-server="true"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213648    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213653    2574 flags.go:64] FLAG: --event-burst="100"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213656    2574 flags.go:64] FLAG: --event-qps="50"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213659    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213662    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.213665    2574 flags.go:64] FLAG: --eviction-hard=""
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221210    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221214    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221217    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221221    2574 flags.go:64] FLAG: --eviction-soft=""
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221224    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221227    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221231    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221236    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221239    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221243    2574 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 15:00:39.231963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221246    2574 flags.go:64] FLAG: --feature-gates=""
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221250    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221254    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221257    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221260    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221263    2574 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221267    2574 flags.go:64] FLAG: --help="false"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221270    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-132-187.ec2.internal"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221273    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221276    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221280    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221284    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221288    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221291    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221293    2574 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221296    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221299    2574 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221302    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221305    2574 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221308    2574 flags.go:64] FLAG: --kube-reserved=""
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221311    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221314    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221317    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221320    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 15:00:39.232790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221322    2574 flags.go:64] FLAG: --lock-file=""
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221325    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221328    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221331    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221338    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221346    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221349    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221353    2574 flags.go:64] FLAG: --logging-format="text"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221356    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221359    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221362    2574 flags.go:64] FLAG: --manifest-url=""
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221365    2574 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221370    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221374    2574 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221378    2574 flags.go:64] FLAG: --max-pods="110"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221381    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221384    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221387    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221390    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221393    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221396    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221399    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221410    2574 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221414    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221417    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 15:00:39.320868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221420    2574 flags.go:64] FLAG: --pod-cidr=""
Jul 07 15:00:39.294519 ip-10-0-132-187 systemd[1]: Started Kubernetes Kubelet.
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221423    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221430    2574 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221433    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221436    2574 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221439    2574 flags.go:64] FLAG: --port="10250"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221442    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221445    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0389159c6fc9f8779"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221448    2574 flags.go:64] FLAG: --qos-reserved=""
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221451    2574 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221455    2574 flags.go:64] FLAG: --register-node="true"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221458    2574 flags.go:64] FLAG: --register-with-taints=""
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221462    2574 flags.go:64] FLAG: --registry-burst="10"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221467    2574 flags.go:64] FLAG: --registry-qps="5"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221472    2574 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221475    2574 flags.go:64] FLAG: --reserved-memory=""
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221479    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221482    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221486    2574 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221489    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221492    2574 flags.go:64] FLAG: --runonce="false"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221494    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221497    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221500    2574 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221503    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 15:00:39.322347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221506    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221510    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221513    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221516    2574 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221519    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221522    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221525    2574 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221528    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221531    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221534    2574 flags.go:64] FLAG: --system-cgroups=""
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221537    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221543    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221553    2574 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221558    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221563    2574 flags.go:64] FLAG: --tls-min-version=""
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221568    2574 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221571    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221575    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221581    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221584    2574 flags.go:64] FLAG: --v="2"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221592    2574 flags.go:64] FLAG: --version="false"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221600    2574 flags.go:64] FLAG: --vmodule=""
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221606    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.221609    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 15:00:39.329392 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221749    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221752    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221755    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221758    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221761    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221764    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221767    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221770    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221790    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221795    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221798    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221801    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221804    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221807    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221810    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221813    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221816    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221819    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221822    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221825    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:00:39.330464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221827    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221830    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221833    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221836    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221839    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221841    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221844    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221847    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221851    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221855    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221859    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221861    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221864    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221866    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221869    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221871    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221874    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221878    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221882    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:00:39.331320 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221884    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221887    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221890    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221893    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221896    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221899    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221901    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221904    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221907    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221909    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221912    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221915    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221918    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221920    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221923    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221926    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221928    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221931    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221933    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221936    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:00:39.332361 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221938    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221943    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221945    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221948    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221951    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221954    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221957    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221959    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221962    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221964    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221967    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221970    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221972    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221975    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221977    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221980    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221982    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221986    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221990    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:00:39.333406 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221993    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221995    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.221999    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222002    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222005    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222008    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222011    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222013    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222016    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222019    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222022    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222025    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222029    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222032    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222037    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222040    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222043    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222046    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222049    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222052    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:00:39.334199 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.222055    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:00:39.334933 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.222665    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:00:39.334933 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.229522    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 15:00:39.334933 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.229539    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 15:00:39.334933 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.229603    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 15:00:39.334933 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.229628    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 15:00:39.334933 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.230689    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:00:39.334933 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.230893    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:00:39.334933 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.230897    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:00:39.334933 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.230901    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:00:39.334933 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.230904    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:00:39.334933 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.230907    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:00:39.334933 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231120    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:00:39.334933 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231321    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:00:39.334933 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231324    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231327    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231330    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231332    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231534    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231537    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231540    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231543    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231545    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231745    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231748    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231751    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231753    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231756    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231758    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231764    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231767    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231769    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231772    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231775    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:00:39.335812 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231778    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231782    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231785    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231787    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231790    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231792    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231795    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231797    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231800    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231802    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231805    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231808    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231810    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231815    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231818    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231821    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231824    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231827    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231831    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:00:39.336804 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231834    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231837    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231840    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231843    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231845    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231848    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231850    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231853    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231855    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231858    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231860    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231864    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231867    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231869    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231872    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231875    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231878    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231881    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231883    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231886    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:00:39.337569 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231889    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231891    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231894    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231897    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231900    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231902    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231905    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231907    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231910    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231912    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231915    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231919    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231922    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231925    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231927    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231930    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231933    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231935    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231938    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231940    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:00:39.338493 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231943    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:00:39.339470 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231946    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:00:39.339470 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231948    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:00:39.339470 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231952    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:00:39.339470 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231956    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:00:39.339470 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231959    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:00:39.339470 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231962    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:00:39.339470 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231965    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:00:39.339470 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231969    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:00:39.339470 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231972    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:00:39.339470 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231975    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:00:39.339470 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.231978    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:00:39.339470 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.231983    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:00:39.339470 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232102    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:00:39.339470 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232117    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232120    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232123    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232126    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232129    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232132    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232134    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232137    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232139    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232142    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232144    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232147    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232149    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232152    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232155    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232157    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232160    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232163    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232166    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232168    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:00:39.340175 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232171    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232174    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232176    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232179    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232182    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232185    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232188    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232193    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232196    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232199    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232202    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232204    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232207    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232209    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232212    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232214    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232217    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232220    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232223    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:00:39.341166 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232225    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232228    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232230    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232233    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232236    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232238    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232241    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232244    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232248    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232251    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232254    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232257    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232260    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232263    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232266    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232269    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232272    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232275    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232278    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:00:39.342027 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232281    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232283    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232287    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232290    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232293    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232295    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232298    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232300    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232304    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232308    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232311    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232314    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232317    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232320    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232322    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232325    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232328    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232330    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232333    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232335    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:00:39.342955 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232338    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232341    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232350    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232353    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232355    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232358    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232361    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232364    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232367    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232369    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232372    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232375    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232377    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232380    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232382    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232385    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232388    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232390    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232393    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:00:39.343640 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:39.232396    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:00:39.417494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.232400    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:00:39.417494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.232527    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 15:00:39.417494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.234721    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 15:00:39.417494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.236078    2574 server.go:1019] "Starting client certificate rotation"
Jul 07 15:00:39.417494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.236151    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 15:00:39.417494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.236198    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 15:00:39.417494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.238372    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 15:00:39.417494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.240625    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 15:00:39.417494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.254121    2574 log.go:25] "Validated CRI v1 runtime API"
Jul 07 15:00:39.417494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.256398    2574 log.go:25] "Validated CRI v1 image API"
Jul 07 15:00:39.417494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.257266    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 15:00:39.417494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.259972    2574 fs.go:135] Filesystem UUIDs: map[7064d357-0f9d-42dd-8e65-2cfc67389877:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 989cf00e-7bbe-4dab-bb09-2bbe896c8e8e:/dev/nvme0n1p4]
Jul 07 15:00:39.418240 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.259989    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 15:00:39.418240 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.268451    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.272714    2574 manager.go:216] Machine: {Timestamp:2026-07-07 15:00:39.27146965 +0000 UTC m=+0.314250725 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3122312 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25d77dc9ab877ef92c991ff4d4ad39 SystemUUID:ec25d77d-c9ab-877e-f92c-991ff4d4ad39 BootID:0e967588-5a40-4e0d-91e2-73cc17c170b5 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fc:de:ad:01:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fc:de:ad:01:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:37:c9:c5:c4:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.272825    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.272936    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.276020    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.276076    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.277354    2574 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.277371    2574 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.277382    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.277993    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.279393    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.283411    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.283546    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.283580    2574 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.283592    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.283608    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.283618    2574 kubelet.go:398] "Adding apiserver pod source"
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.283628    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 15:00:39.420212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.283980    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.283993    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.285956    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.288145    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.288176    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.289323    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.289340    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.289346    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.289352    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.289360    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.289366    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.289374    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.289379    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.289386    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.289391    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.289400    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.289405    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.290024    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.290032    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.293775    2574 server.go:1268] "Started kubelet"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.293876    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.293953    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-187.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.294043    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.294170    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.295806    2574 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.296579    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.296617    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.298711    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.303559    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-187.ec2.internal.18c009fe13976632  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-187.ec2.internal,UID:ip-10-0-132-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-187.ec2.internal,},FirstTimestamp:2026-07-07 15:00:39.293748786 +0000 UTC m=+0.336529861,LastTimestamp:2026-07-07 15:00:39.293748786 +0000 UTC m=+0.336529861,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-187.ec2.internal,}"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.304471    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.304853    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.305655    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.305666    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.305736    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.306038    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.306081    2574 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.306086    2574 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.313160    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wl8w5"
Jul 07 15:00:39.420884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.318010    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wl8w5"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.333516    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.333763    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.334760    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.334777    2574 factory.go:55] Registering systemd factory
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.334788    2574 factory.go:223] Registration of the systemd container factory successfully
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.334774    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.335043    2574 factory.go:153] Registering CRI-O factory
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.335056    2574 factory.go:223] Registration of the crio container factory successfully
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.335076    2574 factory.go:103] Registering Raw factory
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.335086    2574 manager.go:1196] Started watching for new ooms in manager
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.335548    2574 manager.go:349] Starting recovery of all containers
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.345841    2574 manager.go:354] Recovery completed
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.350148    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.351880    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.351900    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.351910    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.352650    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.352661    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.352679    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.354468    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.354613    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-187.ec2.internal.18c009fe170e979b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-187.ec2.internal,UID:ip-10-0-132-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-187.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-187.ec2.internal,},FirstTimestamp:2026-07-07 15:00:39.351891867 +0000 UTC m=+0.394672943,LastTimestamp:2026-07-07 15:00:39.351891867 +0000 UTC m=+0.394672943,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-187.ec2.internal,}"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.354814    2574 policy_none.go:49] "None policy: Start"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.354831    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.354845    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.355253    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.355281    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.355294    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.357022    2574 policy_none.go:47] "Start"
Jul 07 15:00:39.428358 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.405844    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.431960    2574 manager.go:337] "Starting Device Plugin manager"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.432184    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.432199    2574 server.go:87] "Starting device plugin registration server"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.432469    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.432480    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.433098    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.433217    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.433226    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.433302    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.433360    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.533858    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.534814    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.534839    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.534849    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.534876    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-187.ec2.internal"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.540785    2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-187.ec2.internal\" not found" node="ip-10-0-132-187.ec2.internal"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.541771    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-187.ec2.internal"
Jul 07 15:00:39.549351 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.541791    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-187.ec2.internal\": node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:39.550897 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.550803    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 15:00:40.962614 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.551974    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 15:00:40.962614 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.552031    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 15:00:40.962614 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.552059    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 15:00:40.962614 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.552102    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 15:00:40.962614 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:39.554474    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:00:40.962614 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:39.570352    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:40.962614 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.961611    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-187.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal"]
Jul 07 15:00:40.962614 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.961697    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:00:40.963825 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.963409    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:00:40.963825 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.963448    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:00:40.963825 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.963465    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:00:40.966599 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.966074    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:00:40.966599 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.966172    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:40.966599 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.966205    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:00:40.967215 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.966854    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:00:40.967215 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.966859    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:00:40.967215 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.966880    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:00:40.967215 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.966881    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:00:40.967215 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.966889    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:00:40.967215 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.966895    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:00:40.970101 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.969462    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:40.970101 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.969487    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:00:40.970458 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.970222    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:00:40.970458 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.970246    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:00:40.970458 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:40.970256    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:00:41.038047 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:40.979925    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:41.038047 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.018182    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bffa8a0d8a526e727a45f5076f1ca78c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal\" (UID: \"bffa8a0d8a526e727a45f5076f1ca78c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.038047 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.018211    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e1991cb1cdb7a97f906f31ef43205300-config\") pod \"kube-apiserver-proxy-ip-10-0-132-187.ec2.internal\" (UID: \"e1991cb1cdb7a97f906f31ef43205300\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.038047 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.018234    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bffa8a0d8a526e727a45f5076f1ca78c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal\" (UID: \"bffa8a0d8a526e727a45f5076f1ca78c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.038047 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:41.021060    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-187.ec2.internal\" not found" node="ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.038047 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:41.025926    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-187.ec2.internal\" not found" node="ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.154412 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:41.080516    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:41.154412 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.119041    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e1991cb1cdb7a97f906f31ef43205300-config\") pod \"kube-apiserver-proxy-ip-10-0-132-187.ec2.internal\" (UID: \"e1991cb1cdb7a97f906f31ef43205300\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.154412 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.119076    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bffa8a0d8a526e727a45f5076f1ca78c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal\" (UID: \"bffa8a0d8a526e727a45f5076f1ca78c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.154412 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.119093    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bffa8a0d8a526e727a45f5076f1ca78c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal\" (UID: \"bffa8a0d8a526e727a45f5076f1ca78c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.154412 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.119134    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bffa8a0d8a526e727a45f5076f1ca78c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal\" (UID: \"bffa8a0d8a526e727a45f5076f1ca78c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.154412 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.119144    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e1991cb1cdb7a97f906f31ef43205300-config\") pod \"kube-apiserver-proxy-ip-10-0-132-187.ec2.internal\" (UID: \"e1991cb1cdb7a97f906f31ef43205300\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.154412 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.119157    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bffa8a0d8a526e727a45f5076f1ca78c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal\" (UID: \"bffa8a0d8a526e727a45f5076f1ca78c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.233637 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:41.181552    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:41.313912 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:41.282056    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:41.388859 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.324539    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.388859 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.329574    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.388859 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:41.382606    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:41.532644 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:41.483122    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:41.545931 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.544690    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 15:00:41.545931 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.544868    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 15:00:41.654802 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:41.583594    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:41.654802 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.593568    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:00:41.654802 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.645429    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:55:40 +0000 UTC" deadline="2027-12-01 16:41:02.926867396 +0000 UTC"
Jul 07 15:00:41.654802 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.645476    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12289h40m21.28139602s"
Jul 07 15:00:41.764884 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:41.684584    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:41.878792 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:41.785223    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:41.886087 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:41.886058    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-187.ec2.internal\" not found"
Jul 07 15:00:41.912214 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.912127    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:00:41.915873 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.915851    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.924985 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.924959    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 15:00:41.925771 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.925756    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal"
Jul 07 15:00:41.936386 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:41.936364    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 15:00:42.064802 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:42.064769    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1991cb1cdb7a97f906f31ef43205300.slice/crio-0f445a1a74c5cffa80c6a5356c69db84b29477c70de2ae95958de01a0a6dcdd4 WatchSource:0}: Error finding container 0f445a1a74c5cffa80c6a5356c69db84b29477c70de2ae95958de01a0a6dcdd4: Status 404 returned error can't find the container with id 0f445a1a74c5cffa80c6a5356c69db84b29477c70de2ae95958de01a0a6dcdd4
Jul 07 15:00:42.065288 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:42.065269    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbffa8a0d8a526e727a45f5076f1ca78c.slice/crio-efb59eaaadfeda9ad35e57566f1f5001851296ce922c811fdd0a27b77f826ac6 WatchSource:0}: Error finding container efb59eaaadfeda9ad35e57566f1f5001851296ce922c811fdd0a27b77f826ac6: Status 404 returned error can't find the container with id efb59eaaadfeda9ad35e57566f1f5001851296ce922c811fdd0a27b77f826ac6
Jul 07 15:00:42.070606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.070590    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:00:42.213912 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.213836    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:00:42.593782 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.593752    2574 apiserver.go:52] "Watching apiserver"
Jul 07 15:00:42.601017 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.600967    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 15:00:42.602698 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.602058    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bklgh","openshift-image-registry/node-ca-qmvsb","openshift-multus/multus-additional-cni-plugins-zsfgp","openshift-multus/multus-vxzph","openshift-multus/network-metrics-daemon-sw26l","openshift-ovn-kubernetes/ovnkube-node-d9zdp","kube-system/konnectivity-agent-xb4ff","kube-system/kube-apiserver-proxy-ip-10-0-132-187.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4","openshift-cluster-node-tuning-operator/tuned-bfmtj","openshift-dns/node-resolver-p492t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal","openshift-network-diagnostics/network-check-target-vmtlc","openshift-network-operator/iptables-alerter-fgdxb"]
Jul 07 15:00:42.604941 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.604918    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.607065 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.607043    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 15:00:42.607191 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.607125    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 15:00:42.607348 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.607329    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 15:00:42.607410 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.607391    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fgdxb"
Jul 07 15:00:42.607464 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.607395    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 15:00:42.607770 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.607578    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rtbnm\""
Jul 07 15:00:42.607770 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.607649    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 15:00:42.607953 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.607942    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 15:00:42.609604 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.609584    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.610112 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.609797    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wsfmm\""
Jul 07 15:00:42.610112 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.609822    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:00:42.610112 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.609841    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 15:00:42.610346 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.610232    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 15:00:42.611790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.611769    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wgvzp\""
Jul 07 15:00:42.611884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.611797    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 15:00:42.611884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.611807    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 15:00:42.612095 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.612057    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.612095 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.612078    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 15:00:42.612216 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.612110    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 15:00:42.612330 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.612308    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 15:00:42.614509 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.614290    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 15:00:42.614509 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.614313    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zw4zt\""
Jul 07 15:00:42.614509 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.614414    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:42.614509 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:42.614494    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:00:42.616224 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.616204    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 15:00:42.616843 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.616824    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xb4ff"
Jul 07 15:00:42.618751 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.618687    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 15:00:42.618751 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.618746    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xkf5b\""
Jul 07 15:00:42.618947 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.618933    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 15:00:42.619090 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.619074    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:42.619166 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:42.619145    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:00:42.621522 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.621502    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.623373 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.623355    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 15:00:42.623479 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.623416    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 15:00:42.623542 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.623514    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 15:00:42.623758 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.623740    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lpxhq\""
Jul 07 15:00:42.623961 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.623940    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.625895 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.625741    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 15:00:42.625895 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.625796    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:00:42.625895 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.625839    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b4wdc\""
Jul 07 15:00:42.626547 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.626528    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p492t"
Jul 07 15:00:42.626710 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.626676    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 15:00:42.627580 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627559    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk8vm\" (UniqueName: \"kubernetes.io/projected/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-kube-api-access-lk8vm\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.627676 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627585    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29fd614e-5893-4211-9e46-965e0af8fbde-host-slash\") pod \"iptables-alerter-fgdxb\" (UID: \"29fd614e-5893-4211-9e46-965e0af8fbde\") " pod="openshift-network-operator/iptables-alerter-fgdxb"
Jul 07 15:00:42.627676 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627604    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs4gd\" (UniqueName: \"kubernetes.io/projected/29fd614e-5893-4211-9e46-965e0af8fbde-kube-api-access-gs4gd\") pod \"iptables-alerter-fgdxb\" (UID: \"29fd614e-5893-4211-9e46-965e0af8fbde\") " pod="openshift-network-operator/iptables-alerter-fgdxb"
Jul 07 15:00:42.627676 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627628    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-cnibin\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.627676 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627663    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-multus-conf-dir\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.627875 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627703    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnlhd\" (UniqueName: \"kubernetes.io/projected/5f734035-38a4-44f2-80ae-1b668f6b158f-kube-api-access-pnlhd\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.627875 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627727    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-etc-kubernetes\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.627875 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627767    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-system-cni-dir\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.627875 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627795    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.627875 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627846    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-var-lib-cni-bin\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.627875 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627869    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-kubelet\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.628166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-systemd-units\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.628166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627926    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-var-lib-openvswitch\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.628166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627970    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.628166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.627996    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bbxb\" (UniqueName: \"kubernetes.io/projected/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-kube-api-access-4bbxb\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.628166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628046    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-multus-socket-dir-parent\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.628166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628063    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-var-lib-kubelet\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.628166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/69c65439-2c4a-4d89-be0e-1a1f786f2657-konnectivity-ca\") pod \"konnectivity-agent-xb4ff\" (UID: \"69c65439-2c4a-4d89-be0e-1a1f786f2657\") " pod="kube-system/konnectivity-agent-xb4ff"
Jul 07 15:00:42.628166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628136    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-run-netns\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.628166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-os-release\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.628509 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628183    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-system-cni-dir\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.628509 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628210    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-multus-cni-dir\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.628509 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628252    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjv5c\" (UniqueName: \"kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c\") pod \"network-check-target-vmtlc\" (UID: \"a92f5c93-2309-40bf-82b6-7cdafea0713f\") " pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:42.628509 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628274    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-etc-openvswitch\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.628509 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628342    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-run-ovn\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.628509 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628380    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-ovnkube-config\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.628509 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628405    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 15:00:42.628509 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-env-overrides\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.628509 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628439    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-cni-binary-copy\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.628509 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628477    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.628509 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628500    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-run-netns\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.628968 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628532    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-hostroot\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.628968 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628567    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/69c65439-2c4a-4d89-be0e-1a1f786f2657-agent-certs\") pod \"konnectivity-agent-xb4ff\" (UID: \"69c65439-2c4a-4d89-be0e-1a1f786f2657\") " pod="kube-system/konnectivity-agent-xb4ff"
Jul 07 15:00:42.628968 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628589    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-slash\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.628968 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628636    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-run-openvswitch\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.628968 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628665    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.628968 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628696    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 15:00:42.628968 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628718    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qdqnx\""
Jul 07 15:00:42.628968 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628742    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-cnibin\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.628968 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628798    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f734035-38a4-44f2-80ae-1b668f6b158f-cni-binary-copy\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.628968 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628822    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-run-k8s-cni-cncf-io\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.628968 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628863    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-var-lib-cni-multus\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.628968 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628886    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f734035-38a4-44f2-80ae-1b668f6b158f-multus-daemon-config\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.628968 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.628908    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-node-log\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.629527 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.629049    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-cni-netd\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.629527 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.629082    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.629527 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.629146    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-run-multus-certs\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.629527 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.629255    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-run-systemd\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.629527 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.629290    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-log-socket\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.629527 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.629317    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-cni-bin\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.629527 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.629343    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-ovnkube-script-lib\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.629527 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.629370    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29fd614e-5893-4211-9e46-965e0af8fbde-iptables-alerter-script\") pod \"iptables-alerter-fgdxb\" (UID: \"29fd614e-5893-4211-9e46-965e0af8fbde\") " pod="openshift-network-operator/iptables-alerter-fgdxb"
Jul 07 15:00:42.629527 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.629394    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-os-release\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.629527 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.629431    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-ovn-node-metrics-cert\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.630200 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.630177    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:42.631145 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:42.630847    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:00:42.634410 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.633550    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qmvsb"
Jul 07 15:00:42.635698 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.635658    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 15:00:42.635878 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.635855    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j8v28\""
Jul 07 15:00:42.635878 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.635869    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 15:00:42.636176 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.636160    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 15:00:42.650548 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.650523    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wrbdv"
Jul 07 15:00:42.658542 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.658520    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wrbdv"
Jul 07 15:00:42.715877 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.715847    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 15:00:42.729777 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.729745    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-os-release\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.729777 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.729776    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29fd614e-5893-4211-9e46-965e0af8fbde-host-slash\") pod \"iptables-alerter-fgdxb\" (UID: \"29fd614e-5893-4211-9e46-965e0af8fbde\") " pod="openshift-network-operator/iptables-alerter-fgdxb"
Jul 07 15:00:42.730065 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.729793    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs4gd\" (UniqueName: \"kubernetes.io/projected/29fd614e-5893-4211-9e46-965e0af8fbde-kube-api-access-gs4gd\") pod \"iptables-alerter-fgdxb\" (UID: \"29fd614e-5893-4211-9e46-965e0af8fbde\") " pod="openshift-network-operator/iptables-alerter-fgdxb"
Jul 07 15:00:42.730065 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.729860    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-socket-dir\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.730065 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.729886    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2d26\" (UniqueName: \"kubernetes.io/projected/e85b2d7d-177c-4ac3-9100-a7b9381d8637-kube-api-access-b2d26\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.730065 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.729891    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-os-release\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.730065 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.729891    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29fd614e-5893-4211-9e46-965e0af8fbde-host-slash\") pod \"iptables-alerter-fgdxb\" (UID: \"29fd614e-5893-4211-9e46-965e0af8fbde\") " pod="openshift-network-operator/iptables-alerter-fgdxb"
Jul 07 15:00:42.730065 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730028    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-systemd\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730089    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-host\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730121    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e147253-4b27-406f-bdae-c4fb442ccd7d-tmp\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730154    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b88af1ec-e8e2-4a62-a235-7062bdc5c9f9-host\") pod \"node-ca-qmvsb\" (UID: \"b88af1ec-e8e2-4a62-a235-7062bdc5c9f9\") " pod="openshift-image-registry/node-ca-qmvsb"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730201    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730236    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-var-lib-cni-bin\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730261    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-systemd-units\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730287    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-var-lib-openvswitch\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730301    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-var-lib-cni-bin\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730313    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-ovn-node-metrics-cert\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730325    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-var-lib-openvswitch\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730305    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-systemd-units\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730343    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-kubernetes\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730377    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-tuned\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730400    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9f6b1040-2676-427e-ad0e-9a086722f3f5-kubelet-config\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:42.730452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730430    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730463    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-multus-socket-dir-parent\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730487    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-var-lib-kubelet\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730509    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/69c65439-2c4a-4d89-be0e-1a1f786f2657-konnectivity-ca\") pod \"konnectivity-agent-xb4ff\" (UID: \"69c65439-2c4a-4d89-be0e-1a1f786f2657\") " pod="kube-system/konnectivity-agent-xb4ff"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730532    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-run-netns\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730559    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-env-overrides\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730586    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-os-release\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730611    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjv5c\" (UniqueName: \"kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c\") pod \"network-check-target-vmtlc\" (UID: \"a92f5c93-2309-40bf-82b6-7cdafea0713f\") " pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730624    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-multus-socket-dir-parent\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730636    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-run-ovn\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730583    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-var-lib-kubelet\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730672    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-ovnkube-script-lib\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730690    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-run-netns\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730709    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-cni-binary-copy\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730892    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-os-release\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730897    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730948    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.731175 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.730939    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-run-ovn\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731022    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731099    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731133    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-run-netns\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731172    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-hostroot\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731201    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/69c65439-2c4a-4d89-be0e-1a1f786f2657-agent-certs\") pod \"konnectivity-agent-xb4ff\" (UID: \"69c65439-2c4a-4d89-be0e-1a1f786f2657\") " pod="kube-system/konnectivity-agent-xb4ff"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731228    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/69c65439-2c4a-4d89-be0e-1a1f786f2657-konnectivity-ca\") pod \"konnectivity-agent-xb4ff\" (UID: \"69c65439-2c4a-4d89-be0e-1a1f786f2657\") " pod="kube-system/konnectivity-agent-xb4ff"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731255    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-run\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731276    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731283    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f734035-38a4-44f2-80ae-1b668f6b158f-cni-binary-copy\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731283    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-run-netns\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731445    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-env-overrides\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731498    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-hostroot\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731490    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-var-lib-cni-multus\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731570    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-var-lib-cni-multus\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731571    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-ovnkube-script-lib\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731581    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-cni-binary-copy\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731676    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-node-log\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.731955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731636    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-node-log\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731708    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29fd614e-5893-4211-9e46-965e0af8fbde-iptables-alerter-script\") pod \"iptables-alerter-fgdxb\" (UID: \"29fd614e-5893-4211-9e46-965e0af8fbde\") " pod="openshift-network-operator/iptables-alerter-fgdxb"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731733    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-device-dir\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-sysconfig\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731775    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6030f52-8069-4c84-971f-a3733c9c2f7c-tmp-dir\") pod \"node-resolver-p492t\" (UID: \"f6030f52-8069-4c84-971f-a3733c9c2f7c\") " pod="openshift-dns/node-resolver-p492t"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731801    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f734035-38a4-44f2-80ae-1b668f6b158f-cni-binary-copy\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731809    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnw9l\" (UniqueName: \"kubernetes.io/projected/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-kube-api-access-cnw9l\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731839    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-cni-bin\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731857    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731894    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-etc-selinux\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731921    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-cni-bin\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.731967    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxvgk\" (UniqueName: \"kubernetes.io/projected/b88af1ec-e8e2-4a62-a235-7062bdc5c9f9-kube-api-access-dxvgk\") pod \"node-ca-qmvsb\" (UID: \"b88af1ec-e8e2-4a62-a235-7062bdc5c9f9\") " pod="openshift-image-registry/node-ca-qmvsb"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732016    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk8vm\" (UniqueName: \"kubernetes.io/projected/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-kube-api-access-lk8vm\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732045    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-lib-modules\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbjb9\" (UniqueName: \"kubernetes.io/projected/6e147253-4b27-406f-bdae-c4fb442ccd7d-kube-api-access-lbjb9\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732095    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgn7j\" (UniqueName: \"kubernetes.io/projected/f6030f52-8069-4c84-971f-a3733c9c2f7c-kube-api-access-dgn7j\") pod \"node-resolver-p492t\" (UID: \"f6030f52-8069-4c84-971f-a3733c9c2f7c\") " pod="openshift-dns/node-resolver-p492t"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732120    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-cnibin\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.732674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-multus-conf-dir\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732182    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29fd614e-5893-4211-9e46-965e0af8fbde-iptables-alerter-script\") pod \"iptables-alerter-fgdxb\" (UID: \"29fd614e-5893-4211-9e46-965e0af8fbde\") " pod="openshift-network-operator/iptables-alerter-fgdxb"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732194    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-cnibin\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732184    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnlhd\" (UniqueName: \"kubernetes.io/projected/5f734035-38a4-44f2-80ae-1b668f6b158f-kube-api-access-pnlhd\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732231    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-registration-dir\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732246    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-multus-conf-dir\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732256    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-sys\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732300    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b88af1ec-e8e2-4a62-a235-7062bdc5c9f9-serviceca\") pod \"node-ca-qmvsb\" (UID: \"b88af1ec-e8e2-4a62-a235-7062bdc5c9f9\") " pod="openshift-image-registry/node-ca-qmvsb"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732324    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-etc-kubernetes\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732358    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-system-cni-dir\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732372    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-etc-kubernetes\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732377    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-kubelet\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732410    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-system-cni-dir\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732416    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-run-openvswitch\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732432    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732437    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-kubelet\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732449    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:42.733413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732466    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bbxb\" (UniqueName: \"kubernetes.io/projected/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-kube-api-access-4bbxb\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732471    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-run-openvswitch\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732478    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732488    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-etc-openvswitch\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732506    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-ovnkube-config\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732522    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732538    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6030f52-8069-4c84-971f-a3733c9c2f7c-hosts-file\") pod \"node-resolver-p492t\" (UID: \"f6030f52-8069-4c84-971f-a3733c9c2f7c\") " pod="openshift-dns/node-resolver-p492t"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732565    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-system-cni-dir\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732663    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-multus-cni-dir\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732676    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-system-cni-dir\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732688    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-sysctl-conf\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732667    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-etc-openvswitch\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732719    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-slash\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-modprobe-d\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732775    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-multus-cni-dir\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732801    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-slash\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732825    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-cnibin\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-run-k8s-cni-cncf-io\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.733872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732895    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f734035-38a4-44f2-80ae-1b668f6b158f-multus-daemon-config\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732911    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-cnibin\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732918    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-cni-netd\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732923    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-run-k8s-cni-cncf-io\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732945    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732981    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-ovnkube-config\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.732984    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9f6b1040-2676-427e-ad0e-9a086722f3f5-dbus\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.733025    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-sys-fs\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.733043    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-cni-netd\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.733063    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-sysctl-d\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.733070    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.733089    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-run-multus-certs\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.733114    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-run-systemd\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.733196    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f734035-38a4-44f2-80ae-1b668f6b158f-host-run-multus-certs\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.733204    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-log-socket\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.733245    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-var-lib-kubelet\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.733250    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-log-socket\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.734382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.733288    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-run-systemd\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.735593 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.733363    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f734035-38a4-44f2-80ae-1b668f6b158f-multus-daemon-config\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.735593 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.735023    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-ovn-node-metrics-cert\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.735593 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:42.735345    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:00:42.735593 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:42.735370    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:00:42.735593 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:42.735383    2574 projected.go:196] Error preparing data for projected volume kube-api-access-vjv5c for pod openshift-network-diagnostics/network-check-target-vmtlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:42.735593 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:42.735459    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c podName:a92f5c93-2309-40bf-82b6-7cdafea0713f nodeName:}" failed. No retries permitted until 2026-07-07 15:00:43.235436737 +0000 UTC m=+2.969323121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vjv5c" (UniqueName: "kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c") pod "network-check-target-vmtlc" (UID: "a92f5c93-2309-40bf-82b6-7cdafea0713f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:42.735593 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.735466    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/69c65439-2c4a-4d89-be0e-1a1f786f2657-agent-certs\") pod \"konnectivity-agent-xb4ff\" (UID: \"69c65439-2c4a-4d89-be0e-1a1f786f2657\") " pod="kube-system/konnectivity-agent-xb4ff"
Jul 07 15:00:42.737580 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.737560    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs4gd\" (UniqueName: \"kubernetes.io/projected/29fd614e-5893-4211-9e46-965e0af8fbde-kube-api-access-gs4gd\") pod \"iptables-alerter-fgdxb\" (UID: \"29fd614e-5893-4211-9e46-965e0af8fbde\") " pod="openshift-network-operator/iptables-alerter-fgdxb"
Jul 07 15:00:42.739224 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.739207    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bbxb\" (UniqueName: \"kubernetes.io/projected/7c83f81e-fce0-4c5f-af0b-5a6662c9347b-kube-api-access-4bbxb\") pod \"multus-additional-cni-plugins-zsfgp\" (UID: \"7c83f81e-fce0-4c5f-af0b-5a6662c9347b\") " pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.739447 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.739427    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnlhd\" (UniqueName: \"kubernetes.io/projected/5f734035-38a4-44f2-80ae-1b668f6b158f-kube-api-access-pnlhd\") pod \"multus-vxzph\" (UID: \"5f734035-38a4-44f2-80ae-1b668f6b158f\") " pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.739825 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.739811    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk8vm\" (UniqueName: \"kubernetes.io/projected/1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3-kube-api-access-lk8vm\") pod \"ovnkube-node-d9zdp\" (UID: \"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.834081 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834043    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-systemd\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.834081 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834084    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-host\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.834314 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834105    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e147253-4b27-406f-bdae-c4fb442ccd7d-tmp\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.834314 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b88af1ec-e8e2-4a62-a235-7062bdc5c9f9-host\") pod \"node-ca-qmvsb\" (UID: \"b88af1ec-e8e2-4a62-a235-7062bdc5c9f9\") " pod="openshift-image-registry/node-ca-qmvsb"
Jul 07 15:00:42.834314 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834148    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-kubernetes\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.834314 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834167    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-tuned\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.834314 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834174    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-host\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.834314 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834171    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-systemd\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.834314 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834188    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9f6b1040-2676-427e-ad0e-9a086722f3f5-kubelet-config\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:42.834314 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834218    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-kubernetes\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.834314 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834229    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b88af1ec-e8e2-4a62-a235-7062bdc5c9f9-host\") pod \"node-ca-qmvsb\" (UID: \"b88af1ec-e8e2-4a62-a235-7062bdc5c9f9\") " pod="openshift-image-registry/node-ca-qmvsb"
Jul 07 15:00:42.834314 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834284    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-run\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834314    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9f6b1040-2676-427e-ad0e-9a086722f3f5-kubelet-config\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834316    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-device-dir\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834366    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-device-dir\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834380    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-sysconfig\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834357    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-run\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834414    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-sysconfig\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834416    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6030f52-8069-4c84-971f-a3733c9c2f7c-tmp-dir\") pod \"node-resolver-p492t\" (UID: \"f6030f52-8069-4c84-971f-a3733c9c2f7c\") " pod="openshift-dns/node-resolver-p492t"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834457    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnw9l\" (UniqueName: \"kubernetes.io/projected/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-kube-api-access-cnw9l\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834480    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834516    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-etc-selinux\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834549    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxvgk\" (UniqueName: \"kubernetes.io/projected/b88af1ec-e8e2-4a62-a235-7062bdc5c9f9-kube-api-access-dxvgk\") pod \"node-ca-qmvsb\" (UID: \"b88af1ec-e8e2-4a62-a235-7062bdc5c9f9\") " pod="openshift-image-registry/node-ca-qmvsb"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834573    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-lib-modules\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834598    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbjb9\" (UniqueName: \"kubernetes.io/projected/6e147253-4b27-406f-bdae-c4fb442ccd7d-kube-api-access-lbjb9\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834521    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834622    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgn7j\" (UniqueName: \"kubernetes.io/projected/f6030f52-8069-4c84-971f-a3733c9c2f7c-kube-api-access-dgn7j\") pod \"node-resolver-p492t\" (UID: \"f6030f52-8069-4c84-971f-a3733c9c2f7c\") " pod="openshift-dns/node-resolver-p492t"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834650    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-registration-dir\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.834761 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834671    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-sys\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834692    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b88af1ec-e8e2-4a62-a235-7062bdc5c9f9-serviceca\") pod \"node-ca-qmvsb\" (UID: \"b88af1ec-e8e2-4a62-a235-7062bdc5c9f9\") " pod="openshift-image-registry/node-ca-qmvsb"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834701    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6030f52-8069-4c84-971f-a3733c9c2f7c-tmp-dir\") pod \"node-resolver-p492t\" (UID: \"f6030f52-8069-4c84-971f-a3733c9c2f7c\") " pod="openshift-dns/node-resolver-p492t"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834718    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-etc-selinux\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834722    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834726    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-lib-modules\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834767    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834792    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6030f52-8069-4c84-971f-a3733c9c2f7c-hosts-file\") pod \"node-resolver-p492t\" (UID: \"f6030f52-8069-4c84-971f-a3733c9c2f7c\") " pod="openshift-dns/node-resolver-p492t"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834805    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-sys\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834817    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-sysctl-conf\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-modprobe-d\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834871    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9f6b1040-2676-427e-ad0e-9a086722f3f5-dbus\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834895    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-sys-fs\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834918    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-sysctl-d\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:42.834843    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834935    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-modprobe-d\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834949    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-var-lib-kubelet\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834961    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-sysctl-conf\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.835606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834977    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-socket-dir\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.836338 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:42.834991    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs podName:28f4b5b7-49c8-4d2a-8bb7-21bcce740d31 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:43.334977356 +0000 UTC m=+3.068863715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs") pod "network-metrics-daemon-sw26l" (UID: "28f4b5b7-49c8-4d2a-8bb7-21bcce740d31") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:42.836338 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.834989    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6030f52-8069-4c84-971f-a3733c9c2f7c-hosts-file\") pod \"node-resolver-p492t\" (UID: \"f6030f52-8069-4c84-971f-a3733c9c2f7c\") " pod="openshift-dns/node-resolver-p492t"
Jul 07 15:00:42.836338 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:42.835051    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:42.836338 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.835055    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2d26\" (UniqueName: \"kubernetes.io/projected/e85b2d7d-177c-4ac3-9100-a7b9381d8637-kube-api-access-b2d26\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.836338 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:42.835102    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret podName:9f6b1040-2676-427e-ad0e-9a086722f3f5 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:43.335084549 +0000 UTC m=+3.068970913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret") pod "global-pull-secret-syncer-bklgh" (UID: "9f6b1040-2676-427e-ad0e-9a086722f3f5") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:42.836338 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.835104    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-socket-dir\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.836338 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.835117    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-registration-dir\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.836338 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.835164    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e85b2d7d-177c-4ac3-9100-a7b9381d8637-sys-fs\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.836338 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.835205    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9f6b1040-2676-427e-ad0e-9a086722f3f5-dbus\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:42.836338 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.835207    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-var-lib-kubelet\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.836338 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.835260    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-sysctl-d\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.836338 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.835490    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b88af1ec-e8e2-4a62-a235-7062bdc5c9f9-serviceca\") pod \"node-ca-qmvsb\" (UID: \"b88af1ec-e8e2-4a62-a235-7062bdc5c9f9\") " pod="openshift-image-registry/node-ca-qmvsb"
Jul 07 15:00:42.836807 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.836602    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e147253-4b27-406f-bdae-c4fb442ccd7d-tmp\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.837328 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.837305    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e147253-4b27-406f-bdae-c4fb442ccd7d-etc-tuned\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.844114 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.843920    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbjb9\" (UniqueName: \"kubernetes.io/projected/6e147253-4b27-406f-bdae-c4fb442ccd7d-kube-api-access-lbjb9\") pod \"tuned-bfmtj\" (UID: \"6e147253-4b27-406f-bdae-c4fb442ccd7d\") " pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.844114 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.844036    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgn7j\" (UniqueName: \"kubernetes.io/projected/f6030f52-8069-4c84-971f-a3733c9c2f7c-kube-api-access-dgn7j\") pod \"node-resolver-p492t\" (UID: \"f6030f52-8069-4c84-971f-a3733c9c2f7c\") " pod="openshift-dns/node-resolver-p492t"
Jul 07 15:00:42.844666 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.844642    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2d26\" (UniqueName: \"kubernetes.io/projected/e85b2d7d-177c-4ac3-9100-a7b9381d8637-kube-api-access-b2d26\") pod \"aws-ebs-csi-driver-node-4mmn4\" (UID: \"e85b2d7d-177c-4ac3-9100-a7b9381d8637\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.844774 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.844754    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnw9l\" (UniqueName: \"kubernetes.io/projected/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-kube-api-access-cnw9l\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:42.845085 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.845030    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxvgk\" (UniqueName: \"kubernetes.io/projected/b88af1ec-e8e2-4a62-a235-7062bdc5c9f9-kube-api-access-dxvgk\") pod \"node-ca-qmvsb\" (UID: \"b88af1ec-e8e2-4a62-a235-7062bdc5c9f9\") " pod="openshift-image-registry/node-ca-qmvsb"
Jul 07 15:00:42.866764 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.866710    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-187.ec2.internal" event={"ID":"e1991cb1cdb7a97f906f31ef43205300","Type":"ContainerStarted","Data":"0f445a1a74c5cffa80c6a5356c69db84b29477c70de2ae95958de01a0a6dcdd4"}
Jul 07 15:00:42.868585 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.868551    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal" event={"ID":"bffa8a0d8a526e727a45f5076f1ca78c","Type":"ContainerStarted","Data":"efb59eaaadfeda9ad35e57566f1f5001851296ce922c811fdd0a27b77f826ac6"}
Jul 07 15:00:42.918077 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.918040    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:00:42.926415 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.926397    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fgdxb"
Jul 07 15:00:42.928369 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:42.928339    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac0f577_17f7_4195_ab40_ac4dc7c0e8c3.slice/crio-97472d13f5e8e1cf247eb1a31976d17dbd77f878af8ee9aae6a8844e2f029a26 WatchSource:0}: Error finding container 97472d13f5e8e1cf247eb1a31976d17dbd77f878af8ee9aae6a8844e2f029a26: Status 404 returned error can't find the container with id 97472d13f5e8e1cf247eb1a31976d17dbd77f878af8ee9aae6a8844e2f029a26
Jul 07 15:00:42.934695 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:42.934665    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29fd614e_5893_4211_9e46_965e0af8fbde.slice/crio-78d50ecca3f3cf0c3ab443c87ee83025cec938e62b1f41b8b33d238dce02473a WatchSource:0}: Error finding container 78d50ecca3f3cf0c3ab443c87ee83025cec938e62b1f41b8b33d238dce02473a: Status 404 returned error can't find the container with id 78d50ecca3f3cf0c3ab443c87ee83025cec938e62b1f41b8b33d238dce02473a
Jul 07 15:00:42.936775 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.936750    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zsfgp"
Jul 07 15:00:42.942556 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.942540    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vxzph"
Jul 07 15:00:42.945699 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:42.945680    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c83f81e_fce0_4c5f_af0b_5a6662c9347b.slice/crio-a194c61c1a53153231cbfc8b9033c3cc17cda425031a053fff9714bb96959e3d WatchSource:0}: Error finding container a194c61c1a53153231cbfc8b9033c3cc17cda425031a053fff9714bb96959e3d: Status 404 returned error can't find the container with id a194c61c1a53153231cbfc8b9033c3cc17cda425031a053fff9714bb96959e3d
Jul 07 15:00:42.949292 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.949272    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xb4ff"
Jul 07 15:00:42.950809 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:42.950788    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f734035_38a4_44f2_80ae_1b668f6b158f.slice/crio-d4469000185938b593e61e5a4410f09136fcbea735e978b6c75ccf65c1657ad4 WatchSource:0}: Error finding container d4469000185938b593e61e5a4410f09136fcbea735e978b6c75ccf65c1657ad4: Status 404 returned error can't find the container with id d4469000185938b593e61e5a4410f09136fcbea735e978b6c75ccf65c1657ad4
Jul 07 15:00:42.956127 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.956105    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4"
Jul 07 15:00:42.958073 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:42.957995    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c65439_2c4a_4d89_be0e_1a1f786f2657.slice/crio-e4d1ddbf27810bc90864d217faf35341cba12edff631b786bfb02b6198af0553 WatchSource:0}: Error finding container e4d1ddbf27810bc90864d217faf35341cba12edff631b786bfb02b6198af0553: Status 404 returned error can't find the container with id e4d1ddbf27810bc90864d217faf35341cba12edff631b786bfb02b6198af0553
Jul 07 15:00:42.963909 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.963890    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bfmtj"
Jul 07 15:00:42.964160 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:42.964136    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode85b2d7d_177c_4ac3_9100_a7b9381d8637.slice/crio-b8cd7e5253de1353af3ab1c434ec7c22028b520d0584432e0f251104559a0e11 WatchSource:0}: Error finding container b8cd7e5253de1353af3ab1c434ec7c22028b520d0584432e0f251104559a0e11: Status 404 returned error can't find the container with id b8cd7e5253de1353af3ab1c434ec7c22028b520d0584432e0f251104559a0e11
Jul 07 15:00:42.969790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.969770    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p492t"
Jul 07 15:00:42.972060 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:42.972037    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e147253_4b27_406f_bdae_c4fb442ccd7d.slice/crio-e5eaac5410e19db78b60ef6a1c55cc2f5a9ae92fe94d14213bcf5ba6a3023ab0 WatchSource:0}: Error finding container e5eaac5410e19db78b60ef6a1c55cc2f5a9ae92fe94d14213bcf5ba6a3023ab0: Status 404 returned error can't find the container with id e5eaac5410e19db78b60ef6a1c55cc2f5a9ae92fe94d14213bcf5ba6a3023ab0
Jul 07 15:00:42.975505 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:42.975482    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qmvsb"
Jul 07 15:00:42.981334 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:42.981313    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6030f52_8069_4c84_971f_a3733c9c2f7c.slice/crio-6e3ddbc78bbf6a575cfcbd032e934d85b852f584f879842a7f2f71ea65b35621 WatchSource:0}: Error finding container 6e3ddbc78bbf6a575cfcbd032e934d85b852f584f879842a7f2f71ea65b35621: Status 404 returned error can't find the container with id 6e3ddbc78bbf6a575cfcbd032e934d85b852f584f879842a7f2f71ea65b35621
Jul 07 15:00:42.987901 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:00:42.987880    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88af1ec_e8e2_4a62_a235_7062bdc5c9f9.slice/crio-55389b89e4c7ad5f6975fba8feee9dfd419129a66a78cce4d663362a05a4ea4c WatchSource:0}: Error finding container 55389b89e4c7ad5f6975fba8feee9dfd419129a66a78cce4d663362a05a4ea4c: Status 404 returned error can't find the container with id 55389b89e4c7ad5f6975fba8feee9dfd419129a66a78cce4d663362a05a4ea4c
Jul 07 15:00:43.008021 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.007979    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:00:43.237466 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.237387    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjv5c\" (UniqueName: \"kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c\") pod \"network-check-target-vmtlc\" (UID: \"a92f5c93-2309-40bf-82b6-7cdafea0713f\") " pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:43.237613 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:43.237586    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:00:43.237613 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:43.237610    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:00:43.237694 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:43.237619    2574 projected.go:196] Error preparing data for projected volume kube-api-access-vjv5c for pod openshift-network-diagnostics/network-check-target-vmtlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:43.237731 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:43.237692    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c podName:a92f5c93-2309-40bf-82b6-7cdafea0713f nodeName:}" failed. No retries permitted until 2026-07-07 15:00:44.237658204 +0000 UTC m=+3.971544578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjv5c" (UniqueName: "kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c") pod "network-check-target-vmtlc" (UID: "a92f5c93-2309-40bf-82b6-7cdafea0713f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:43.338726 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.338689    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:43.338911 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:43.338863    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:43.338911 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.338891    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:43.339048 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:43.338946    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret podName:9f6b1040-2676-427e-ad0e-9a086722f3f5 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:44.338916817 +0000 UTC m=+4.072803195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret") pod "global-pull-secret-syncer-bklgh" (UID: "9f6b1040-2676-427e-ad0e-9a086722f3f5") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:43.339120 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:43.339061    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:43.339120 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:43.339113    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs podName:28f4b5b7-49c8-4d2a-8bb7-21bcce740d31 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:44.339101748 +0000 UTC m=+4.072988113 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs") pod "network-metrics-daemon-sw26l" (UID: "28f4b5b7-49c8-4d2a-8bb7-21bcce740d31") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:43.662396 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.662332    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:55:42 +0000 UTC" deadline="2028-04-19 06:33:03.860347304 +0000 UTC"
Jul 07 15:00:43.662396 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.662393    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15639h32m20.197959154s"
Jul 07 15:00:43.861366 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.861226    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:43.861522 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:43.861360    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:00:43.874042 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.873941    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xb4ff" event={"ID":"69c65439-2c4a-4d89-be0e-1a1f786f2657","Type":"ContainerStarted","Data":"e4d1ddbf27810bc90864d217faf35341cba12edff631b786bfb02b6198af0553"}
Jul 07 15:00:43.876486 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.876146    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsfgp" event={"ID":"7c83f81e-fce0-4c5f-af0b-5a6662c9347b","Type":"ContainerStarted","Data":"a194c61c1a53153231cbfc8b9033c3cc17cda425031a053fff9714bb96959e3d"}
Jul 07 15:00:43.879484 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.879453    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qmvsb" event={"ID":"b88af1ec-e8e2-4a62-a235-7062bdc5c9f9","Type":"ContainerStarted","Data":"55389b89e4c7ad5f6975fba8feee9dfd419129a66a78cce4d663362a05a4ea4c"}
Jul 07 15:00:43.882371 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.882338    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bfmtj" event={"ID":"6e147253-4b27-406f-bdae-c4fb442ccd7d","Type":"ContainerStarted","Data":"e5eaac5410e19db78b60ef6a1c55cc2f5a9ae92fe94d14213bcf5ba6a3023ab0"}
Jul 07 15:00:43.886802 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.886728    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vxzph" event={"ID":"5f734035-38a4-44f2-80ae-1b668f6b158f","Type":"ContainerStarted","Data":"d4469000185938b593e61e5a4410f09136fcbea735e978b6c75ccf65c1657ad4"}
Jul 07 15:00:43.888800 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.888769    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fgdxb" event={"ID":"29fd614e-5893-4211-9e46-965e0af8fbde","Type":"ContainerStarted","Data":"78d50ecca3f3cf0c3ab443c87ee83025cec938e62b1f41b8b33d238dce02473a"}
Jul 07 15:00:43.891830 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.891770    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp" event={"ID":"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3","Type":"ContainerStarted","Data":"97472d13f5e8e1cf247eb1a31976d17dbd77f878af8ee9aae6a8844e2f029a26"}
Jul 07 15:00:43.898218 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.898190    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p492t" event={"ID":"f6030f52-8069-4c84-971f-a3733c9c2f7c","Type":"ContainerStarted","Data":"6e3ddbc78bbf6a575cfcbd032e934d85b852f584f879842a7f2f71ea65b35621"}
Jul 07 15:00:43.909187 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:43.909149    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4" event={"ID":"e85b2d7d-177c-4ac3-9100-a7b9381d8637","Type":"ContainerStarted","Data":"b8cd7e5253de1353af3ab1c434ec7c22028b520d0584432e0f251104559a0e11"}
Jul 07 15:00:44.245276 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:44.244834    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjv5c\" (UniqueName: \"kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c\") pod \"network-check-target-vmtlc\" (UID: \"a92f5c93-2309-40bf-82b6-7cdafea0713f\") " pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:44.245276 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:44.245203    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:00:44.245276 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:44.245227    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:00:44.245276 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:44.245242    2574 projected.go:196] Error preparing data for projected volume kube-api-access-vjv5c for pod openshift-network-diagnostics/network-check-target-vmtlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:44.245550 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:44.245298    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c podName:a92f5c93-2309-40bf-82b6-7cdafea0713f nodeName:}" failed. No retries permitted until 2026-07-07 15:00:46.245280128 +0000 UTC m=+5.979166493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjv5c" (UniqueName: "kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c") pod "network-check-target-vmtlc" (UID: "a92f5c93-2309-40bf-82b6-7cdafea0713f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:44.346468 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:44.345683    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:44.346468 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:44.345734    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:44.346468 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:44.345890    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:44.346468 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:44.345951    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret podName:9f6b1040-2676-427e-ad0e-9a086722f3f5 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:46.345933994 +0000 UTC m=+6.079820375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret") pod "global-pull-secret-syncer-bklgh" (UID: "9f6b1040-2676-427e-ad0e-9a086722f3f5") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:44.346468 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:44.346363    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:44.346468 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:44.346426    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs podName:28f4b5b7-49c8-4d2a-8bb7-21bcce740d31 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:46.346407841 +0000 UTC m=+6.080294224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs") pod "network-metrics-daemon-sw26l" (UID: "28f4b5b7-49c8-4d2a-8bb7-21bcce740d31") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:44.663088 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:44.663020    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:55:42 +0000 UTC" deadline="2028-04-07 04:22:03.149621782 +0000 UTC"
Jul 07 15:00:44.663088 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:44.663087    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15349h21m18.486540058s"
Jul 07 15:00:44.864117 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:44.864079    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:44.864303 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:44.864200    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:00:44.864611 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:44.864589    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:44.864748 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:44.864704    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:00:44.916800 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:44.916763    2574 generic.go:356] "Generic (PLEG): container finished" podID="bffa8a0d8a526e727a45f5076f1ca78c" containerID="693d8bb343755f4aeedc14de5cde50b8008f92996e7fecc524051ded78fd159e" exitCode=0
Jul 07 15:00:44.916965 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:44.916821    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal" event={"ID":"bffa8a0d8a526e727a45f5076f1ca78c","Type":"ContainerDied","Data":"693d8bb343755f4aeedc14de5cde50b8008f92996e7fecc524051ded78fd159e"}
Jul 07 15:00:45.862948 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:45.862160    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:45.862948 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:45.862300    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:00:46.267040 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:46.266905    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjv5c\" (UniqueName: \"kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c\") pod \"network-check-target-vmtlc\" (UID: \"a92f5c93-2309-40bf-82b6-7cdafea0713f\") " pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:46.267209 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:46.267106    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:00:46.267209 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:46.267129    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:00:46.267209 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:46.267143    2574 projected.go:196] Error preparing data for projected volume kube-api-access-vjv5c for pod openshift-network-diagnostics/network-check-target-vmtlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:46.267209 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:46.267207    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c podName:a92f5c93-2309-40bf-82b6-7cdafea0713f nodeName:}" failed. No retries permitted until 2026-07-07 15:00:50.267187984 +0000 UTC m=+10.001074348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjv5c" (UniqueName: "kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c") pod "network-check-target-vmtlc" (UID: "a92f5c93-2309-40bf-82b6-7cdafea0713f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:46.367736 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:46.367698    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:46.367910 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:46.367752    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:46.367910 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:46.367879    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:46.368070 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:46.367941    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret podName:9f6b1040-2676-427e-ad0e-9a086722f3f5 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:50.367921257 +0000 UTC m=+10.101807623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret") pod "global-pull-secret-syncer-bklgh" (UID: "9f6b1040-2676-427e-ad0e-9a086722f3f5") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:46.368353 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:46.368334    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:46.368423 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:46.368389    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs podName:28f4b5b7-49c8-4d2a-8bb7-21bcce740d31 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:50.368372992 +0000 UTC m=+10.102259357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs") pod "network-metrics-daemon-sw26l" (UID: "28f4b5b7-49c8-4d2a-8bb7-21bcce740d31") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:46.863914 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:46.863879    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:46.864418 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:46.864030    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:46.864418 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:46.864036    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:00:46.864418 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:46.864139    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:00:47.861700 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:47.861668    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:47.861869 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:47.861798    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:00:48.861320 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:48.861208    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:48.861778 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:48.861349    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:00:48.861778 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:48.861732    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:48.861895 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:48.861833    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:00:49.861637 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:49.861597    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:49.862127 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:49.861735    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:00:50.306593 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:50.306542    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjv5c\" (UniqueName: \"kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c\") pod \"network-check-target-vmtlc\" (UID: \"a92f5c93-2309-40bf-82b6-7cdafea0713f\") " pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:50.306780 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:50.306761    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:00:50.306842 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:50.306788    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:00:50.306842 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:50.306803    2574 projected.go:196] Error preparing data for projected volume kube-api-access-vjv5c for pod openshift-network-diagnostics/network-check-target-vmtlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:50.306949 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:50.306865    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c podName:a92f5c93-2309-40bf-82b6-7cdafea0713f nodeName:}" failed. No retries permitted until 2026-07-07 15:00:58.306844952 +0000 UTC m=+18.040731312 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjv5c" (UniqueName: "kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c") pod "network-check-target-vmtlc" (UID: "a92f5c93-2309-40bf-82b6-7cdafea0713f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:50.407754 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:50.407372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:50.407754 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:50.407426    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:50.407754 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:50.407560    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:50.407754 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:50.407565    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:50.407754 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:50.407626    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret podName:9f6b1040-2676-427e-ad0e-9a086722f3f5 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:58.407607553 +0000 UTC m=+18.141493916 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret") pod "global-pull-secret-syncer-bklgh" (UID: "9f6b1040-2676-427e-ad0e-9a086722f3f5") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:50.407754 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:50.407647    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs podName:28f4b5b7-49c8-4d2a-8bb7-21bcce740d31 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:58.407636321 +0000 UTC m=+18.141522685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs") pod "network-metrics-daemon-sw26l" (UID: "28f4b5b7-49c8-4d2a-8bb7-21bcce740d31") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:50.862804 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:50.862720    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:50.863455 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:50.862838    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:00:50.863455 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:50.862915    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:50.863455 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:50.863067    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:00:51.861608 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:51.861574    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:51.861806 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:51.861718    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:00:52.865672 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:52.865276    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:52.865672 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:52.865431    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:00:52.866288 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:52.865905    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:52.866288 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:52.866032    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:00:53.861636 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:53.861610    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:53.861774 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:53.861703    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:00:54.861865 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:54.861831    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:54.862348 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:54.861837    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:54.862348 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:54.861982    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:00:54.862348 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:54.862055    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:00:55.861353 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:55.861320    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:55.861540 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:55.861427    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:00:56.861961 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:56.861923    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:56.862424 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:56.862081    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:00:56.862424 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:56.862130    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:56.862424 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:56.862257    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:00:57.862037 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:57.861981    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:57.862451 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:57.862122    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:00:58.369466 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:58.369431    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjv5c\" (UniqueName: \"kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c\") pod \"network-check-target-vmtlc\" (UID: \"a92f5c93-2309-40bf-82b6-7cdafea0713f\") " pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:58.369638 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:58.369612    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:00:58.369694 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:58.369641    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:00:58.369694 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:58.369655    2574 projected.go:196] Error preparing data for projected volume kube-api-access-vjv5c for pod openshift-network-diagnostics/network-check-target-vmtlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:58.369776 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:58.369722    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c podName:a92f5c93-2309-40bf-82b6-7cdafea0713f nodeName:}" failed. No retries permitted until 2026-07-07 15:01:14.36970298 +0000 UTC m=+34.103589343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjv5c" (UniqueName: "kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c") pod "network-check-target-vmtlc" (UID: "a92f5c93-2309-40bf-82b6-7cdafea0713f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:00:58.470707 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:58.470667    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:58.470707 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:58.470709    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:58.470946 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:58.470827    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:58.470946 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:58.470838    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:58.470946 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:58.470881    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret podName:9f6b1040-2676-427e-ad0e-9a086722f3f5 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:14.47086755 +0000 UTC m=+34.204753910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret") pod "global-pull-secret-syncer-bklgh" (UID: "9f6b1040-2676-427e-ad0e-9a086722f3f5") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:00:58.470946 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:58.470896    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs podName:28f4b5b7-49c8-4d2a-8bb7-21bcce740d31 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:14.470889736 +0000 UTC m=+34.204776096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs") pod "network-metrics-daemon-sw26l" (UID: "28f4b5b7-49c8-4d2a-8bb7-21bcce740d31") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:00:58.861180 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:58.861148    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:00:58.861374 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:58.861145    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:00:58.861374 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:58.861297    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:00:58.861474 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:58.861383    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:00:59.862131 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:00:59.862103    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:00:59.862536 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:00:59.862213    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:01:00.862538 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:00.862496    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:00.862996 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:00.862615    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:01:00.862996 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:00.862658    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:01:00.862996 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:00.862785    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:01:01.861620 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:01.861580    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:01:01.861794 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:01.861716    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:01:02.861257 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.861102    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:01:02.861745 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.861102    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:02.861745 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:02.861342    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:01:02.861745 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:02.861418    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:01:02.953321 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.953291    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p492t" event={"ID":"f6030f52-8069-4c84-971f-a3733c9c2f7c","Type":"ContainerStarted","Data":"6311347c21ab01355c9ae240206fc4a3f5964f4f460a9f5584969b10eaa20972"}
Jul 07 15:01:02.954751 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.954724    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4" event={"ID":"e85b2d7d-177c-4ac3-9100-a7b9381d8637","Type":"ContainerStarted","Data":"d198f1a5ddce3e922f3cf0f0cc685012aca73194703a9d45ddef68dbd40f6935"}
Jul 07 15:01:02.956073 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.956047    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xb4ff" event={"ID":"69c65439-2c4a-4d89-be0e-1a1f786f2657","Type":"ContainerStarted","Data":"45159fa4138a04d90588004146c97c0c8b9c7ab13bd7d1cae8246782be67e52f"}
Jul 07 15:01:02.957718 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.957571    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c83f81e-fce0-4c5f-af0b-5a6662c9347b" containerID="2ccd2fbf8fd4fdd95076d5dfd69a035c821de6a8a542e806e278dfcfd692e870" exitCode=0
Jul 07 15:01:02.957718 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.957647    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsfgp" event={"ID":"7c83f81e-fce0-4c5f-af0b-5a6662c9347b","Type":"ContainerDied","Data":"2ccd2fbf8fd4fdd95076d5dfd69a035c821de6a8a542e806e278dfcfd692e870"}
Jul 07 15:01:02.959275 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.959166    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-187.ec2.internal" event={"ID":"e1991cb1cdb7a97f906f31ef43205300","Type":"ContainerStarted","Data":"bd35a6b2ef3e5590db1fedd9faefb6d1515b1a16a9208b30d2abed13db80d67d"}
Jul 07 15:01:02.960646 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.960626    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qmvsb" event={"ID":"b88af1ec-e8e2-4a62-a235-7062bdc5c9f9","Type":"ContainerStarted","Data":"eeb23ce794fe2411cd9053db1080c39a4b30f0ba57acc2ae684b71e0523efcc6"}
Jul 07 15:01:02.963736 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.963716    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bfmtj" event={"ID":"6e147253-4b27-406f-bdae-c4fb442ccd7d","Type":"ContainerStarted","Data":"763ca18ebeee18dc4c779399ce0eecc80a9435f92541f4270102283088c6249e"}
Jul 07 15:01:02.964964 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.964945    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vxzph" event={"ID":"5f734035-38a4-44f2-80ae-1b668f6b158f","Type":"ContainerStarted","Data":"6d962740109023570bc1253a6dc9a888900af9662f4db330bb030b98a9ba1594"}
Jul 07 15:01:02.966556 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.966537    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp" event={"ID":"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3","Type":"ContainerStarted","Data":"a7f2ac7df0f80489a553801936550865a97a56ab94d9249211e31e031c05c5fe"}
Jul 07 15:01:02.966622 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.966588    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp" event={"ID":"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3","Type":"ContainerStarted","Data":"f5c03daf176b76f3824116c47d9404b961e8cd0b65676ad316a4f47955073df7"}
Jul 07 15:01:02.968539 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.968511    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal" event={"ID":"bffa8a0d8a526e727a45f5076f1ca78c","Type":"ContainerStarted","Data":"26bacc8c70263b6d9d02b0670b225abe8d33f86002e5c0ac642a985a88e10580"}
Jul 07 15:01:02.971747 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:02.971703    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p492t" podStartSLOduration=2.640269601 podStartE2EDuration="21.971688597s" totalImagesPullingTime="19.331418996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:02.971640819 +0000 UTC m=+22.705527200" watchObservedRunningTime="2026-07-07 15:01:02.971688597 +0000 UTC m=+22.705574978"
Jul 07 15:01:03.010173 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.010123    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bfmtj" podStartSLOduration=2.653577686 podStartE2EDuration="22.010106437s" totalImagesPullingTime="19.356528751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:03.009407961 +0000 UTC m=+22.743294343" watchObservedRunningTime="2026-07-07 15:01:03.010106437 +0000 UTC m=+22.743992818"
Jul 07 15:01:03.022789 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.022743    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-187.ec2.internal" podStartSLOduration=22.022726525 podStartE2EDuration="22.022726525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:03.022278912 +0000 UTC m=+22.756165294" watchObservedRunningTime="2026-07-07 15:01:03.022726525 +0000 UTC m=+22.756612906"
Jul 07 15:01:03.049977 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.049811    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vxzph" podStartSLOduration=3.624159544 podStartE2EDuration="23.04979512s" totalImagesPullingTime="19.425635576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:03.049643488 +0000 UTC m=+22.783529871" watchObservedRunningTime="2026-07-07 15:01:03.04979512 +0000 UTC m=+22.783681501"
Jul 07 15:01:03.088683 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.088637    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xb4ff" podStartSLOduration=6.606194449 podStartE2EDuration="22.088620819s" totalImagesPullingTime="15.48242637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:03.069956618 +0000 UTC m=+22.803843001" watchObservedRunningTime="2026-07-07 15:01:03.088620819 +0000 UTC m=+22.822507202"
Jul 07 15:01:03.089145 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.089114    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qmvsb" podStartSLOduration=10.840873235 podStartE2EDuration="22.089101828s" totalImagesPullingTime="11.248228593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:03.088389361 +0000 UTC m=+22.822275744" watchObservedRunningTime="2026-07-07 15:01:03.089101828 +0000 UTC m=+22.822988241"
Jul 07 15:01:03.102089 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.102041    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-187.ec2.internal" podStartSLOduration=22.102020521 podStartE2EDuration="22.102020521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:03.101850224 +0000 UTC m=+22.835736607" watchObservedRunningTime="2026-07-07 15:01:03.102020521 +0000 UTC m=+22.835906896"
Jul 07 15:01:03.861824 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.861735    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:01:03.862442 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:03.861846    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:01:03.971868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.971832    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fgdxb" event={"ID":"29fd614e-5893-4211-9e46-965e0af8fbde","Type":"ContainerStarted","Data":"1ea68f5a1841882d1e920a26d215ebead9245ae0f523ef2a6e17c1da6ce9fe04"}
Jul 07 15:01:03.974477 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.974453    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:01:03.974764 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.974743    2574 generic.go:356] "Generic (PLEG): container finished" podID="1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3" containerID="a7f2ac7df0f80489a553801936550865a97a56ab94d9249211e31e031c05c5fe" exitCode=1
Jul 07 15:01:03.974872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.974847    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp" event={"ID":"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3","Type":"ContainerDied","Data":"a7f2ac7df0f80489a553801936550865a97a56ab94d9249211e31e031c05c5fe"}
Jul 07 15:01:03.974940 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.974927    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp" event={"ID":"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3","Type":"ContainerStarted","Data":"a2348721b9435b1661a15f2fa2ac7991c1e91ba9a8e3236beda5fe94208b1ccc"}
Jul 07 15:01:03.974980 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.974972    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp" event={"ID":"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3","Type":"ContainerStarted","Data":"ef56b005c01facb91df8cf7e61e7309c7b7772646a08f9cc67fad71c0e444642"}
Jul 07 15:01:03.975029 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.975001    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp" event={"ID":"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3","Type":"ContainerStarted","Data":"69f20f4823e9924703a919c3f132115dfdac5c504db84df0b2aa8c7a98ba5381"}
Jul 07 15:01:03.975065 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.975053    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp" event={"ID":"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3","Type":"ContainerStarted","Data":"5766dc5974034e9a746c459fbdd643f5b1933014f0219e8dc10f1ab96e8443a8"}
Jul 07 15:01:03.988713 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:03.988648    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fgdxb" podStartSLOduration=4.609518302 podStartE2EDuration="23.98862727s" totalImagesPullingTime="19.379108968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:03.98831725 +0000 UTC m=+23.722203633" watchObservedRunningTime="2026-07-07 15:01:03.98862727 +0000 UTC m=+23.722513652"
Jul 07 15:01:04.574640 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:04.574610    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xb4ff"
Jul 07 15:01:04.575379 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:04.575361    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xb4ff"
Jul 07 15:01:04.583981 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:04.583955    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 15:01:04.757264 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:04.757084    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T15:01:04.583976717Z","UUID":"18faa4cc-7765-4406-a654-8d003a3cc63c","Handler":null,"Name":"","Endpoint":""}
Jul 07 15:01:04.758592 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:04.758574    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 15:01:04.758676 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:04.758620    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 15:01:04.862148 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:04.862118    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:04.862592 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:04.862238    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:01:04.862592 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:04.862285    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:01:04.862592 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:04.862410    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:01:04.978883 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:04.978849    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4" event={"ID":"e85b2d7d-177c-4ac3-9100-a7b9381d8637","Type":"ContainerStarted","Data":"1dba89d622dd31cd5bb6ecb21916e6693ae3e196bb0d5c535738eeae78a75c37"}
Jul 07 15:01:05.861660 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:05.861527    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:01:05.861854 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:05.861707    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:01:05.984150 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:05.984125    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:01:05.984564 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:05.984489    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp" event={"ID":"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3","Type":"ContainerStarted","Data":"4f2ed19970cf77ec45548871f17ecf305e63775cf42f8e019bb6a0286ab0b85a"}
Jul 07 15:01:05.986385 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:05.986364    2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 15:01:05.986385 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:05.986362    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4" event={"ID":"e85b2d7d-177c-4ac3-9100-a7b9381d8637","Type":"ContainerStarted","Data":"b3a4a99385986f75e6f44aec19a645a2e921ce5870afe4db5717d10a16fcd4d3"}
Jul 07 15:01:06.004670 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:06.004619    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mmn4" podStartSLOduration=2.504378025 podStartE2EDuration="25.004604411s" totalImagesPullingTime="22.500226386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:06.004174688 +0000 UTC m=+25.738061074" watchObservedRunningTime="2026-07-07 15:01:06.004604411 +0000 UTC m=+25.738490792"
Jul 07 15:01:06.862042 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:06.861992    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:01:06.862273 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:06.861992    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:06.862273 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:06.862125    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:01:06.862273 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:06.862204    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:01:07.861736 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:07.861707    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:01:07.862382 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:07.861850    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:01:07.994993 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:07.994730    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:01:07.995487 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:07.995336    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp" event={"ID":"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3","Type":"ContainerStarted","Data":"532a4e00eba9136eb406b1d3924b2bfabcbf955e78478b753d9dcd83c257c443"}
Jul 07 15:01:07.995752 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:07.995730    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:01:07.995864 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:07.995808    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:01:07.995864 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:07.995817    2574 scope.go:117] "RemoveContainer" containerID="a7f2ac7df0f80489a553801936550865a97a56ab94d9249211e31e031c05c5fe"
Jul 07 15:01:07.995965 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:07.995865    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:01:08.014324 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:08.014217    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:01:08.014411 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:08.014379    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:01:08.861268 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:08.861188    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:01:08.861436 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:08.861189    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:08.861436 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:08.861332    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:01:08.861436 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:08.861401    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:01:09.004789 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:09.004758    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:01:09.005240 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:09.005173    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp" event={"ID":"1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3","Type":"ContainerStarted","Data":"7f7153505dcb8329b29a90e9de7e80ff296675d7ec35e0899fa1e0dc6a6db639"}
Jul 07 15:01:09.032111 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:09.032036    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp" podStartSLOduration=9.229958297 podStartE2EDuration="29.031998633s" totalImagesPullingTime="19.802040336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:09.031557406 +0000 UTC m=+28.765443790" watchObservedRunningTime="2026-07-07 15:01:09.031998633 +0000 UTC m=+28.765885018"
Jul 07 15:01:09.826755 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:09.826717    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bklgh"]
Jul 07 15:01:09.826926 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:09.826854    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:01:09.826976 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:09.826948    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:01:09.830113 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:09.830087    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sw26l"]
Jul 07 15:01:09.830252 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:09.830196    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:01:09.830330 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:09.830308    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:01:09.830837 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:09.830814    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vmtlc"]
Jul 07 15:01:09.830967 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:09.830896    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:09.831037 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:09.830980    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:01:11.011123 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:11.011086    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c83f81e-fce0-4c5f-af0b-5a6662c9347b" containerID="c5e988d4b4c85b74a6eaddf2e111dc2dd37841828ef6dd34d425c07a1b9a51e6" exitCode=0
Jul 07 15:01:11.011527 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:11.011133    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsfgp" event={"ID":"7c83f81e-fce0-4c5f-af0b-5a6662c9347b","Type":"ContainerDied","Data":"c5e988d4b4c85b74a6eaddf2e111dc2dd37841828ef6dd34d425c07a1b9a51e6"}
Jul 07 15:01:11.861342 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:11.861312    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:11.861499 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:11.861313    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:01:11.861499 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:11.861430    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:01:11.861622 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:11.861540    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:01:11.861622 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:11.861320    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:01:11.861704 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:11.861675    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:01:12.784412 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:12.784237    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xb4ff"
Jul 07 15:01:12.784991 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:12.784503    2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 15:01:12.784991 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:12.784961    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xb4ff"
Jul 07 15:01:13.018402 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:13.018367    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c83f81e-fce0-4c5f-af0b-5a6662c9347b" containerID="cbbd86a286f6b816681f5fb6ae0646f141a619f88409c3e78eea31b18deadfa9" exitCode=0
Jul 07 15:01:13.018598 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:13.018452    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsfgp" event={"ID":"7c83f81e-fce0-4c5f-af0b-5a6662c9347b","Type":"ContainerDied","Data":"cbbd86a286f6b816681f5fb6ae0646f141a619f88409c3e78eea31b18deadfa9"}
Jul 07 15:01:13.861446 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:13.861418    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:01:13.861886 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:13.861503    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:13.861886 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:13.861518    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:01:13.861886 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:13.861612    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:01:13.861886 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:13.861728    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:01:13.861886 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:13.861796    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:01:14.023399 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:14.023311    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c83f81e-fce0-4c5f-af0b-5a6662c9347b" containerID="c7b5a104c9528af54b4cd61b997897d9231a1ca5bf1632d2e0813a5bc4ffdf35" exitCode=0
Jul 07 15:01:14.023399 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:14.023364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsfgp" event={"ID":"7c83f81e-fce0-4c5f-af0b-5a6662c9347b","Type":"ContainerDied","Data":"c7b5a104c9528af54b4cd61b997897d9231a1ca5bf1632d2e0813a5bc4ffdf35"}
Jul 07 15:01:14.390187 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:14.390144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjv5c\" (UniqueName: \"kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c\") pod \"network-check-target-vmtlc\" (UID: \"a92f5c93-2309-40bf-82b6-7cdafea0713f\") " pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:14.390519 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:14.390290    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:01:14.390519 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:14.390308    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:01:14.390519 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:14.390322    2574 projected.go:196] Error preparing data for projected volume kube-api-access-vjv5c for pod openshift-network-diagnostics/network-check-target-vmtlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:01:14.390519 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:14.390378    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c podName:a92f5c93-2309-40bf-82b6-7cdafea0713f nodeName:}" failed. No retries permitted until 2026-07-07 15:01:46.390361288 +0000 UTC m=+66.124247649 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjv5c" (UniqueName: "kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c") pod "network-check-target-vmtlc" (UID: "a92f5c93-2309-40bf-82b6-7cdafea0713f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:01:14.490707 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:14.490668    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:01:14.490707 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:14.490716    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:01:14.490956 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:14.490844    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:01:14.490956 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:14.490915    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret podName:9f6b1040-2676-427e-ad0e-9a086722f3f5 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:46.490897114 +0000 UTC m=+66.224783480 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret") pod "global-pull-secret-syncer-bklgh" (UID: "9f6b1040-2676-427e-ad0e-9a086722f3f5") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:01:14.490956 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:14.490845    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:01:14.491139 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:14.491016    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs podName:28f4b5b7-49c8-4d2a-8bb7-21bcce740d31 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:46.490988255 +0000 UTC m=+66.224874638 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs") pod "network-metrics-daemon-sw26l" (UID: "28f4b5b7-49c8-4d2a-8bb7-21bcce740d31") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:01:15.861752 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:15.861707    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:01:15.862377 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:15.861764    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:01:15.862377 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:15.861830    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bklgh" podUID="9f6b1040-2676-427e-ad0e-9a086722f3f5"
Jul 07 15:01:15.862377 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:15.861764    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:15.862377 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:15.861873    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:01:15.862377 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:15.861929    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmtlc" podUID="a92f5c93-2309-40bf-82b6-7cdafea0713f"
Jul 07 15:01:16.125974 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.125895    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-187.ec2.internal" event="NodeReady"
Jul 07 15:01:16.126147 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.126086    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 15:01:16.161550 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.161486    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"]
Jul 07 15:01:16.165504 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.165480    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b9dc9555b-m4dw6"]
Jul 07 15:01:16.165643 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.165607    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:01:16.167628 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.167597    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 15:01:16.167628 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.167600    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xndjb\""
Jul 07 15:01:16.167750 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.167647    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 15:01:16.169537 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.169515    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"]
Jul 07 15:01:16.169621 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.169604    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.171607 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.171540    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dwmxm\""
Jul 07 15:01:16.171607 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.171570    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 15:01:16.171843 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.171689    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 15:01:16.171843 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.171796    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 15:01:16.173383 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.173361    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7"]
Jul 07 15:01:16.173470 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.173436    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:01:16.175332 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.175308    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 15:01:16.175430 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.175308    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 15:01:16.175484 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.175449    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 15:01:16.175781 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.175761    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 15:01:16.177285 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.177263    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"]
Jul 07 15:01:16.177384 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.177374    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7"
Jul 07 15:01:16.178550 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.178530    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 15:01:16.179708 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.179687    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 15:01:16.180018 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.179933    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pqkcs\""
Jul 07 15:01:16.182041 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.182018    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"]
Jul 07 15:01:16.182120 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.182060    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7"]
Jul 07 15:01:16.182120 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.182076    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b9dc9555b-m4dw6"]
Jul 07 15:01:16.182120 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.182096    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"]
Jul 07 15:01:16.182228 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.182135    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.184244 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.184223    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 15:01:16.184466 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.184448    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 15:01:16.184557 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.184471    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 15:01:16.184557 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.184537    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 15:01:16.189771 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.189747    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k2882"]
Jul 07 15:01:16.193593 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.193573    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kpdq6"]
Jul 07 15:01:16.193702 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.193687    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k2882"
Jul 07 15:01:16.197495 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.197470    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"]
Jul 07 15:01:16.197637 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.197617    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:16.200853 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.200828    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 15:01:16.200978 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.200957    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 15:01:16.201083 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.201068    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j8pj6\""
Jul 07 15:01:16.201186 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.201171    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 15:01:16.202702 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.202682    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 15:01:16.202881 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.202868    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bp52v\""
Jul 07 15:01:16.203361 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.203348    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 15:01:16.206439 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.206403    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kpdq6"]
Jul 07 15:01:16.207092 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.207075    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k2882"]
Jul 07 15:01:16.305056 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brqxx\" (UniqueName: \"kubernetes.io/projected/bf15a5e6-deb7-4a52-bf42-1570d1d87182-kube-api-access-brqxx\") pod \"ingress-canary-k2882\" (UID: \"bf15a5e6-deb7-4a52-bf42-1570d1d87182\") " pod="openshift-ingress-canary/ingress-canary-k2882"
Jul 07 15:01:16.305056 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9ca387e-d409-4533-90f2-b0101613e043-ca\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.305247 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305088    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vgvq\" (UniqueName: \"kubernetes.io/projected/14576e55-7854-4572-8ac5-d2fc741ccb87-kube-api-access-4vgvq\") pod \"managed-serviceaccount-addon-agent-7f998ddff8-zm8n7\" (UID: \"14576e55-7854-4572-8ac5-d2fc741ccb87\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7"
Jul 07 15:01:16.305247 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305116    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30db6f20-e529-4ed7-b894-521a841a5445-registry-certificates\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.305247 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305141    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9ca387e-d409-4533-90f2-b0101613e043-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.305247 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305158    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30db6f20-e529-4ed7-b894-521a841a5445-ca-trust-extracted\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.305247 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305184    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30db6f20-e529-4ed7-b894-521a841a5445-installation-pull-secrets\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.305247 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305205    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9ca387e-d409-4533-90f2-b0101613e043-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.305247 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14576e55-7854-4572-8ac5-d2fc741ccb87-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f998ddff8-zm8n7\" (UID: \"14576e55-7854-4572-8ac5-d2fc741ccb87\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7"
Jul 07 15:01:16.305247 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305240    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:16.305494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305266    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.305494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305291    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fkjs\" (UniqueName: \"kubernetes.io/projected/f9ca387e-d409-4533-90f2-b0101613e043-kube-api-access-9fkjs\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.305494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305311    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30db6f20-e529-4ed7-b894-521a841a5445-trusted-ca\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.305494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305384    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-tmp-dir\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:16.305494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305433    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9ca387e-d409-4533-90f2-b0101613e043-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.305494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305461    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:01:16.305681 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305497    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-config-volume\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:16.305681 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305514    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9ca387e-d409-4533-90f2-b0101613e043-hub\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.305681 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305531    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrlsw\" (UniqueName: \"kubernetes.io/projected/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-kube-api-access-rrlsw\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:16.305681 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305548    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54251ec3-451e-44b6-b218-35c93790d77a-tmp\") pod \"klusterlet-addon-workmgr-7db69c9d56-d7bvq\" (UID: \"54251ec3-451e-44b6-b218-35c93790d77a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:01:16.305681 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305588    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tskc8\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-kube-api-access-tskc8\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.305681 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30db6f20-e529-4ed7-b894-521a841a5445-image-registry-private-configuration\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.305681 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305632    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/54251ec3-451e-44b6-b218-35c93790d77a-klusterlet-config\") pod \"klusterlet-addon-workmgr-7db69c9d56-d7bvq\" (UID: \"54251ec3-451e-44b6-b218-35c93790d77a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:01:16.305681 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305678    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb6ll\" (UniqueName: \"kubernetes.io/projected/54251ec3-451e-44b6-b218-35c93790d77a-kube-api-access-mb6ll\") pod \"klusterlet-addon-workmgr-7db69c9d56-d7bvq\" (UID: \"54251ec3-451e-44b6-b218-35c93790d77a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:01:16.305897 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305703    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:01:16.305897 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305729    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf15a5e6-deb7-4a52-bf42-1570d1d87182-cert\") pod \"ingress-canary-k2882\" (UID: \"bf15a5e6-deb7-4a52-bf42-1570d1d87182\") " pod="openshift-ingress-canary/ingress-canary-k2882"
Jul 07 15:01:16.305897 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.305756    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-bound-sa-token\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.406495 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.406401    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30db6f20-e529-4ed7-b894-521a841a5445-ca-trust-extracted\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.406495 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.406456    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30db6f20-e529-4ed7-b894-521a841a5445-installation-pull-secrets\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.406495 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.406482    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9ca387e-d409-4533-90f2-b0101613e043-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.406777 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.406758    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14576e55-7854-4572-8ac5-d2fc741ccb87-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f998ddff8-zm8n7\" (UID: \"14576e55-7854-4572-8ac5-d2fc741ccb87\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7"
Jul 07 15:01:16.406822 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.406796    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:16.406868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.406823    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.406917 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.406860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fkjs\" (UniqueName: \"kubernetes.io/projected/f9ca387e-d409-4533-90f2-b0101613e043-kube-api-access-9fkjs\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.406917 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.406901    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30db6f20-e529-4ed7-b894-521a841a5445-trusted-ca\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.406917 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.406909    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30db6f20-e529-4ed7-b894-521a841a5445-ca-trust-extracted\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.407080 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.406944    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-tmp-dir\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:16.407576 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.407422    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9ca387e-d409-4533-90f2-b0101613e043-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.407576 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:16.407454    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:01:16.407576 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.407459    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9ca387e-d409-4533-90f2-b0101613e043-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.407576 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:16.407476    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9dc9555b-m4dw6: secret "image-registry-tls" not found
Jul 07 15:01:16.407576 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:16.407536    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 15:01:16.407576 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:16.407539    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls podName:30db6f20-e529-4ed7-b894-521a841a5445 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:16.907519736 +0000 UTC m=+36.641406100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls") pod "image-registry-5b9dc9555b-m4dw6" (UID: "30db6f20-e529-4ed7-b894-521a841a5445") : secret "image-registry-tls" not found
Jul 07 15:01:16.407576 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.407460    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:01:16.407931 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.407805    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-tmp-dir\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:16.407931 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:16.407812    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:01:16.407931 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.407847    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-config-volume\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:16.407931 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.407877    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9ca387e-d409-4533-90f2-b0101613e043-hub\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.407931 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.407890    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30db6f20-e529-4ed7-b894-521a841a5445-trusted-ca\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.407931 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:16.407899    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls podName:96e3cedc-88dc-46fe-bf69-bfaea614cc7f nodeName:}" failed. No retries permitted until 2026-07-07 15:01:16.907881306 +0000 UTC m=+36.641767672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls") pod "dns-default-kpdq6" (UID: "96e3cedc-88dc-46fe-bf69-bfaea614cc7f") : secret "dns-default-metrics-tls" not found
Jul 07 15:01:16.408191 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:16.407946    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert podName:0e6fd9d6-e904-446a-b031-06ebe9ac9ace nodeName:}" failed. No retries permitted until 2026-07-07 15:01:16.907930224 +0000 UTC m=+36.641816598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-zp7ss" (UID: "0e6fd9d6-e904-446a-b031-06ebe9ac9ace") : secret "networking-console-plugin-cert" not found
Jul 07 15:01:16.408191 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.407975    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrlsw\" (UniqueName: \"kubernetes.io/projected/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-kube-api-access-rrlsw\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:16.408191 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.407998    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54251ec3-451e-44b6-b218-35c93790d77a-tmp\") pod \"klusterlet-addon-workmgr-7db69c9d56-d7bvq\" (UID: \"54251ec3-451e-44b6-b218-35c93790d77a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:01:16.408191 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.408055    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tskc8\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-kube-api-access-tskc8\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.408191 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.408092    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30db6f20-e529-4ed7-b894-521a841a5445-image-registry-private-configuration\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.408191 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.408117    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/54251ec3-451e-44b6-b218-35c93790d77a-klusterlet-config\") pod \"klusterlet-addon-workmgr-7db69c9d56-d7bvq\" (UID: \"54251ec3-451e-44b6-b218-35c93790d77a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:01:16.408191 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.408150    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb6ll\" (UniqueName: \"kubernetes.io/projected/54251ec3-451e-44b6-b218-35c93790d77a-kube-api-access-mb6ll\") pod \"klusterlet-addon-workmgr-7db69c9d56-d7bvq\" (UID: \"54251ec3-451e-44b6-b218-35c93790d77a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:01:16.408191 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.408174    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:01:16.408494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.408198    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf15a5e6-deb7-4a52-bf42-1570d1d87182-cert\") pod \"ingress-canary-k2882\" (UID: \"bf15a5e6-deb7-4a52-bf42-1570d1d87182\") " pod="openshift-ingress-canary/ingress-canary-k2882"
Jul 07 15:01:16.408494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.408228    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-bound-sa-token\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.408494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.408263    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brqxx\" (UniqueName: \"kubernetes.io/projected/bf15a5e6-deb7-4a52-bf42-1570d1d87182-kube-api-access-brqxx\") pod \"ingress-canary-k2882\" (UID: \"bf15a5e6-deb7-4a52-bf42-1570d1d87182\") " pod="openshift-ingress-canary/ingress-canary-k2882"
Jul 07 15:01:16.408494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.408283    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9ca387e-d409-4533-90f2-b0101613e043-ca\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.408494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.408312    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vgvq\" (UniqueName: \"kubernetes.io/projected/14576e55-7854-4572-8ac5-d2fc741ccb87-kube-api-access-4vgvq\") pod \"managed-serviceaccount-addon-agent-7f998ddff8-zm8n7\" (UID: \"14576e55-7854-4572-8ac5-d2fc741ccb87\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7"
Jul 07 15:01:16.408494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.408326    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-config-volume\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:16.408494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.408335    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30db6f20-e529-4ed7-b894-521a841a5445-registry-certificates\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.408494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.408390    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9ca387e-d409-4533-90f2-b0101613e043-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.408826 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.408760    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30db6f20-e529-4ed7-b894-521a841a5445-registry-certificates\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.409971 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.409205    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54251ec3-451e-44b6-b218-35c93790d77a-tmp\") pod \"klusterlet-addon-workmgr-7db69c9d56-d7bvq\" (UID: \"54251ec3-451e-44b6-b218-35c93790d77a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:01:16.410298 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.410197    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:01:16.411897 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.411819    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30db6f20-e529-4ed7-b894-521a841a5445-installation-pull-secrets\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.411897 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.411841    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9ca387e-d409-4533-90f2-b0101613e043-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.412036 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.411935    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9ca387e-d409-4533-90f2-b0101613e043-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.413784 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.412256    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14576e55-7854-4572-8ac5-d2fc741ccb87-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f998ddff8-zm8n7\" (UID: \"14576e55-7854-4572-8ac5-d2fc741ccb87\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7"
Jul 07 15:01:16.413784 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.412387    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/54251ec3-451e-44b6-b218-35c93790d77a-klusterlet-config\") pod \"klusterlet-addon-workmgr-7db69c9d56-d7bvq\" (UID: \"54251ec3-451e-44b6-b218-35c93790d77a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:01:16.413784 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.413455    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30db6f20-e529-4ed7-b894-521a841a5445-image-registry-private-configuration\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.413965 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.413803    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9ca387e-d409-4533-90f2-b0101613e043-hub\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.414256 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.414235    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf15a5e6-deb7-4a52-bf42-1570d1d87182-cert\") pod \"ingress-canary-k2882\" (UID: \"bf15a5e6-deb7-4a52-bf42-1570d1d87182\") " pod="openshift-ingress-canary/ingress-canary-k2882"
Jul 07 15:01:16.414323 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.414282    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9ca387e-d409-4533-90f2-b0101613e043-ca\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.417197 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.417172    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrlsw\" (UniqueName: \"kubernetes.io/projected/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-kube-api-access-rrlsw\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:16.417788 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.417763    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fkjs\" (UniqueName: \"kubernetes.io/projected/f9ca387e-d409-4533-90f2-b0101613e043-kube-api-access-9fkjs\") pod \"cluster-proxy-proxy-agent-7f98c9576-5x66k\" (UID: \"f9ca387e-d409-4533-90f2-b0101613e043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.418775 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.418542    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-bound-sa-token\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.419134 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.419113    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vgvq\" (UniqueName: \"kubernetes.io/projected/14576e55-7854-4572-8ac5-d2fc741ccb87-kube-api-access-4vgvq\") pod \"managed-serviceaccount-addon-agent-7f998ddff8-zm8n7\" (UID: \"14576e55-7854-4572-8ac5-d2fc741ccb87\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7"
Jul 07 15:01:16.419341 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.419319    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb6ll\" (UniqueName: \"kubernetes.io/projected/54251ec3-451e-44b6-b218-35c93790d77a-kube-api-access-mb6ll\") pod \"klusterlet-addon-workmgr-7db69c9d56-d7bvq\" (UID: \"54251ec3-451e-44b6-b218-35c93790d77a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:01:16.419691 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.419664    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tskc8\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-kube-api-access-tskc8\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.420446 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.420430    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brqxx\" (UniqueName: \"kubernetes.io/projected/bf15a5e6-deb7-4a52-bf42-1570d1d87182-kube-api-access-brqxx\") pod \"ingress-canary-k2882\" (UID: \"bf15a5e6-deb7-4a52-bf42-1570d1d87182\") " pod="openshift-ingress-canary/ingress-canary-k2882"
Jul 07 15:01:16.493267 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.493224    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:01:16.517421 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.517391    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7"
Jul 07 15:01:16.526493 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.526465    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:01:16.547877 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.547819    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k2882"
Jul 07 15:01:16.687142 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.687115    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"]
Jul 07 15:01:16.691470 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:01:16.691444    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54251ec3_451e_44b6_b218_35c93790d77a.slice/crio-939022f8ef49e9772a109007bf8797a7bdc9a84912548ff78c3874efd0182637 WatchSource:0}: Error finding container 939022f8ef49e9772a109007bf8797a7bdc9a84912548ff78c3874efd0182637: Status 404 returned error can't find the container with id 939022f8ef49e9772a109007bf8797a7bdc9a84912548ff78c3874efd0182637
Jul 07 15:01:16.694866 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.694823    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7"]
Jul 07 15:01:16.699539 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:01:16.699513    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14576e55_7854_4572_8ac5_d2fc741ccb87.slice/crio-03aa411c5d2e6555912046ae8cb62174aecf2e998c1767398eef7994f80c4f93 WatchSource:0}: Error finding container 03aa411c5d2e6555912046ae8cb62174aecf2e998c1767398eef7994f80c4f93: Status 404 returned error can't find the container with id 03aa411c5d2e6555912046ae8cb62174aecf2e998c1767398eef7994f80c4f93
Jul 07 15:01:16.716130 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.716040    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"]
Jul 07 15:01:16.719096 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:01:16.719058    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9ca387e_d409_4533_90f2_b0101613e043.slice/crio-3876ca0b96908589b4005a227083f451ab8104e8cd5d4e4754426ffadc73ec35 WatchSource:0}: Error finding container 3876ca0b96908589b4005a227083f451ab8104e8cd5d4e4754426ffadc73ec35: Status 404 returned error can't find the container with id 3876ca0b96908589b4005a227083f451ab8104e8cd5d4e4754426ffadc73ec35
Jul 07 15:01:16.740989 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.740958    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k2882"]
Jul 07 15:01:16.744821 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:01:16.744789    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf15a5e6_deb7_4a52_bf42_1570d1d87182.slice/crio-b08243144c3939fc9d090dea2983490c62a08f3575d0d8f419f4bee0ff888aa7 WatchSource:0}: Error finding container b08243144c3939fc9d090dea2983490c62a08f3575d0d8f419f4bee0ff888aa7: Status 404 returned error can't find the container with id b08243144c3939fc9d090dea2983490c62a08f3575d0d8f419f4bee0ff888aa7
Jul 07 15:01:16.913160 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.913070    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:16.913160 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.913115    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:16.913719 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:16.913228    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:01:16.913719 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:16.913230    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:01:16.913719 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:16.913244    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9dc9555b-m4dw6: secret "image-registry-tls" not found
Jul 07 15:01:16.913719 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:16.913279    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:01:16.913719 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:16.913315    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls podName:96e3cedc-88dc-46fe-bf69-bfaea614cc7f nodeName:}" failed. No retries permitted until 2026-07-07 15:01:17.913283125 +0000 UTC m=+37.647169509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls") pod "dns-default-kpdq6" (UID: "96e3cedc-88dc-46fe-bf69-bfaea614cc7f") : secret "dns-default-metrics-tls" not found
Jul 07 15:01:16.913719 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:16.913374    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls podName:30db6f20-e529-4ed7-b894-521a841a5445 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:17.91335856 +0000 UTC m=+37.647244939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls") pod "image-registry-5b9dc9555b-m4dw6" (UID: "30db6f20-e529-4ed7-b894-521a841a5445") : secret "image-registry-tls" not found
Jul 07 15:01:16.913719 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:16.913387    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 15:01:16.913719 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:16.913434    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert podName:0e6fd9d6-e904-446a-b031-06ebe9ac9ace nodeName:}" failed. No retries permitted until 2026-07-07 15:01:17.913419264 +0000 UTC m=+37.647305623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-zp7ss" (UID: "0e6fd9d6-e904-446a-b031-06ebe9ac9ace") : secret "networking-console-plugin-cert" not found
Jul 07 15:01:17.032196 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.032158    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k2882" event={"ID":"bf15a5e6-deb7-4a52-bf42-1570d1d87182","Type":"ContainerStarted","Data":"b08243144c3939fc9d090dea2983490c62a08f3575d0d8f419f4bee0ff888aa7"}
Jul 07 15:01:17.033513 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.033468    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq" event={"ID":"54251ec3-451e-44b6-b218-35c93790d77a","Type":"ContainerStarted","Data":"939022f8ef49e9772a109007bf8797a7bdc9a84912548ff78c3874efd0182637"}
Jul 07 15:01:17.034798 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.034771    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k" event={"ID":"f9ca387e-d409-4533-90f2-b0101613e043","Type":"ContainerStarted","Data":"3876ca0b96908589b4005a227083f451ab8104e8cd5d4e4754426ffadc73ec35"}
Jul 07 15:01:17.035918 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.035899    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7" event={"ID":"14576e55-7854-4572-8ac5-d2fc741ccb87","Type":"ContainerStarted","Data":"03aa411c5d2e6555912046ae8cb62174aecf2e998c1767398eef7994f80c4f93"}
Jul 07 15:01:17.861330 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.861295    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:17.861531 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.861295    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:01:17.861531 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.861294    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:01:17.864695 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.864502    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 15:01:17.864695 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.864526    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 15:01:17.864695 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.864535    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 15:01:17.864695 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.864566    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mbwr6\""
Jul 07 15:01:17.864695 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.864501    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 15:01:17.864695 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.864503    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2msz5\""
Jul 07 15:01:17.921642 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.921603    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:17.922113 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:17.921738    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:01:17.922113 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.921751    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:17.922113 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:17.921808    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls podName:96e3cedc-88dc-46fe-bf69-bfaea614cc7f nodeName:}" failed. No retries permitted until 2026-07-07 15:01:19.921789589 +0000 UTC m=+39.655675962 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls") pod "dns-default-kpdq6" (UID: "96e3cedc-88dc-46fe-bf69-bfaea614cc7f") : secret "dns-default-metrics-tls" not found
Jul 07 15:01:17.922113 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:17.921846    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:01:17.922113 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:17.921867    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:01:17.922113 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:17.921879    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9dc9555b-m4dw6: secret "image-registry-tls" not found
Jul 07 15:01:17.922113 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:17.921923    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls podName:30db6f20-e529-4ed7-b894-521a841a5445 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:19.921910539 +0000 UTC m=+39.655796913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls") pod "image-registry-5b9dc9555b-m4dw6" (UID: "30db6f20-e529-4ed7-b894-521a841a5445") : secret "image-registry-tls" not found
Jul 07 15:01:17.922113 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:17.921967    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 15:01:17.922113 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:17.922060    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert podName:0e6fd9d6-e904-446a-b031-06ebe9ac9ace nodeName:}" failed. No retries permitted until 2026-07-07 15:01:19.922043456 +0000 UTC m=+39.655929816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-zp7ss" (UID: "0e6fd9d6-e904-446a-b031-06ebe9ac9ace") : secret "networking-console-plugin-cert" not found
Jul 07 15:01:19.943295 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:19.942973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:01:19.943776 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:19.943507    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:19.943776 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:19.943541    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:19.943776 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:19.943683    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:01:19.943776 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:19.943699    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9dc9555b-m4dw6: secret "image-registry-tls" not found
Jul 07 15:01:19.943776 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:19.943758    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls podName:30db6f20-e529-4ed7-b894-521a841a5445 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:23.943739044 +0000 UTC m=+43.677625411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls") pod "image-registry-5b9dc9555b-m4dw6" (UID: "30db6f20-e529-4ed7-b894-521a841a5445") : secret "image-registry-tls" not found
Jul 07 15:01:19.944299 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:19.944284    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 15:01:19.944377 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:19.944365    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert podName:0e6fd9d6-e904-446a-b031-06ebe9ac9ace nodeName:}" failed. No retries permitted until 2026-07-07 15:01:23.944326466 +0000 UTC m=+43.678212826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-zp7ss" (UID: "0e6fd9d6-e904-446a-b031-06ebe9ac9ace") : secret "networking-console-plugin-cert" not found
Jul 07 15:01:19.944447 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:19.944433    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:01:19.944498 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:19.944468    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls podName:96e3cedc-88dc-46fe-bf69-bfaea614cc7f nodeName:}" failed. No retries permitted until 2026-07-07 15:01:23.944456923 +0000 UTC m=+43.678343286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls") pod "dns-default-kpdq6" (UID: "96e3cedc-88dc-46fe-bf69-bfaea614cc7f") : secret "dns-default-metrics-tls" not found
Jul 07 15:01:20.052382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:20.052342    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c83f81e-fce0-4c5f-af0b-5a6662c9347b" containerID="a1ca166ca45c04471a0b61449f3f6e28587ef935ab5fc77bb1dd4da7aa184db6" exitCode=0
Jul 07 15:01:20.052560 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:20.052426    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsfgp" event={"ID":"7c83f81e-fce0-4c5f-af0b-5a6662c9347b","Type":"ContainerDied","Data":"a1ca166ca45c04471a0b61449f3f6e28587ef935ab5fc77bb1dd4da7aa184db6"}
Jul 07 15:01:21.060732 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:21.060689    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c83f81e-fce0-4c5f-af0b-5a6662c9347b" containerID="4ac0ccfbce2936ba66c8a2ad2499e15b563fb6bd30eac76e449ba0d442e1d2d7" exitCode=0
Jul 07 15:01:21.061357 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:21.060777    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsfgp" event={"ID":"7c83f81e-fce0-4c5f-af0b-5a6662c9347b","Type":"ContainerDied","Data":"4ac0ccfbce2936ba66c8a2ad2499e15b563fb6bd30eac76e449ba0d442e1d2d7"}
Jul 07 15:01:23.979146 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:23.979096    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:01:23.979553 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:23.979187    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:23.979553 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:23.979246    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:23.979553 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:23.979247    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 15:01:23.979553 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:23.979324    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:01:23.979553 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:23.979328    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert podName:0e6fd9d6-e904-446a-b031-06ebe9ac9ace nodeName:}" failed. No retries permitted until 2026-07-07 15:01:31.979310301 +0000 UTC m=+51.713196663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-zp7ss" (UID: "0e6fd9d6-e904-446a-b031-06ebe9ac9ace") : secret "networking-console-plugin-cert" not found
Jul 07 15:01:23.979553 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:23.979336    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9dc9555b-m4dw6: secret "image-registry-tls" not found
Jul 07 15:01:23.979553 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:23.979380    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls podName:30db6f20-e529-4ed7-b894-521a841a5445 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:31.979368552 +0000 UTC m=+51.713254912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls") pod "image-registry-5b9dc9555b-m4dw6" (UID: "30db6f20-e529-4ed7-b894-521a841a5445") : secret "image-registry-tls" not found
Jul 07 15:01:23.979553 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:23.979325    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:01:23.979553 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:23.979407    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls podName:96e3cedc-88dc-46fe-bf69-bfaea614cc7f nodeName:}" failed. No retries permitted until 2026-07-07 15:01:31.979400933 +0000 UTC m=+51.713287292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls") pod "dns-default-kpdq6" (UID: "96e3cedc-88dc-46fe-bf69-bfaea614cc7f") : secret "dns-default-metrics-tls" not found
Jul 07 15:01:25.074550 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:25.074509    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsfgp" event={"ID":"7c83f81e-fce0-4c5f-af0b-5a6662c9347b","Type":"ContainerStarted","Data":"f3a57dbd3b0c42fff859efff4132bb09b6fec9db21ecf06c65fa7b91eb7989ce"}
Jul 07 15:01:25.076304 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:25.076273    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k2882" event={"ID":"bf15a5e6-deb7-4a52-bf42-1570d1d87182","Type":"ContainerStarted","Data":"947bb18b3801cd70e5f297808e5dc0b6b062f0d1dd21583b17bd774587aabbdf"}
Jul 07 15:01:25.078074 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:25.078041    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq" event={"ID":"54251ec3-451e-44b6-b218-35c93790d77a","Type":"ContainerStarted","Data":"9b85057750b9c9d1a5d349706ae41384129a140263fcee8f343ecfab9000fb86"}
Jul 07 15:01:25.078201 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:25.078182    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:01:25.079760 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:25.079734    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7" event={"ID":"14576e55-7854-4572-8ac5-d2fc741ccb87","Type":"ContainerStarted","Data":"393eaa428293d6f0ca015f001d19826065cedc35dc3c222e624ce907dbf67ab4"}
Jul 07 15:01:25.080292 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:25.080270    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:01:25.096407 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:25.096254    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zsfgp" podStartSLOduration=11.90560889 podStartE2EDuration="45.096230559s" totalImagesPullingTime="33.190621669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:25.095265443 +0000 UTC m=+44.829151825" watchObservedRunningTime="2026-07-07 15:01:25.096230559 +0000 UTC m=+44.830116941"
Jul 07 15:01:25.109834 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:25.109725    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq" podStartSLOduration=3.320523669 podStartE2EDuration="11.109708809s" totalImagesPullingTime="7.78918514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:25.109138214 +0000 UTC m=+44.843024598" watchObservedRunningTime="2026-07-07 15:01:25.109708809 +0000 UTC m=+44.843595192"
Jul 07 15:01:25.126265 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:25.124350    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7" podStartSLOduration=3.363064186 podStartE2EDuration="11.124321803s" totalImagesPullingTime="7.761257617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:25.122752473 +0000 UTC m=+44.856638855" watchObservedRunningTime="2026-07-07 15:01:25.124321803 +0000 UTC m=+44.858208188"
Jul 07 15:01:25.139071 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:25.138978    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k2882" podStartSLOduration=1.422941627 podStartE2EDuration="9.138951433s" totalImagesPullingTime="7.716009806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:25.137783149 +0000 UTC m=+44.871669532" watchObservedRunningTime="2026-07-07 15:01:25.138951433 +0000 UTC m=+44.872837817"
Jul 07 15:01:28.090079 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:28.089973    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k" event={"ID":"f9ca387e-d409-4533-90f2-b0101613e043","Type":"ContainerStarted","Data":"479f9e68350f614a512a01929149289179a2d5cb58a340591ae854d4d136d391"}
Jul 07 15:01:28.090079 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:28.090029    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k" event={"ID":"f9ca387e-d409-4533-90f2-b0101613e043","Type":"ContainerStarted","Data":"07642393b91c45dfbe5007907bb8b3029a8458369556817c9c1b535fa166e5b2"}
Jul 07 15:01:28.090079 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:28.090044    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k" event={"ID":"f9ca387e-d409-4533-90f2-b0101613e043","Type":"ContainerStarted","Data":"2b9b1918574379f1d0114a6f2209038093b6dbba335d261696ccb58062c4cd38"}
Jul 07 15:01:28.108317 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:28.108258    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k" podStartSLOduration=3.276830151 podStartE2EDuration="14.108238879s" totalImagesPullingTime="10.831408728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:28.107177087 +0000 UTC m=+47.841063471" watchObservedRunningTime="2026-07-07 15:01:28.108238879 +0000 UTC m=+47.842125260"
Jul 07 15:01:32.049702 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:32.049666    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:32.049702 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:32.049707    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:32.050181 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:32.049745    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:01:32.050181 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:32.049820    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:01:32.050181 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:32.049842    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:01:32.050181 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:32.049873    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9dc9555b-m4dw6: secret "image-registry-tls" not found
Jul 07 15:01:32.050181 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:32.049876    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 15:01:32.050181 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:32.049882    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls podName:96e3cedc-88dc-46fe-bf69-bfaea614cc7f nodeName:}" failed. No retries permitted until 2026-07-07 15:01:48.049866206 +0000 UTC m=+67.783752571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls") pod "dns-default-kpdq6" (UID: "96e3cedc-88dc-46fe-bf69-bfaea614cc7f") : secret "dns-default-metrics-tls" not found
Jul 07 15:01:32.050181 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:32.049936    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert podName:0e6fd9d6-e904-446a-b031-06ebe9ac9ace nodeName:}" failed. No retries permitted until 2026-07-07 15:01:48.049909545 +0000 UTC m=+67.783795908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-zp7ss" (UID: "0e6fd9d6-e904-446a-b031-06ebe9ac9ace") : secret "networking-console-plugin-cert" not found
Jul 07 15:01:32.050181 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:32.049957    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls podName:30db6f20-e529-4ed7-b894-521a841a5445 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:48.049950643 +0000 UTC m=+67.783837002 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls") pod "image-registry-5b9dc9555b-m4dw6" (UID: "30db6f20-e529-4ed7-b894-521a841a5445") : secret "image-registry-tls" not found
Jul 07 15:01:40.018270 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:40.018242    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9zdp"
Jul 07 15:01:46.460759 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:46.460714    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjv5c\" (UniqueName: \"kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c\") pod \"network-check-target-vmtlc\" (UID: \"a92f5c93-2309-40bf-82b6-7cdafea0713f\") " pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:46.463659 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:46.463637    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 15:01:46.473827 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:46.473804    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 15:01:46.485376 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:46.485348    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjv5c\" (UniqueName: \"kubernetes.io/projected/a92f5c93-2309-40bf-82b6-7cdafea0713f-kube-api-access-vjv5c\") pod \"network-check-target-vmtlc\" (UID: \"a92f5c93-2309-40bf-82b6-7cdafea0713f\") " pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:46.561774 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:46.561739    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:01:46.561774 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:46.561775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:01:46.564674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:46.564647    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 15:01:46.564743 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:46.564650    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 15:01:46.572722 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:46.572690    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 15:01:46.572857 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:46.572776    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs podName:28f4b5b7-49c8-4d2a-8bb7-21bcce740d31 nodeName:}" failed. No retries permitted until 2026-07-07 15:02:50.572751479 +0000 UTC m=+130.306637841 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs") pod "network-metrics-daemon-sw26l" (UID: "28f4b5b7-49c8-4d2a-8bb7-21bcce740d31") : secret "metrics-daemon-secret" not found
Jul 07 15:01:46.575020 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:46.574979    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f6b1040-2676-427e-ad0e-9a086722f3f5-original-pull-secret\") pod \"global-pull-secret-syncer-bklgh\" (UID: \"9f6b1040-2676-427e-ad0e-9a086722f3f5\") " pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:01:46.675604 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:46.675571    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2msz5\""
Jul 07 15:01:46.682701 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:46.682678    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bklgh"
Jul 07 15:01:46.683749 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:46.683728    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:46.820057 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:46.820027    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bklgh"]
Jul 07 15:01:46.826636 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:01:46.826606    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f6b1040_2676_427e_ad0e_9a086722f3f5.slice/crio-1a319000bd1a9892d9814dcd1bb5fe634c3a98887684fc087836e22b361c39e4 WatchSource:0}: Error finding container 1a319000bd1a9892d9814dcd1bb5fe634c3a98887684fc087836e22b361c39e4: Status 404 returned error can't find the container with id 1a319000bd1a9892d9814dcd1bb5fe634c3a98887684fc087836e22b361c39e4
Jul 07 15:01:46.841487 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:46.841454    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vmtlc"]
Jul 07 15:01:46.845063 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:01:46.845041    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda92f5c93_2309_40bf_82b6_7cdafea0713f.slice/crio-1eb43dc0cd6238badfcb2dbcdd2c1c2e4739ec1c82615779adca92f2ed14ded0 WatchSource:0}: Error finding container 1eb43dc0cd6238badfcb2dbcdd2c1c2e4739ec1c82615779adca92f2ed14ded0: Status 404 returned error can't find the container with id 1eb43dc0cd6238badfcb2dbcdd2c1c2e4739ec1c82615779adca92f2ed14ded0
Jul 07 15:01:47.149558 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:47.149525    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bklgh" event={"ID":"9f6b1040-2676-427e-ad0e-9a086722f3f5","Type":"ContainerStarted","Data":"1a319000bd1a9892d9814dcd1bb5fe634c3a98887684fc087836e22b361c39e4"}
Jul 07 15:01:47.150640 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:47.150615    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vmtlc" event={"ID":"a92f5c93-2309-40bf-82b6-7cdafea0713f","Type":"ContainerStarted","Data":"1eb43dc0cd6238badfcb2dbcdd2c1c2e4739ec1c82615779adca92f2ed14ded0"}
Jul 07 15:01:48.072928 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:48.072887    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:01:48.073383 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:48.073055    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 15:01:48.073383 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:48.073143    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert podName:0e6fd9d6-e904-446a-b031-06ebe9ac9ace nodeName:}" failed. No retries permitted until 2026-07-07 15:02:20.073121696 +0000 UTC m=+99.807008069 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-zp7ss" (UID: "0e6fd9d6-e904-446a-b031-06ebe9ac9ace") : secret "networking-console-plugin-cert" not found
Jul 07 15:01:48.073383 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:48.073241    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:01:48.073383 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:48.073277    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:01:48.073383 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:48.073374    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:01:48.073706 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:48.073392    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:01:48.073706 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:48.073406    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9dc9555b-m4dw6: secret "image-registry-tls" not found
Jul 07 15:01:48.073706 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:48.073436    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls podName:96e3cedc-88dc-46fe-bf69-bfaea614cc7f nodeName:}" failed. No retries permitted until 2026-07-07 15:02:20.073419183 +0000 UTC m=+99.807305544 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls") pod "dns-default-kpdq6" (UID: "96e3cedc-88dc-46fe-bf69-bfaea614cc7f") : secret "dns-default-metrics-tls" not found
Jul 07 15:01:48.073706 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:01:48.073455    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls podName:30db6f20-e529-4ed7-b894-521a841a5445 nodeName:}" failed. No retries permitted until 2026-07-07 15:02:20.073448463 +0000 UTC m=+99.807334822 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls") pod "image-registry-5b9dc9555b-m4dw6" (UID: "30db6f20-e529-4ed7-b894-521a841a5445") : secret "image-registry-tls" not found
Jul 07 15:01:52.169140 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:52.169103    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vmtlc" event={"ID":"a92f5c93-2309-40bf-82b6-7cdafea0713f","Type":"ContainerStarted","Data":"c0b289c9e814bb2987c0862228c6dc1145243c5f293f07071977a59fba43d64f"}
Jul 07 15:01:52.169571 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:52.169214    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:01:52.170627 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:52.170604    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bklgh" event={"ID":"9f6b1040-2676-427e-ad0e-9a086722f3f5","Type":"ContainerStarted","Data":"6a6abaa3ec70129d064eb6d130da12640d8b4ae14123856ebd6eacbfea45e743"}
Jul 07 15:01:52.197504 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:52.197442    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vmtlc" podStartSLOduration=67.586237872 podStartE2EDuration="1m12.197419495s" totalImagesPullingTime="4.611181623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:52.183994998 +0000 UTC m=+71.917881379" watchObservedRunningTime="2026-07-07 15:01:52.197419495 +0000 UTC m=+71.931305878"
Jul 07 15:01:52.197698 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:01:52.197677    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bklgh" podStartSLOduration=66.563975373 podStartE2EDuration="1m11.197668979s" totalImagesPullingTime="4.633693606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:52.196985748 +0000 UTC m=+71.930872130" watchObservedRunningTime="2026-07-07 15:01:52.197668979 +0000 UTC m=+71.931555361"
Jul 07 15:02:20.125056 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:02:20.124987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:02:20.125056 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:02:20.125061    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:02:20.125564 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:02:20.125103    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:02:20.125564 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:02:20.125155    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:02:20.125564 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:02:20.125231    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 15:02:20.125564 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:02:20.125155    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:02:20.125564 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:02:20.125293    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9dc9555b-m4dw6: secret "image-registry-tls" not found
Jul 07 15:02:20.125564 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:02:20.125239    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls podName:96e3cedc-88dc-46fe-bf69-bfaea614cc7f nodeName:}" failed. No retries permitted until 2026-07-07 15:03:24.125220361 +0000 UTC m=+163.859106721 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls") pod "dns-default-kpdq6" (UID: "96e3cedc-88dc-46fe-bf69-bfaea614cc7f") : secret "dns-default-metrics-tls" not found
Jul 07 15:02:20.125564 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:02:20.125330    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert podName:0e6fd9d6-e904-446a-b031-06ebe9ac9ace nodeName:}" failed. No retries permitted until 2026-07-07 15:03:24.125318082 +0000 UTC m=+163.859204443 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-zp7ss" (UID: "0e6fd9d6-e904-446a-b031-06ebe9ac9ace") : secret "networking-console-plugin-cert" not found
Jul 07 15:02:20.125564 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:02:20.125342    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls podName:30db6f20-e529-4ed7-b894-521a841a5445 nodeName:}" failed. No retries permitted until 2026-07-07 15:03:24.125335231 +0000 UTC m=+163.859221591 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls") pod "image-registry-5b9dc9555b-m4dw6" (UID: "30db6f20-e529-4ed7-b894-521a841a5445") : secret "image-registry-tls" not found
Jul 07 15:02:23.180187 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:02:23.180152    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vmtlc"
Jul 07 15:02:50.657414 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:02:50.657371    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:02:50.657917 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:02:50.657488    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 15:02:50.657917 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:02:50.657540    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs podName:28f4b5b7-49c8-4d2a-8bb7-21bcce740d31 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:52.657526416 +0000 UTC m=+252.391412775 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs") pod "network-metrics-daemon-sw26l" (UID: "28f4b5b7-49c8-4d2a-8bb7-21bcce740d31") : secret "metrics-daemon-secret" not found
Jul 07 15:03:19.178970 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:03:19.178922    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss" podUID="0e6fd9d6-e904-446a-b031-06ebe9ac9ace"
Jul 07 15:03:19.185577 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:03:19.185542    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6" podUID="30db6f20-e529-4ed7-b894-521a841a5445"
Jul 07 15:03:19.253918 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:03:19.253883    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kpdq6" podUID="96e3cedc-88dc-46fe-bf69-bfaea614cc7f"
Jul 07 15:03:19.429878 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:19.429797    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:03:19.430049 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:19.429797    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:03:19.430049 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:19.429797    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:03:20.888113 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:03:20.888064    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:03:24.218353 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:24.218309    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:03:24.218353 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:24.218352    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:03:24.218872 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:24.218383    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:03:24.218872 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:03:24.218484    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 15:03:24.218872 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:03:24.218493    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:03:24.218872 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:03:24.218538    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert podName:0e6fd9d6-e904-446a-b031-06ebe9ac9ace nodeName:}" failed. No retries permitted until 2026-07-07 15:05:26.218524411 +0000 UTC m=+285.952410774 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-zp7ss" (UID: "0e6fd9d6-e904-446a-b031-06ebe9ac9ace") : secret "networking-console-plugin-cert" not found
Jul 07 15:03:24.218872 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:03:24.218562    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls podName:96e3cedc-88dc-46fe-bf69-bfaea614cc7f nodeName:}" failed. No retries permitted until 2026-07-07 15:05:26.218543348 +0000 UTC m=+285.952429728 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls") pod "dns-default-kpdq6" (UID: "96e3cedc-88dc-46fe-bf69-bfaea614cc7f") : secret "dns-default-metrics-tls" not found
Jul 07 15:03:24.218872 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:03:24.218488    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:03:24.218872 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:03:24.218581    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9dc9555b-m4dw6: secret "image-registry-tls" not found
Jul 07 15:03:24.218872 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:03:24.218612    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls podName:30db6f20-e529-4ed7-b894-521a841a5445 nodeName:}" failed. No retries permitted until 2026-07-07 15:05:26.218603151 +0000 UTC m=+285.952489511 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls") pod "image-registry-5b9dc9555b-m4dw6" (UID: "30db6f20-e529-4ed7-b894-521a841a5445") : secret "image-registry-tls" not found
Jul 07 15:03:25.078812 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:25.078763    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq" podUID="54251ec3-451e-44b6-b218-35c93790d77a" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused"
Jul 07 15:03:25.448156 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:25.448066    2574 generic.go:356] "Generic (PLEG): container finished" podID="54251ec3-451e-44b6-b218-35c93790d77a" containerID="9b85057750b9c9d1a5d349706ae41384129a140263fcee8f343ecfab9000fb86" exitCode=1
Jul 07 15:03:25.448156 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:25.448146    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq" event={"ID":"54251ec3-451e-44b6-b218-35c93790d77a","Type":"ContainerDied","Data":"9b85057750b9c9d1a5d349706ae41384129a140263fcee8f343ecfab9000fb86"}
Jul 07 15:03:25.448642 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:25.448510    2574 scope.go:117] "RemoveContainer" containerID="9b85057750b9c9d1a5d349706ae41384129a140263fcee8f343ecfab9000fb86"
Jul 07 15:03:25.449831 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:25.449724    2574 generic.go:356] "Generic (PLEG): container finished" podID="14576e55-7854-4572-8ac5-d2fc741ccb87" containerID="393eaa428293d6f0ca015f001d19826065cedc35dc3c222e624ce907dbf67ab4" exitCode=255
Jul 07 15:03:25.449831 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:25.449773    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7" event={"ID":"14576e55-7854-4572-8ac5-d2fc741ccb87","Type":"ContainerDied","Data":"393eaa428293d6f0ca015f001d19826065cedc35dc3c222e624ce907dbf67ab4"}
Jul 07 15:03:25.450103 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:25.450086    2574 scope.go:117] "RemoveContainer" containerID="393eaa428293d6f0ca015f001d19826065cedc35dc3c222e624ce907dbf67ab4"
Jul 07 15:03:26.454779 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:26.454748    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq" event={"ID":"54251ec3-451e-44b6-b218-35c93790d77a","Type":"ContainerStarted","Data":"c743216742be63d95385a3c6f596191edbf505621f1aa6ebe1d72bafbfb21d62"}
Jul 07 15:03:26.455238 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:26.455072    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:03:26.456025 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:26.455992    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:03:26.456832 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:26.456809    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7" event={"ID":"14576e55-7854-4572-8ac5-d2fc741ccb87","Type":"ContainerStarted","Data":"ddfdb1a7365debe80b113406e1fabb6e1b0e2e7e0803cdb06d5a4de4073b5ea8"}
Jul 07 15:03:35.861888 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:03:35.861832    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:04:48.106289 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.106246    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mkq7w"]
Jul 07 15:04:48.109591 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.109570    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.111651 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.111616    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gkfhx\""
Jul 07 15:04:48.112237 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.112207    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 15:04:48.112237 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.112226    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 15:04:48.112380 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.112250    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 15:04:48.112380 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.112259    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 15:04:48.122886 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.122864    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mkq7w"]
Jul 07 15:04:48.267483 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.267437    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48766641-8e93-4e51-a781-2ea6edda9326-data-volume\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.267483 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.267479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jmn4\" (UniqueName: \"kubernetes.io/projected/48766641-8e93-4e51-a781-2ea6edda9326-kube-api-access-9jmn4\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.267709 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.267553    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48766641-8e93-4e51-a781-2ea6edda9326-crio-socket\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.267709 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.267572    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.267709 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.267683    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.368538 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.368447    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48766641-8e93-4e51-a781-2ea6edda9326-crio-socket\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.368538 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.368486    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.368538 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.368521    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.368752 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.368558    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48766641-8e93-4e51-a781-2ea6edda9326-data-volume\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.368752 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.368574    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jmn4\" (UniqueName: \"kubernetes.io/projected/48766641-8e93-4e51-a781-2ea6edda9326-kube-api-access-9jmn4\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.368752 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.368585    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48766641-8e93-4e51-a781-2ea6edda9326-crio-socket\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.368752 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:48.368624    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:48.368752 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:48.368654    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:04:48.368752 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:48.368715    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls podName:48766641-8e93-4e51-a781-2ea6edda9326 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:48.86869146 +0000 UTC m=+248.602577821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mkq7w" (UID: "48766641-8e93-4e51-a781-2ea6edda9326") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:48.368752 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:48.368734    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm podName:48766641-8e93-4e51-a781-2ea6edda9326 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:48.868724732 +0000 UTC m=+248.602611098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mkq7w" (UID: "48766641-8e93-4e51-a781-2ea6edda9326") : configmap "kube-rbac-proxy" not found
Jul 07 15:04:48.368972 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.368881    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48766641-8e93-4e51-a781-2ea6edda9326-data-volume\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.376167 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.376144    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jmn4\" (UniqueName: \"kubernetes.io/projected/48766641-8e93-4e51-a781-2ea6edda9326-kube-api-access-9jmn4\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.872395 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.872350    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.872571 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:48.872446    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:48.872571 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:48.872473    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:04:48.872571 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:48.872537    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm podName:48766641-8e93-4e51-a781-2ea6edda9326 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:49.872519346 +0000 UTC m=+249.606405706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mkq7w" (UID: "48766641-8e93-4e51-a781-2ea6edda9326") : configmap "kube-rbac-proxy" not found
Jul 07 15:04:48.872571 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:48.872539    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:48.872711 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:48.872581    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls podName:48766641-8e93-4e51-a781-2ea6edda9326 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:49.872569241 +0000 UTC m=+249.606455604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mkq7w" (UID: "48766641-8e93-4e51-a781-2ea6edda9326") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:49.881307 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:49.881254    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:49.881307 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:49.881320    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:49.881794 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:49.881391    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:04:49.881794 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:49.881440    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm podName:48766641-8e93-4e51-a781-2ea6edda9326 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:51.881428275 +0000 UTC m=+251.615314635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mkq7w" (UID: "48766641-8e93-4e51-a781-2ea6edda9326") : configmap "kube-rbac-proxy" not found
Jul 07 15:04:49.881794 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:49.881441    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:49.881794 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:49.881512    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls podName:48766641-8e93-4e51-a781-2ea6edda9326 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:51.881494097 +0000 UTC m=+251.615380461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mkq7w" (UID: "48766641-8e93-4e51-a781-2ea6edda9326") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:50.902736 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:50.902709    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p492t_f6030f52-8069-4c84-971f-a3733c9c2f7c/dns-node-resolver/0.log"
Jul 07 15:04:51.897978 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:51.897939    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:51.898226 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:51.898065    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:51.898226 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:51.898081    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:04:51.898226 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:51.898160    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm podName:48766641-8e93-4e51-a781-2ea6edda9326 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:55.898141509 +0000 UTC m=+255.632027888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mkq7w" (UID: "48766641-8e93-4e51-a781-2ea6edda9326") : configmap "kube-rbac-proxy" not found
Jul 07 15:04:51.898226 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:51.898187    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:51.898380 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:51.898232    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls podName:48766641-8e93-4e51-a781-2ea6edda9326 nodeName:}" failed. No retries permitted until 2026-07-07 15:04:55.898216641 +0000 UTC m=+255.632103006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mkq7w" (UID: "48766641-8e93-4e51-a781-2ea6edda9326") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:51.901728 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:51.901708    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qmvsb_b88af1ec-e8e2-4a62-a235-7062bdc5c9f9/node-ca/0.log"
Jul 07 15:04:52.705432 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:52.705394    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:04:52.705984 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:52.705571    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 15:04:52.705984 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:52.705658    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs podName:28f4b5b7-49c8-4d2a-8bb7-21bcce740d31 nodeName:}" failed. No retries permitted until 2026-07-07 15:06:54.705634029 +0000 UTC m=+374.439520390 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs") pod "network-metrics-daemon-sw26l" (UID: "28f4b5b7-49c8-4d2a-8bb7-21bcce740d31") : secret "metrics-daemon-secret" not found
Jul 07 15:04:52.706489 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:52.706473    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k2882_bf15a5e6-deb7-4a52-bf42-1570d1d87182/serve-healthcheck-canary/0.log"
Jul 07 15:04:55.932667 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:55.932627    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:55.933184 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:04:55.932712    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:04:55.933184 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:55.932799    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:55.933184 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:55.932873    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls podName:48766641-8e93-4e51-a781-2ea6edda9326 nodeName:}" failed. No retries permitted until 2026-07-07 15:05:03.932857533 +0000 UTC m=+263.666743893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mkq7w" (UID: "48766641-8e93-4e51-a781-2ea6edda9326") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:04:55.933184 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:55.932807    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:04:55.933184 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:04:55.932961    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm podName:48766641-8e93-4e51-a781-2ea6edda9326 nodeName:}" failed. No retries permitted until 2026-07-07 15:05:03.932942817 +0000 UTC m=+263.666829180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mkq7w" (UID: "48766641-8e93-4e51-a781-2ea6edda9326") : configmap "kube-rbac-proxy" not found
Jul 07 15:05:04.002060 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:04.001949    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:05:04.002428 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:04.002063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:05:04.002525 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:04.002506    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48766641-8e93-4e51-a781-2ea6edda9326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:05:04.004302 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:04.004286    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48766641-8e93-4e51-a781-2ea6edda9326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkq7w\" (UID: \"48766641-8e93-4e51-a781-2ea6edda9326\") " pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:05:04.018349 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:04.018320    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mkq7w"
Jul 07 15:05:04.147709 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:04.147672    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mkq7w"]
Jul 07 15:05:04.150520 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:05:04.150492    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48766641_8e93_4e51_a781_2ea6edda9326.slice/crio-2c6ffa74e63d1b8bf1be154486642aa29f94e4bbd3723befa04e0174dc2adaad WatchSource:0}: Error finding container 2c6ffa74e63d1b8bf1be154486642aa29f94e4bbd3723befa04e0174dc2adaad: Status 404 returned error can't find the container with id 2c6ffa74e63d1b8bf1be154486642aa29f94e4bbd3723befa04e0174dc2adaad
Jul 07 15:05:04.740953 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:04.740911    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mkq7w" event={"ID":"48766641-8e93-4e51-a781-2ea6edda9326","Type":"ContainerStarted","Data":"2c6ffa74e63d1b8bf1be154486642aa29f94e4bbd3723befa04e0174dc2adaad"}
Jul 07 15:05:08.754667 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:08.754631    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mkq7w" event={"ID":"48766641-8e93-4e51-a781-2ea6edda9326","Type":"ContainerStarted","Data":"c56b8ff887976e85619453dc4365fec9368483712355ada4031bbf7edf05191b"}
Jul 07 15:05:09.759891 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:09.759857    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mkq7w" event={"ID":"48766641-8e93-4e51-a781-2ea6edda9326","Type":"ContainerStarted","Data":"271cdcc643b249dc55f6690715fa9dbc5bdb7145cbe95cff88bf02bd386819dd"}
Jul 07 15:05:12.771312 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:12.771274    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mkq7w" event={"ID":"48766641-8e93-4e51-a781-2ea6edda9326","Type":"ContainerStarted","Data":"90830f6aaf13208974772adbc8d76089404626c153b5e44d477ec16d6b600bb5"}
Jul 07 15:05:12.798552 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:12.798489    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mkq7w" podStartSLOduration=17.020852291 podStartE2EDuration="24.798469981s" totalImagesPullingTime="7.77761769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:04:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:12.797890914 +0000 UTC m=+272.531777301" watchObservedRunningTime="2026-07-07 15:05:12.798469981 +0000 UTC m=+272.532356364"
Jul 07 15:05:16.527716 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:16.527672    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k" podUID="f9ca387e-d409-4533-90f2-b0101613e043" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 15:05:22.431215 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:05:22.431167    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss" podUID="0e6fd9d6-e904-446a-b031-06ebe9ac9ace"
Jul 07 15:05:22.431215 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:05:22.431168    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6" podUID="30db6f20-e529-4ed7-b894-521a841a5445"
Jul 07 15:05:22.431215 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:05:22.431167    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kpdq6" podUID="96e3cedc-88dc-46fe-bf69-bfaea614cc7f"
Jul 07 15:05:22.801119 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:22.801092    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:05:22.801302 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:22.801091    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:05:22.801302 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:22.801091    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:05:25.811942 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:25.811849    2574 generic.go:356] "Generic (PLEG): container finished" podID="54251ec3-451e-44b6-b218-35c93790d77a" containerID="c743216742be63d95385a3c6f596191edbf505621f1aa6ebe1d72bafbfb21d62" exitCode=1
Jul 07 15:05:25.811942 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:25.811923    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq" event={"ID":"54251ec3-451e-44b6-b218-35c93790d77a","Type":"ContainerDied","Data":"c743216742be63d95385a3c6f596191edbf505621f1aa6ebe1d72bafbfb21d62"}
Jul 07 15:05:25.812458 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:25.811980    2574 scope.go:117] "RemoveContainer" containerID="9b85057750b9c9d1a5d349706ae41384129a140263fcee8f343ecfab9000fb86"
Jul 07 15:05:25.812458 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:25.812305    2574 scope.go:117] "RemoveContainer" containerID="c743216742be63d95385a3c6f596191edbf505621f1aa6ebe1d72bafbfb21d62"
Jul 07 15:05:25.812536 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:05:25.812515    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7db69c9d56-d7bvq_open-cluster-management-agent-addon(54251ec3-451e-44b6-b218-35c93790d77a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq" podUID="54251ec3-451e-44b6-b218-35c93790d77a"
Jul 07 15:05:25.813732 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:25.813711    2574 generic.go:356] "Generic (PLEG): container finished" podID="14576e55-7854-4572-8ac5-d2fc741ccb87" containerID="ddfdb1a7365debe80b113406e1fabb6e1b0e2e7e0803cdb06d5a4de4073b5ea8" exitCode=255
Jul 07 15:05:25.813821 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:25.813741    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7" event={"ID":"14576e55-7854-4572-8ac5-d2fc741ccb87","Type":"ContainerDied","Data":"ddfdb1a7365debe80b113406e1fabb6e1b0e2e7e0803cdb06d5a4de4073b5ea8"}
Jul 07 15:05:25.813998 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:25.813986    2574 scope.go:117] "RemoveContainer" containerID="ddfdb1a7365debe80b113406e1fabb6e1b0e2e7e0803cdb06d5a4de4073b5ea8"
Jul 07 15:05:25.814169 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:05:25.814152    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7f998ddff8-zm8n7_open-cluster-management-agent-addon(14576e55-7854-4572-8ac5-d2fc741ccb87)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7" podUID="14576e55-7854-4572-8ac5-d2fc741ccb87"
Jul 07 15:05:25.822967 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:25.822949    2574 scope.go:117] "RemoveContainer" containerID="393eaa428293d6f0ca015f001d19826065cedc35dc3c222e624ce907dbf67ab4"
Jul 07 15:05:26.284099 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.284057    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:05:26.284099 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.284106    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:05:26.284303 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.284147    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:05:26.286460 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.286427    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96e3cedc-88dc-46fe-bf69-bfaea614cc7f-metrics-tls\") pod \"dns-default-kpdq6\" (UID: \"96e3cedc-88dc-46fe-bf69-bfaea614cc7f\") " pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:05:26.286574 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.286466    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6fd9d6-e904-446a-b031-06ebe9ac9ace-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-zp7ss\" (UID: \"0e6fd9d6-e904-446a-b031-06ebe9ac9ace\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:05:26.286574 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.286513    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls\") pod \"image-registry-5b9dc9555b-m4dw6\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") " pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:05:26.405660 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.405623    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bp52v\""
Jul 07 15:05:26.405660 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.405628    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dwmxm\""
Jul 07 15:05:26.405907 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.405628    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xndjb\""
Jul 07 15:05:26.413500 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.413473    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:05:26.413597 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.413562    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:05:26.413597 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.413575    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"
Jul 07 15:05:26.455259 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.455226    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:05:26.493574 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.493479    2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:05:26.518676 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.518593    2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7"
Jul 07 15:05:26.528381 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.528317    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k" podUID="f9ca387e-d409-4533-90f2-b0101613e043" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 15:05:26.566341 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.566250    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kpdq6"]
Jul 07 15:05:26.569656 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:05:26.569624    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e3cedc_88dc_46fe_bf69_bfaea614cc7f.slice/crio-cf6d47eaaca9a308eae0b72a5296f5ee7534f46e74a974af9957804fe3f6fa3a WatchSource:0}: Error finding container cf6d47eaaca9a308eae0b72a5296f5ee7534f46e74a974af9957804fe3f6fa3a: Status 404 returned error can't find the container with id cf6d47eaaca9a308eae0b72a5296f5ee7534f46e74a974af9957804fe3f6fa3a
Jul 07 15:05:26.788821 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.788783    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss"]
Jul 07 15:05:26.791909 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.791884    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b9dc9555b-m4dw6"]
Jul 07 15:05:26.793769 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:05:26.793744    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6fd9d6_e904_446a_b031_06ebe9ac9ace.slice/crio-63bde4cfb47ed5f356251ae80b52fafbd3b5eb7c0d061592b23b5849afb34108 WatchSource:0}: Error finding container 63bde4cfb47ed5f356251ae80b52fafbd3b5eb7c0d061592b23b5849afb34108: Status 404 returned error can't find the container with id 63bde4cfb47ed5f356251ae80b52fafbd3b5eb7c0d061592b23b5849afb34108
Jul 07 15:05:26.795056 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:05:26.794990    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30db6f20_e529_4ed7_b894_521a841a5445.slice/crio-e61053de015a7e09b415c619708012e18447e8b22bd1e2093e07e0d55c06db2d WatchSource:0}: Error finding container e61053de015a7e09b415c619708012e18447e8b22bd1e2093e07e0d55c06db2d: Status 404 returned error can't find the container with id e61053de015a7e09b415c619708012e18447e8b22bd1e2093e07e0d55c06db2d
Jul 07 15:05:26.818886 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.818816    2574 scope.go:117] "RemoveContainer" containerID="c743216742be63d95385a3c6f596191edbf505621f1aa6ebe1d72bafbfb21d62"
Jul 07 15:05:26.819286 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:05:26.819032    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7db69c9d56-d7bvq_open-cluster-management-agent-addon(54251ec3-451e-44b6-b218-35c93790d77a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq" podUID="54251ec3-451e-44b6-b218-35c93790d77a"
Jul 07 15:05:26.819843 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.819822    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpdq6" event={"ID":"96e3cedc-88dc-46fe-bf69-bfaea614cc7f","Type":"ContainerStarted","Data":"cf6d47eaaca9a308eae0b72a5296f5ee7534f46e74a974af9957804fe3f6fa3a"}
Jul 07 15:05:26.821390 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.821372    2574 scope.go:117] "RemoveContainer" containerID="ddfdb1a7365debe80b113406e1fabb6e1b0e2e7e0803cdb06d5a4de4073b5ea8"
Jul 07 15:05:26.821534 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:05:26.821515    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7f998ddff8-zm8n7_open-cluster-management-agent-addon(14576e55-7854-4572-8ac5-d2fc741ccb87)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7" podUID="14576e55-7854-4572-8ac5-d2fc741ccb87"
Jul 07 15:05:26.822272 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.822246    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss" event={"ID":"0e6fd9d6-e904-446a-b031-06ebe9ac9ace","Type":"ContainerStarted","Data":"63bde4cfb47ed5f356251ae80b52fafbd3b5eb7c0d061592b23b5849afb34108"}
Jul 07 15:05:26.823192 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:26.823169    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6" event={"ID":"30db6f20-e529-4ed7-b894-521a841a5445","Type":"ContainerStarted","Data":"e61053de015a7e09b415c619708012e18447e8b22bd1e2093e07e0d55c06db2d"}
Jul 07 15:05:27.828385 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:27.828341    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6" event={"ID":"30db6f20-e529-4ed7-b894-521a841a5445","Type":"ContainerStarted","Data":"21ce1d0060c48ee3de827dcad7546d49a6d854124e15d10fdff2a78e4fea0ce9"}
Jul 07 15:05:27.828892 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:27.828426    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:05:27.828892 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:27.828726    2574 scope.go:117] "RemoveContainer" containerID="c743216742be63d95385a3c6f596191edbf505621f1aa6ebe1d72bafbfb21d62"
Jul 07 15:05:27.828999 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:05:27.828909    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7db69c9d56-d7bvq_open-cluster-management-agent-addon(54251ec3-451e-44b6-b218-35c93790d77a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq" podUID="54251ec3-451e-44b6-b218-35c93790d77a"
Jul 07 15:05:27.848697 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:27.848635    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6" podStartSLOduration=285.848613305 podStartE2EDuration="4m45.848613305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:27.847052117 +0000 UTC m=+287.580938500" watchObservedRunningTime="2026-07-07 15:05:27.848613305 +0000 UTC m=+287.582499664"
Jul 07 15:05:28.185368 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.185300    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d7krp"]
Jul 07 15:05:28.188253 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.188222    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.191795 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.191767    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 15:05:28.192068 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.192053    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 15:05:28.192579 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.192545    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 15:05:28.192689 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.192620    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 15:05:28.192867 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.192852    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vwdqv\""
Jul 07 15:05:28.197472 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.197441    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 15:05:28.199900 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.199880    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 15:05:28.300172 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.300127    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-textfile\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.300172 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.300177    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtrbv\" (UniqueName: \"kubernetes.io/projected/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-kube-api-access-gtrbv\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.300427 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.300208    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-accelerators-collector-config\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.300427 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.300275    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.300427 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.300320    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-tls\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.300427 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.300363    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-sys\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.300427 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.300388    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-metrics-client-ca\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.300427 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.300403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-root\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.300427 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.300426    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-wtmp\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.401297 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.401252    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-accelerators-collector-config\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.401503 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.401326    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.401503 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.401362    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-tls\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.401503 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.401412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-sys\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.401503 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.401436    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-metrics-client-ca\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.401503 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.401458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-root\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.401503 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.401480    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-wtmp\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.401828 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.401511    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-textfile\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.401828 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.401521    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-sys\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.401828 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.401541    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtrbv\" (UniqueName: \"kubernetes.io/projected/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-kube-api-access-gtrbv\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.401976 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.401910    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-wtmp\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.401976 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.401965    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-root\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.402113 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.401969    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-accelerators-collector-config\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.402113 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.402048    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-metrics-client-ca\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.402218 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.402123    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-textfile\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.404075 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.404052    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.404323 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.404305    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-node-exporter-tls\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.410581 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.410545    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtrbv\" (UniqueName: \"kubernetes.io/projected/e46bf1ba-9df2-49b9-aaa4-59d0a945c916-kube-api-access-gtrbv\") pod \"node-exporter-d7krp\" (UID: \"e46bf1ba-9df2-49b9-aaa4-59d0a945c916\") " pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.502669 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.502580    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d7krp"
Jul 07 15:05:28.687572 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:05:28.687537    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46bf1ba_9df2_49b9_aaa4_59d0a945c916.slice/crio-7a88a5dbab52b68c73861d65be15a7e26c08d05b7abcf89d2aa51dcb060af0bc WatchSource:0}: Error finding container 7a88a5dbab52b68c73861d65be15a7e26c08d05b7abcf89d2aa51dcb060af0bc: Status 404 returned error can't find the container with id 7a88a5dbab52b68c73861d65be15a7e26c08d05b7abcf89d2aa51dcb060af0bc
Jul 07 15:05:28.835596 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.835550    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss" event={"ID":"0e6fd9d6-e904-446a-b031-06ebe9ac9ace","Type":"ContainerStarted","Data":"e1123286e30ae944e9c4f32cdc358b87933061e3cb0468f4d3280ea005881381"}
Jul 07 15:05:28.837728 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.837692    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7krp" event={"ID":"e46bf1ba-9df2-49b9-aaa4-59d0a945c916","Type":"ContainerStarted","Data":"7a88a5dbab52b68c73861d65be15a7e26c08d05b7abcf89d2aa51dcb060af0bc"}
Jul 07 15:05:28.840130 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.840100    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpdq6" event={"ID":"96e3cedc-88dc-46fe-bf69-bfaea614cc7f","Type":"ContainerStarted","Data":"5d82d0dbb9d51e89ead4902d08d84c577bb5732d04cc4c788ef7fe49a0e01c61"}
Jul 07 15:05:28.852257 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:28.852213    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-zp7ss" podStartSLOduration=283.963664359 podStartE2EDuration="4m45.852196604s" totalImagesPullingTime="1.888532245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:28.851651623 +0000 UTC m=+288.585538004" watchObservedRunningTime="2026-07-07 15:05:28.852196604 +0000 UTC m=+288.586082964"
Jul 07 15:05:29.844674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:29.844646    2574 generic.go:356] "Generic (PLEG): container finished" podID="e46bf1ba-9df2-49b9-aaa4-59d0a945c916" containerID="6f595dc8f69d76dedd5b6fdfaa461a080bf6a4d07b5c1ef4844f4cacb0e07963" exitCode=0
Jul 07 15:05:29.845073 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:29.844720    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7krp" event={"ID":"e46bf1ba-9df2-49b9-aaa4-59d0a945c916","Type":"ContainerDied","Data":"6f595dc8f69d76dedd5b6fdfaa461a080bf6a4d07b5c1ef4844f4cacb0e07963"}
Jul 07 15:05:29.846571 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:29.846544    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpdq6" event={"ID":"96e3cedc-88dc-46fe-bf69-bfaea614cc7f","Type":"ContainerStarted","Data":"c4d60245fc7a563e2b64cb43d738adfb590c2c83575ceee2bfeaac19b800bd03"}
Jul 07 15:05:29.846690 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:29.846624    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:05:29.877361 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:29.877312    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kpdq6" podStartSLOduration=251.758740384 podStartE2EDuration="4m13.877293967s" totalImagesPullingTime="2.118553583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:29.876277353 +0000 UTC m=+289.610163737" watchObservedRunningTime="2026-07-07 15:05:29.877293967 +0000 UTC m=+289.611180349"
Jul 07 15:05:30.851333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:30.851295    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7krp" event={"ID":"e46bf1ba-9df2-49b9-aaa4-59d0a945c916","Type":"ContainerStarted","Data":"8206699ba4a9a29383f516bf653647642f423ff66023d012322679a6769c1fda"}
Jul 07 15:05:30.851756 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:30.851355    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7krp" event={"ID":"e46bf1ba-9df2-49b9-aaa4-59d0a945c916","Type":"ContainerStarted","Data":"a9ec74bed4e16d568546ae29519773014314234137d4150fff03756d9e7062f1"}
Jul 07 15:05:30.869916 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:30.869864    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d7krp" podStartSLOduration=1.787778604 podStartE2EDuration="2.869848075s" totalImagesPullingTime="1.016136238s" totalInitContainerRuntime="65.933233ms" isStatefulPod=true podCreationTimestamp="2026-07-07 15:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:30.868423409 +0000 UTC m=+290.602309791" watchObservedRunningTime="2026-07-07 15:05:30.869848075 +0000 UTC m=+290.603734462"
Jul 07 15:05:36.527779 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:36.527735    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k" podUID="f9ca387e-d409-4533-90f2-b0101613e043" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 15:05:36.528184 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:36.527807    2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k"
Jul 07 15:05:36.528296 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:36.528266    2574 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"479f9e68350f614a512a01929149289179a2d5cb58a340591ae854d4d136d391"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 07 15:05:36.528334 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:36.528317    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k" podUID="f9ca387e-d409-4533-90f2-b0101613e043" containerName="service-proxy" containerID="cri-o://479f9e68350f614a512a01929149289179a2d5cb58a340591ae854d4d136d391" gracePeriod=30
Jul 07 15:05:36.871311 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:36.871224    2574 generic.go:356] "Generic (PLEG): container finished" podID="f9ca387e-d409-4533-90f2-b0101613e043" containerID="479f9e68350f614a512a01929149289179a2d5cb58a340591ae854d4d136d391" exitCode=2
Jul 07 15:05:36.871311 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:36.871287    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k" event={"ID":"f9ca387e-d409-4533-90f2-b0101613e043","Type":"ContainerDied","Data":"479f9e68350f614a512a01929149289179a2d5cb58a340591ae854d4d136d391"}
Jul 07 15:05:36.871504 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:36.871319    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f98c9576-5x66k" event={"ID":"f9ca387e-d409-4533-90f2-b0101613e043","Type":"ContainerStarted","Data":"34f2f992926f2a804156c996d870f7dfc267ede1c09a7c892293903eb6c77cd3"}
Jul 07 15:05:38.862377 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:05:38.862322    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sw26l" podUID="28f4b5b7-49c8-4d2a-8bb7-21bcce740d31"
Jul 07 15:05:39.853704 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:39.853675    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kpdq6"
Jul 07 15:05:39.862156 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:39.862135    2574 scope.go:117] "RemoveContainer" containerID="c743216742be63d95385a3c6f596191edbf505621f1aa6ebe1d72bafbfb21d62"
Jul 07 15:05:40.667666 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:40.667597    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:05:40.668327 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:40.668303    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:05:40.671205 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:40.671184    2574 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 15:05:40.885880 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:40.885748    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq" event={"ID":"54251ec3-451e-44b6-b218-35c93790d77a","Type":"ContainerStarted","Data":"35390b6859f299b332632426459890f8631254a32262cfddd5c06bb5664ecf07"}
Jul 07 15:05:41.084517 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:40.886040    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:05:41.084517 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:40.887636    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7db69c9d56-d7bvq"
Jul 07 15:05:41.862376 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:41.862339    2574 scope.go:117] "RemoveContainer" containerID="ddfdb1a7365debe80b113406e1fabb6e1b0e2e7e0803cdb06d5a4de4073b5ea8"
Jul 07 15:05:42.893645 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:42.893609    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f998ddff8-zm8n7" event={"ID":"14576e55-7854-4572-8ac5-d2fc741ccb87","Type":"ContainerStarted","Data":"fe4b1ff3b71f4e735cfb56cd3809913e8d361c540d3b15667004532210b1e9a4"}
Jul 07 15:05:44.662364 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:44.662326    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b9dc9555b-m4dw6"]
Jul 07 15:05:44.666915 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:44.666885    2574 patch_prober.go:28] interesting pod/image-registry-5b9dc9555b-m4dw6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 15:05:44.667083 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:44.666934    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6" podUID="30db6f20-e529-4ed7-b894-521a841a5445" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 15:05:49.861677 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:49.861632    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:05:54.667781 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:05:54.667753    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:06:09.682148 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:09.682095    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6" podUID="30db6f20-e529-4ed7-b894-521a841a5445" containerName="registry" containerID="cri-o://21ce1d0060c48ee3de827dcad7546d49a6d854124e15d10fdff2a78e4fea0ce9" gracePeriod=30
Jul 07 15:06:09.932586 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:09.932521    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:06:09.983024 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:09.982973    2574 generic.go:356] "Generic (PLEG): container finished" podID="30db6f20-e529-4ed7-b894-521a841a5445" containerID="21ce1d0060c48ee3de827dcad7546d49a6d854124e15d10fdff2a78e4fea0ce9" exitCode=0
Jul 07 15:06:09.983221 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:09.983039    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6"
Jul 07 15:06:09.983221 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:09.983035    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6" event={"ID":"30db6f20-e529-4ed7-b894-521a841a5445","Type":"ContainerDied","Data":"21ce1d0060c48ee3de827dcad7546d49a6d854124e15d10fdff2a78e4fea0ce9"}
Jul 07 15:06:09.983221 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:09.983095    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9dc9555b-m4dw6" event={"ID":"30db6f20-e529-4ed7-b894-521a841a5445","Type":"ContainerDied","Data":"e61053de015a7e09b415c619708012e18447e8b22bd1e2093e07e0d55c06db2d"}
Jul 07 15:06:09.983221 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:09.983126    2574 scope.go:117] "RemoveContainer" containerID="21ce1d0060c48ee3de827dcad7546d49a6d854124e15d10fdff2a78e4fea0ce9"
Jul 07 15:06:09.990941 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:09.990923    2574 scope.go:117] "RemoveContainer" containerID="21ce1d0060c48ee3de827dcad7546d49a6d854124e15d10fdff2a78e4fea0ce9"
Jul 07 15:06:09.991245 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:06:09.991226    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21ce1d0060c48ee3de827dcad7546d49a6d854124e15d10fdff2a78e4fea0ce9\": container with ID starting with 21ce1d0060c48ee3de827dcad7546d49a6d854124e15d10fdff2a78e4fea0ce9 not found: ID does not exist" containerID="21ce1d0060c48ee3de827dcad7546d49a6d854124e15d10fdff2a78e4fea0ce9"
Jul 07 15:06:09.991298 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:09.991257    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21ce1d0060c48ee3de827dcad7546d49a6d854124e15d10fdff2a78e4fea0ce9"} err="failed to get container status \"21ce1d0060c48ee3de827dcad7546d49a6d854124e15d10fdff2a78e4fea0ce9\": rpc error: code = NotFound desc = could not find container \"21ce1d0060c48ee3de827dcad7546d49a6d854124e15d10fdff2a78e4fea0ce9\": container with ID starting with 21ce1d0060c48ee3de827dcad7546d49a6d854124e15d10fdff2a78e4fea0ce9 not found: ID does not exist"
Jul 07 15:06:10.008094 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.008068    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30db6f20-e529-4ed7-b894-521a841a5445-registry-certificates\") pod \"30db6f20-e529-4ed7-b894-521a841a5445\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") "
Jul 07 15:06:10.008229 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.008113    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30db6f20-e529-4ed7-b894-521a841a5445-trusted-ca\") pod \"30db6f20-e529-4ed7-b894-521a841a5445\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") "
Jul 07 15:06:10.008229 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.008167    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30db6f20-e529-4ed7-b894-521a841a5445-ca-trust-extracted\") pod \"30db6f20-e529-4ed7-b894-521a841a5445\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") "
Jul 07 15:06:10.008229 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.008190    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls\") pod \"30db6f20-e529-4ed7-b894-521a841a5445\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") "
Jul 07 15:06:10.008384 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.008308    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tskc8\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-kube-api-access-tskc8\") pod \"30db6f20-e529-4ed7-b894-521a841a5445\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") "
Jul 07 15:06:10.008384 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.008372    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30db6f20-e529-4ed7-b894-521a841a5445-image-registry-private-configuration\") pod \"30db6f20-e529-4ed7-b894-521a841a5445\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") "
Jul 07 15:06:10.008472 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.008402    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-bound-sa-token\") pod \"30db6f20-e529-4ed7-b894-521a841a5445\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") "
Jul 07 15:06:10.008472 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.008439    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30db6f20-e529-4ed7-b894-521a841a5445-installation-pull-secrets\") pod \"30db6f20-e529-4ed7-b894-521a841a5445\" (UID: \"30db6f20-e529-4ed7-b894-521a841a5445\") "
Jul 07 15:06:10.009524 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.009231    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30db6f20-e529-4ed7-b894-521a841a5445-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "30db6f20-e529-4ed7-b894-521a841a5445" (UID: "30db6f20-e529-4ed7-b894-521a841a5445"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:06:10.009524 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.009345    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30db6f20-e529-4ed7-b894-521a841a5445-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "30db6f20-e529-4ed7-b894-521a841a5445" (UID: "30db6f20-e529-4ed7-b894-521a841a5445"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:06:10.012035 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.011907    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30db6f20-e529-4ed7-b894-521a841a5445-registry-certificates\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:06:10.012035 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.011937    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30db6f20-e529-4ed7-b894-521a841a5445-trusted-ca\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:06:10.012035 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.011931    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "30db6f20-e529-4ed7-b894-521a841a5445" (UID: "30db6f20-e529-4ed7-b894-521a841a5445"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:06:10.015053 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.012698    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-kube-api-access-tskc8" (OuterVolumeSpecName: "kube-api-access-tskc8") pod "30db6f20-e529-4ed7-b894-521a841a5445" (UID: "30db6f20-e529-4ed7-b894-521a841a5445"). InnerVolumeSpecName "kube-api-access-tskc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:06:10.015053 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.013777    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30db6f20-e529-4ed7-b894-521a841a5445-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "30db6f20-e529-4ed7-b894-521a841a5445" (UID: "30db6f20-e529-4ed7-b894-521a841a5445"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:06:10.018355 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.018189    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "30db6f20-e529-4ed7-b894-521a841a5445" (UID: "30db6f20-e529-4ed7-b894-521a841a5445"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:06:10.018355 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.018194    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30db6f20-e529-4ed7-b894-521a841a5445-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "30db6f20-e529-4ed7-b894-521a841a5445" (UID: "30db6f20-e529-4ed7-b894-521a841a5445"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:06:10.020612 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.020578    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30db6f20-e529-4ed7-b894-521a841a5445-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "30db6f20-e529-4ed7-b894-521a841a5445" (UID: "30db6f20-e529-4ed7-b894-521a841a5445"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:06:10.113187 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.113149    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30db6f20-e529-4ed7-b894-521a841a5445-image-registry-private-configuration\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:06:10.113187 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.113182    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-bound-sa-token\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:06:10.113187 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.113193    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30db6f20-e529-4ed7-b894-521a841a5445-installation-pull-secrets\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:06:10.113422 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.113203    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30db6f20-e529-4ed7-b894-521a841a5445-ca-trust-extracted\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:06:10.113422 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.113212    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-registry-tls\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:06:10.113422 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.113221    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tskc8\" (UniqueName: \"kubernetes.io/projected/30db6f20-e529-4ed7-b894-521a841a5445-kube-api-access-tskc8\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:06:10.303374 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.303340    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b9dc9555b-m4dw6"]
Jul 07 15:06:10.307336 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.307310    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b9dc9555b-m4dw6"]
Jul 07 15:06:10.865837 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:10.865805    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30db6f20-e529-4ed7-b894-521a841a5445" path="/var/lib/kubelet/pods/30db6f20-e529-4ed7-b894-521a841a5445/volumes"
Jul 07 15:06:54.741863 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:54.741821    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:06:54.744161 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:54.744140    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28f4b5b7-49c8-4d2a-8bb7-21bcce740d31-metrics-certs\") pod \"network-metrics-daemon-sw26l\" (UID: \"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31\") " pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:06:54.965141 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:54.965106    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mbwr6\""
Jul 07 15:06:54.973645 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:54.973623    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw26l"
Jul 07 15:06:55.103512 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:55.103480    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sw26l"]
Jul 07 15:06:55.106784 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:06:55.106757    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f4b5b7_49c8_4d2a_8bb7_21bcce740d31.slice/crio-9e7cfb108b252ebd1f444dc2a3a0786d9aa89c6b4559ea220593e3690ca7be06 WatchSource:0}: Error finding container 9e7cfb108b252ebd1f444dc2a3a0786d9aa89c6b4559ea220593e3690ca7be06: Status 404 returned error can't find the container with id 9e7cfb108b252ebd1f444dc2a3a0786d9aa89c6b4559ea220593e3690ca7be06
Jul 07 15:06:55.108702 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:55.108686    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:06:55.129463 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:55.129424    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sw26l" event={"ID":"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31","Type":"ContainerStarted","Data":"9e7cfb108b252ebd1f444dc2a3a0786d9aa89c6b4559ea220593e3690ca7be06"}
Jul 07 15:06:57.138188 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:57.138147    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sw26l" event={"ID":"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31","Type":"ContainerStarted","Data":"c145decee919535dccc9780fb661d525a3742056f7ab397662384834a2b2ea02"}
Jul 07 15:06:57.138589 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:57.138220    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sw26l" event={"ID":"28f4b5b7-49c8-4d2a-8bb7-21bcce740d31","Type":"ContainerStarted","Data":"375f62c7da15096df9b9fc705dbf701d66f7c995f62b80c6b1b070c46e9a6650"}
Jul 07 15:06:57.156066 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:06:57.155988    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sw26l" podStartSLOduration=375.078772543 podStartE2EDuration="6m16.155973072s" totalImagesPullingTime="1.077200529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:06:57.154554706 +0000 UTC m=+376.888441088" watchObservedRunningTime="2026-07-07 15:06:57.155973072 +0000 UTC m=+376.889859453"
Jul 07 15:08:32.438414 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.438328    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-s8cjd"]
Jul 07 15:08:32.438867 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.438587    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30db6f20-e529-4ed7-b894-521a841a5445" containerName="registry"
Jul 07 15:08:32.438867 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.438599    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="30db6f20-e529-4ed7-b894-521a841a5445" containerName="registry"
Jul 07 15:08:32.438867 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.438649    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="30db6f20-e529-4ed7-b894-521a841a5445" containerName="registry"
Jul 07 15:08:32.441378 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.441361    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-s8cjd"
Jul 07 15:08:32.443895 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.443866    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 15:08:32.443895 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.443869    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 15:08:32.444102 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.443926    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7bjhl\""
Jul 07 15:08:32.452894 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.452868    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-s8cjd"]
Jul 07 15:08:32.520670 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.520634    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e60caa15-606e-41bc-8e49-95beb473fe84-bound-sa-token\") pod \"cert-manager-55b4d954d5-s8cjd\" (UID: \"e60caa15-606e-41bc-8e49-95beb473fe84\") " pod="cert-manager/cert-manager-55b4d954d5-s8cjd"
Jul 07 15:08:32.520862 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.520682    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slc2p\" (UniqueName: \"kubernetes.io/projected/e60caa15-606e-41bc-8e49-95beb473fe84-kube-api-access-slc2p\") pod \"cert-manager-55b4d954d5-s8cjd\" (UID: \"e60caa15-606e-41bc-8e49-95beb473fe84\") " pod="cert-manager/cert-manager-55b4d954d5-s8cjd"
Jul 07 15:08:32.621238 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.621202    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e60caa15-606e-41bc-8e49-95beb473fe84-bound-sa-token\") pod \"cert-manager-55b4d954d5-s8cjd\" (UID: \"e60caa15-606e-41bc-8e49-95beb473fe84\") " pod="cert-manager/cert-manager-55b4d954d5-s8cjd"
Jul 07 15:08:32.621368 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.621243    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slc2p\" (UniqueName: \"kubernetes.io/projected/e60caa15-606e-41bc-8e49-95beb473fe84-kube-api-access-slc2p\") pod \"cert-manager-55b4d954d5-s8cjd\" (UID: \"e60caa15-606e-41bc-8e49-95beb473fe84\") " pod="cert-manager/cert-manager-55b4d954d5-s8cjd"
Jul 07 15:08:32.628799 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.628766    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e60caa15-606e-41bc-8e49-95beb473fe84-bound-sa-token\") pod \"cert-manager-55b4d954d5-s8cjd\" (UID: \"e60caa15-606e-41bc-8e49-95beb473fe84\") " pod="cert-manager/cert-manager-55b4d954d5-s8cjd"
Jul 07 15:08:32.628930 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.628837    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slc2p\" (UniqueName: \"kubernetes.io/projected/e60caa15-606e-41bc-8e49-95beb473fe84-kube-api-access-slc2p\") pod \"cert-manager-55b4d954d5-s8cjd\" (UID: \"e60caa15-606e-41bc-8e49-95beb473fe84\") " pod="cert-manager/cert-manager-55b4d954d5-s8cjd"
Jul 07 15:08:32.750368 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.750268    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-s8cjd"
Jul 07 15:08:32.874845 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:32.874813    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-s8cjd"]
Jul 07 15:08:32.877699 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:08:32.877663    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode60caa15_606e_41bc_8e49_95beb473fe84.slice/crio-3b39eadf113ce3b6d520ebca146a6121902fee9a7a90c7652700c30016c1618e WatchSource:0}: Error finding container 3b39eadf113ce3b6d520ebca146a6121902fee9a7a90c7652700c30016c1618e: Status 404 returned error can't find the container with id 3b39eadf113ce3b6d520ebca146a6121902fee9a7a90c7652700c30016c1618e
Jul 07 15:08:33.453927 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:33.453889    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-s8cjd" event={"ID":"e60caa15-606e-41bc-8e49-95beb473fe84","Type":"ContainerStarted","Data":"3b39eadf113ce3b6d520ebca146a6121902fee9a7a90c7652700c30016c1618e"}
Jul 07 15:08:36.467055 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:36.467019    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-s8cjd" event={"ID":"e60caa15-606e-41bc-8e49-95beb473fe84","Type":"ContainerStarted","Data":"60cad266b9a58e31a1f776fefa0f364349ad8627fe75b59a90acf11644aba394"}
Jul 07 15:08:36.487738 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:36.487680    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-s8cjd" podStartSLOduration=1.100489039 podStartE2EDuration="4.487661077s" totalImagesPullingTime="3.387172038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:08:36.48660235 +0000 UTC m=+476.220488732" watchObservedRunningTime="2026-07-07 15:08:36.487661077 +0000 UTC m=+476.221547458"
Jul 07 15:08:54.513703 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.513665    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"]
Jul 07 15:08:54.517089 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.517069    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.519473 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.519442    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 15:08:54.519473 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.519463    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 15:08:54.519622 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.519447    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 15:08:54.519769 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.519754    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f2t5w\""
Jul 07 15:08:54.520028 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.519997    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 15:08:54.536313 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.536280    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"]
Jul 07 15:08:54.675715 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.675673    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/147699b4-cf44-43c8-8209-023dbc7f4530-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.675715 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.675719    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/147699b4-cf44-43c8-8209-023dbc7f4530-webhook-cert\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.675930 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.675750    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr6c9\" (UniqueName: \"kubernetes.io/projected/147699b4-cf44-43c8-8209-023dbc7f4530-kube-api-access-zr6c9\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.675930 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.675776    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/147699b4-cf44-43c8-8209-023dbc7f4530-tmp\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.675930 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.675811    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/147699b4-cf44-43c8-8209-023dbc7f4530-manifests\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.777213 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.777183    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/147699b4-cf44-43c8-8209-023dbc7f4530-webhook-cert\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.777332 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.777227    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr6c9\" (UniqueName: \"kubernetes.io/projected/147699b4-cf44-43c8-8209-023dbc7f4530-kube-api-access-zr6c9\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.777332 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.777247    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/147699b4-cf44-43c8-8209-023dbc7f4530-tmp\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.777332 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.777304    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/147699b4-cf44-43c8-8209-023dbc7f4530-manifests\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.777458 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.777353    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/147699b4-cf44-43c8-8209-023dbc7f4530-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.777763 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.777736    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/147699b4-cf44-43c8-8209-023dbc7f4530-manifests\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.779737 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.779708    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/147699b4-cf44-43c8-8209-023dbc7f4530-tmp\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.779858 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.779812    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/147699b4-cf44-43c8-8209-023dbc7f4530-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.779898 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.779880    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/147699b4-cf44-43c8-8209-023dbc7f4530-webhook-cert\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.790835 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.790805    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr6c9\" (UniqueName: \"kubernetes.io/projected/147699b4-cf44-43c8-8209-023dbc7f4530-kube-api-access-zr6c9\") pod \"opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r\" (UID: \"147699b4-cf44-43c8-8209-023dbc7f4530\") " pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.826731 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.826692    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:08:54.961861 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:54.961831    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"]
Jul 07 15:08:54.965282 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:08:54.965256    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147699b4_cf44_43c8_8209_023dbc7f4530.slice/crio-5bb632f813b3dcd31d122c8bdaf03ab1491ef56bbaa7418c8252e010b936889a WatchSource:0}: Error finding container 5bb632f813b3dcd31d122c8bdaf03ab1491ef56bbaa7418c8252e010b936889a: Status 404 returned error can't find the container with id 5bb632f813b3dcd31d122c8bdaf03ab1491ef56bbaa7418c8252e010b936889a
Jul 07 15:08:55.537723 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:55.537684    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r" event={"ID":"147699b4-cf44-43c8-8209-023dbc7f4530","Type":"ContainerStarted","Data":"5bb632f813b3dcd31d122c8bdaf03ab1491ef56bbaa7418c8252e010b936889a"}
Jul 07 15:08:58.552266 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:58.552174    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r" event={"ID":"147699b4-cf44-43c8-8209-023dbc7f4530","Type":"ContainerStarted","Data":"0b7805551f9e8fc95bab5afc22bb96f1dc8b721edabb6ec003b8fe4ddca3aff1"}
Jul 07 15:08:59.558190 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:59.558151    2574 generic.go:356] "Generic (PLEG): container finished" podID="147699b4-cf44-43c8-8209-023dbc7f4530" containerID="0b7805551f9e8fc95bab5afc22bb96f1dc8b721edabb6ec003b8fe4ddca3aff1" exitCode=0
Jul 07 15:08:59.558590 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:08:59.558225    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r" event={"ID":"147699b4-cf44-43c8-8209-023dbc7f4530","Type":"ContainerDied","Data":"0b7805551f9e8fc95bab5afc22bb96f1dc8b721edabb6ec003b8fe4ddca3aff1"}
Jul 07 15:09:00.565621 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:00.565578    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r" event={"ID":"147699b4-cf44-43c8-8209-023dbc7f4530","Type":"ContainerStarted","Data":"56ad4bb5bfc322f7f837fd10d05769769a062192fd36b48c5ec8215f2efc5ac0"}
Jul 07 15:09:00.566123 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:00.565715    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:09:11.571815 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:11.571787    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r"
Jul 07 15:09:11.595587 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:11.595521    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r" podStartSLOduration=12.795908175 podStartE2EDuration="17.595501184s" totalImagesPullingTime="3.718755406s" totalInitContainerRuntime="1.080837603s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:08:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:09:00.610146791 +0000 UTC m=+500.344033173" watchObservedRunningTime="2026-07-07 15:09:11.595501184 +0000 UTC m=+511.329387570"
Jul 07 15:09:14.612204 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:14.612160    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-x5vpc"]
Jul 07 15:09:14.621990 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:14.621960    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-x5vpc"
Jul 07 15:09:14.624143 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:14.624116    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 15:09:14.624278 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:14.624199    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-g6bm2\""
Jul 07 15:09:14.627183 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:14.627157    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-x5vpc"]
Jul 07 15:09:14.713405 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:14.713371    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/548b6708-0881-443a-80ac-ae1bde1ff258-cert\") pod \"odh-model-controller-7998c67dc4-x5vpc\" (UID: \"548b6708-0881-443a-80ac-ae1bde1ff258\") " pod="opendatahub/odh-model-controller-7998c67dc4-x5vpc"
Jul 07 15:09:14.713576 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:14.713432    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmcbj\" (UniqueName: \"kubernetes.io/projected/548b6708-0881-443a-80ac-ae1bde1ff258-kube-api-access-dmcbj\") pod \"odh-model-controller-7998c67dc4-x5vpc\" (UID: \"548b6708-0881-443a-80ac-ae1bde1ff258\") " pod="opendatahub/odh-model-controller-7998c67dc4-x5vpc"
Jul 07 15:09:14.814423 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:14.814382    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmcbj\" (UniqueName: \"kubernetes.io/projected/548b6708-0881-443a-80ac-ae1bde1ff258-kube-api-access-dmcbj\") pod \"odh-model-controller-7998c67dc4-x5vpc\" (UID: \"548b6708-0881-443a-80ac-ae1bde1ff258\") " pod="opendatahub/odh-model-controller-7998c67dc4-x5vpc"
Jul 07 15:09:14.814611 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:14.814441    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/548b6708-0881-443a-80ac-ae1bde1ff258-cert\") pod \"odh-model-controller-7998c67dc4-x5vpc\" (UID: \"548b6708-0881-443a-80ac-ae1bde1ff258\") " pod="opendatahub/odh-model-controller-7998c67dc4-x5vpc"
Jul 07 15:09:14.814611 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:09:14.814552    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 07 15:09:14.814611 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:09:14.814608    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/548b6708-0881-443a-80ac-ae1bde1ff258-cert podName:548b6708-0881-443a-80ac-ae1bde1ff258 nodeName:}" failed. No retries permitted until 2026-07-07 15:09:15.314591286 +0000 UTC m=+515.048477657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/548b6708-0881-443a-80ac-ae1bde1ff258-cert") pod "odh-model-controller-7998c67dc4-x5vpc" (UID: "548b6708-0881-443a-80ac-ae1bde1ff258") : secret "odh-model-controller-webhook-cert" not found
Jul 07 15:09:14.824619 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:14.824585    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmcbj\" (UniqueName: \"kubernetes.io/projected/548b6708-0881-443a-80ac-ae1bde1ff258-kube-api-access-dmcbj\") pod \"odh-model-controller-7998c67dc4-x5vpc\" (UID: \"548b6708-0881-443a-80ac-ae1bde1ff258\") " pod="opendatahub/odh-model-controller-7998c67dc4-x5vpc"
Jul 07 15:09:15.316561 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.316526    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9844g"]
Jul 07 15:09:15.319871 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.319855    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-9844g"
Jul 07 15:09:15.325982 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.325949    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/548b6708-0881-443a-80ac-ae1bde1ff258-cert\") pod \"odh-model-controller-7998c67dc4-x5vpc\" (UID: \"548b6708-0881-443a-80ac-ae1bde1ff258\") " pod="opendatahub/odh-model-controller-7998c67dc4-x5vpc"
Jul 07 15:09:15.328538 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.328512    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/548b6708-0881-443a-80ac-ae1bde1ff258-cert\") pod \"odh-model-controller-7998c67dc4-x5vpc\" (UID: \"548b6708-0881-443a-80ac-ae1bde1ff258\") " pod="opendatahub/odh-model-controller-7998c67dc4-x5vpc"
Jul 07 15:09:15.329105 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.329085    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 15:09:15.351674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.351627    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9844g"]
Jul 07 15:09:15.427107 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.427070    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2w55\" (UniqueName: \"kubernetes.io/projected/33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f-kube-api-access-d2w55\") pod \"model-serving-api-54d89bd5fc-9844g\" (UID: \"33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-9844g"
Jul 07 15:09:15.427107 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.427115    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f-tls-certs\") pod \"model-serving-api-54d89bd5fc-9844g\" (UID: \"33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-9844g"
Jul 07 15:09:15.528180 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.528146    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2w55\" (UniqueName: \"kubernetes.io/projected/33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f-kube-api-access-d2w55\") pod \"model-serving-api-54d89bd5fc-9844g\" (UID: \"33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-9844g"
Jul 07 15:09:15.528357 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.528191    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f-tls-certs\") pod \"model-serving-api-54d89bd5fc-9844g\" (UID: \"33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-9844g"
Jul 07 15:09:15.530636 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.530615    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f-tls-certs\") pod \"model-serving-api-54d89bd5fc-9844g\" (UID: \"33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-9844g"
Jul 07 15:09:15.533532 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.533503    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-x5vpc"
Jul 07 15:09:15.537166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.537142    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2w55\" (UniqueName: \"kubernetes.io/projected/33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f-kube-api-access-d2w55\") pod \"model-serving-api-54d89bd5fc-9844g\" (UID: \"33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-9844g"
Jul 07 15:09:15.629415 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.629383    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-9844g"
Jul 07 15:09:15.674619 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.674560    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-x5vpc"]
Jul 07 15:09:15.678947 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:09:15.678912    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548b6708_0881_443a_80ac_ae1bde1ff258.slice/crio-ee76bde25ac0ec62287c8f212f825f93751894add6a9395c3bfce013b104dcfc WatchSource:0}: Error finding container ee76bde25ac0ec62287c8f212f825f93751894add6a9395c3bfce013b104dcfc: Status 404 returned error can't find the container with id ee76bde25ac0ec62287c8f212f825f93751894add6a9395c3bfce013b104dcfc
Jul 07 15:09:15.767034 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:15.766980    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9844g"]
Jul 07 15:09:15.770241 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:09:15.770210    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33ce1f51_0a14_4ba5_95d7_dcaa2d3e6f0f.slice/crio-a8bf73c1cb24129ca074e6d0019e5d215ad6575e1f48bec315f885a27d27f1a2 WatchSource:0}: Error finding container a8bf73c1cb24129ca074e6d0019e5d215ad6575e1f48bec315f885a27d27f1a2: Status 404 returned error can't find the container with id a8bf73c1cb24129ca074e6d0019e5d215ad6575e1f48bec315f885a27d27f1a2
Jul 07 15:09:16.624636 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:16.624598    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-x5vpc" event={"ID":"548b6708-0881-443a-80ac-ae1bde1ff258","Type":"ContainerStarted","Data":"ee76bde25ac0ec62287c8f212f825f93751894add6a9395c3bfce013b104dcfc"}
Jul 07 15:09:16.625666 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:16.625646    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-9844g" event={"ID":"33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f","Type":"ContainerStarted","Data":"a8bf73c1cb24129ca074e6d0019e5d215ad6575e1f48bec315f885a27d27f1a2"}
Jul 07 15:09:19.811251 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.811208    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2"]
Jul 07 15:09:19.814742 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.814710    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2"
Jul 07 15:09:19.817040 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.816865    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 15:09:19.821753 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.821237    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 15:09:19.821753 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.821410    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 15:09:19.821753 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.821516    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-442xg\""
Jul 07 15:09:19.821753 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.821688    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 15:09:19.830287 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.830262    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2"]
Jul 07 15:09:19.867705 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.867669    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztlm4\" (UniqueName: \"kubernetes.io/projected/16fe234c-0991-46e3-b902-796dfb8269ce-kube-api-access-ztlm4\") pod \"kube-auth-proxy-f474c7cd5-wdbv2\" (UID: \"16fe234c-0991-46e3-b902-796dfb8269ce\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2"
Jul 07 15:09:19.867896 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.867743    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16fe234c-0991-46e3-b902-796dfb8269ce-tmp\") pod \"kube-auth-proxy-f474c7cd5-wdbv2\" (UID: \"16fe234c-0991-46e3-b902-796dfb8269ce\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2"
Jul 07 15:09:19.867896 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.867771    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16fe234c-0991-46e3-b902-796dfb8269ce-tls-certs\") pod \"kube-auth-proxy-f474c7cd5-wdbv2\" (UID: \"16fe234c-0991-46e3-b902-796dfb8269ce\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2"
Jul 07 15:09:19.968820 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.968786    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztlm4\" (UniqueName: \"kubernetes.io/projected/16fe234c-0991-46e3-b902-796dfb8269ce-kube-api-access-ztlm4\") pod \"kube-auth-proxy-f474c7cd5-wdbv2\" (UID: \"16fe234c-0991-46e3-b902-796dfb8269ce\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2"
Jul 07 15:09:19.968995 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.968852    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16fe234c-0991-46e3-b902-796dfb8269ce-tmp\") pod \"kube-auth-proxy-f474c7cd5-wdbv2\" (UID: \"16fe234c-0991-46e3-b902-796dfb8269ce\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2"
Jul 07 15:09:19.968995 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.968883    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16fe234c-0991-46e3-b902-796dfb8269ce-tls-certs\") pod \"kube-auth-proxy-f474c7cd5-wdbv2\" (UID: \"16fe234c-0991-46e3-b902-796dfb8269ce\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2"
Jul 07 15:09:19.971343 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.971307    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16fe234c-0991-46e3-b902-796dfb8269ce-tmp\") pod \"kube-auth-proxy-f474c7cd5-wdbv2\" (UID: \"16fe234c-0991-46e3-b902-796dfb8269ce\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2"
Jul 07 15:09:19.971465 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.971365    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16fe234c-0991-46e3-b902-796dfb8269ce-tls-certs\") pod \"kube-auth-proxy-f474c7cd5-wdbv2\" (UID: \"16fe234c-0991-46e3-b902-796dfb8269ce\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2"
Jul 07 15:09:19.978524 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:19.978494    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztlm4\" (UniqueName: \"kubernetes.io/projected/16fe234c-0991-46e3-b902-796dfb8269ce-kube-api-access-ztlm4\") pod \"kube-auth-proxy-f474c7cd5-wdbv2\" (UID: \"16fe234c-0991-46e3-b902-796dfb8269ce\") " pod="openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2"
Jul 07 15:09:20.127257 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.127165    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2"
Jul 07 15:09:20.318426 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.318379    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2"]
Jul 07 15:09:20.321571 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:09:20.321544    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16fe234c_0991_46e3_b902_796dfb8269ce.slice/crio-d46e12eabcbeb09a8ed857adf6b27ee229b525dbe7031d0242d8c98ee530e4ad WatchSource:0}: Error finding container d46e12eabcbeb09a8ed857adf6b27ee229b525dbe7031d0242d8c98ee530e4ad: Status 404 returned error can't find the container with id d46e12eabcbeb09a8ed857adf6b27ee229b525dbe7031d0242d8c98ee530e4ad
Jul 07 15:09:20.643396 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.643349    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-x5vpc" event={"ID":"548b6708-0881-443a-80ac-ae1bde1ff258","Type":"ContainerStarted","Data":"c1b0478c9e5c628ac24efc031fbf1c156f1b39597ba55b4eca30dc584479aa67"}
Jul 07 15:09:20.643603 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.643492    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-x5vpc"
Jul 07 15:09:20.645307 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.645280    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-9844g" event={"ID":"33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f","Type":"ContainerStarted","Data":"698dfffdcf52b90fcb3844ba83d158db9557f99ea262924ab16e53acba15526b"}
Jul 07 15:09:20.645446 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.645352    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-9844g"
Jul 07 15:09:20.646790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.646760    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2" event={"ID":"16fe234c-0991-46e3-b902-796dfb8269ce","Type":"ContainerStarted","Data":"d46e12eabcbeb09a8ed857adf6b27ee229b525dbe7031d0242d8c98ee530e4ad"}
Jul 07 15:09:20.666837 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.666749    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-x5vpc" podStartSLOduration=2.3553794359999998 podStartE2EDuration="6.66672727s" totalImagesPullingTime="4.311347834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:09:20.665102168 +0000 UTC m=+520.398988550" watchObservedRunningTime="2026-07-07 15:09:20.66672727 +0000 UTC m=+520.400613654"
Jul 07 15:09:20.683203 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.683145    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-9844g" podStartSLOduration=1.466634501 podStartE2EDuration="5.683127432s" totalImagesPullingTime="4.216492931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:09:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:09:20.682118944 +0000 UTC m=+520.416005337" watchObservedRunningTime="2026-07-07 15:09:20.683127432 +0000 UTC m=+520.417013813"
Jul 07 15:09:20.928734 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.928658    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"]
Jul 07 15:09:20.932977 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.932954    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:20.935078 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.935058    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 15:09:20.935180 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.935111    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-phtwb\""
Jul 07 15:09:20.935228 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.935179    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 15:09:20.935421 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.935408    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 15:09:20.935469 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.935428    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 15:09:20.944103 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.944081    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"]
Jul 07 15:09:20.976773 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.976734    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-cacerts\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:20.976965 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.976794    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca57750a-df1f-4f35-9962-922aab92e00a-istio-token\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:20.976965 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.976840    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca57750a-df1f-4f35-9962-922aab92e00a-local-certs\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:20.976965 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.976877    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:20.977152 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.976995    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:20.977152 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.977069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr4qd\" (UniqueName: \"kubernetes.io/projected/ca57750a-df1f-4f35-9962-922aab92e00a-kube-api-access-mr4qd\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:20.977152 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:20.977125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca57750a-df1f-4f35-9962-922aab92e00a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.078477 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.078434    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.078679 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.078501    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr4qd\" (UniqueName: \"kubernetes.io/projected/ca57750a-df1f-4f35-9962-922aab92e00a-kube-api-access-mr4qd\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.078679 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.078530    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca57750a-df1f-4f35-9962-922aab92e00a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.078679 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.078547    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-cacerts\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.078679 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.078573    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca57750a-df1f-4f35-9962-922aab92e00a-istio-token\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.078679 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.078592    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca57750a-df1f-4f35-9962-922aab92e00a-local-certs\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.078679 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.078607    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.079287 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.079255    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca57750a-df1f-4f35-9962-922aab92e00a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.081086 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.081059    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca57750a-df1f-4f35-9962-922aab92e00a-local-certs\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.081173 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.081098    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.081173 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.081113    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.081255 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.081237    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-cacerts\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.086370 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.086347    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca57750a-df1f-4f35-9962-922aab92e00a-istio-token\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.086555 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.086534    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr4qd\" (UniqueName: \"kubernetes.io/projected/ca57750a-df1f-4f35-9962-922aab92e00a-kube-api-access-mr4qd\") pod \"istiod-openshift-gateway-7574459656-xm4gq\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.244140 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.244053    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:21.402807 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.402771    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"]
Jul 07 15:09:21.406435 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:09:21.406402    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca57750a_df1f_4f35_9962_922aab92e00a.slice/crio-ea0c24133dae1f0368e73214483c7eca537e6a536f2f683354115d68c82a979d WatchSource:0}: Error finding container ea0c24133dae1f0368e73214483c7eca537e6a536f2f683354115d68c82a979d: Status 404 returned error can't find the container with id ea0c24133dae1f0368e73214483c7eca537e6a536f2f683354115d68c82a979d
Jul 07 15:09:21.651618 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:21.651581    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq" event={"ID":"ca57750a-df1f-4f35-9962-922aab92e00a","Type":"ContainerStarted","Data":"ea0c24133dae1f0368e73214483c7eca537e6a536f2f683354115d68c82a979d"}
Jul 07 15:09:24.516173 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:24.516128    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 15:09:24.516472 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:24.516227    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 15:09:24.665840 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:24.665803    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq" event={"ID":"ca57750a-df1f-4f35-9962-922aab92e00a","Type":"ContainerStarted","Data":"0eec7c094ab7976174da7b9b8eb255cdbcf4f58bc1e6bd942d64f038dc0bd2e7"}
Jul 07 15:09:24.666070 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:24.665917    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:24.667528 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:24.667503    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2" event={"ID":"16fe234c-0991-46e3-b902-796dfb8269ce","Type":"ContainerStarted","Data":"8be36ef97c61fad319ea929b412cdfab104195efa8d52cb6b0568942d0ab977d"}
Jul 07 15:09:24.713126 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:24.713073    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq" podStartSLOduration=1.606125428 podStartE2EDuration="4.713056495s" totalImagesPullingTime="3.106931067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:09:24.711983638 +0000 UTC m=+524.445870032" watchObservedRunningTime="2026-07-07 15:09:24.713056495 +0000 UTC m=+524.446942876"
Jul 07 15:09:24.742181 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:24.742121    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f474c7cd5-wdbv2" podStartSLOduration=1.555329044 podStartE2EDuration="5.742098918s" totalImagesPullingTime="4.186769874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:09:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:09:24.741643582 +0000 UTC m=+524.475529964" watchObservedRunningTime="2026-07-07 15:09:24.742098918 +0000 UTC m=+524.475985302"
Jul 07 15:09:25.302656 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.302615    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q"]
Jul 07 15:09:25.307486 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.307453    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q"
Jul 07 15:09:25.310343 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.310315    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 15:09:25.310494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.310445    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2hppv\""
Jul 07 15:09:25.320221 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.320195    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw"]
Jul 07 15:09:25.323338 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.323316    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw"
Jul 07 15:09:25.326540 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.326510    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 15:09:25.326680 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.326537    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jxtmq\""
Jul 07 15:09:25.329555 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.328819    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q"]
Jul 07 15:09:25.346116 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.345867    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw"]
Jul 07 15:09:25.417801 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.417764    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c6vj\" (UniqueName: \"kubernetes.io/projected/5fa8449e-d52f-4fa3-a953-7ec7bf5a9276-kube-api-access-7c6vj\") pod \"llmisvc-controller-manager-777c6bd7d5-wwrpw\" (UID: \"5fa8449e-d52f-4fa3-a953-7ec7bf5a9276\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw"
Jul 07 15:09:25.417801 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.417805    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ee848ff-e538-4121-bcde-f0a77bc25a0f-cert\") pod \"kserve-controller-manager-d6f4b65b8-nrp9q\" (UID: \"5ee848ff-e538-4121-bcde-f0a77bc25a0f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q"
Jul 07 15:09:25.418040 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.417823    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxzpr\" (UniqueName: \"kubernetes.io/projected/5ee848ff-e538-4121-bcde-f0a77bc25a0f-kube-api-access-zxzpr\") pod \"kserve-controller-manager-d6f4b65b8-nrp9q\" (UID: \"5ee848ff-e538-4121-bcde-f0a77bc25a0f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q"
Jul 07 15:09:25.418040 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.417922    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fa8449e-d52f-4fa3-a953-7ec7bf5a9276-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wwrpw\" (UID: \"5fa8449e-d52f-4fa3-a953-7ec7bf5a9276\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw"
Jul 07 15:09:25.519094 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.519055    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c6vj\" (UniqueName: \"kubernetes.io/projected/5fa8449e-d52f-4fa3-a953-7ec7bf5a9276-kube-api-access-7c6vj\") pod \"llmisvc-controller-manager-777c6bd7d5-wwrpw\" (UID: \"5fa8449e-d52f-4fa3-a953-7ec7bf5a9276\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw"
Jul 07 15:09:25.519094 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.519096    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ee848ff-e538-4121-bcde-f0a77bc25a0f-cert\") pod \"kserve-controller-manager-d6f4b65b8-nrp9q\" (UID: \"5ee848ff-e538-4121-bcde-f0a77bc25a0f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q"
Jul 07 15:09:25.519094 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.519114    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxzpr\" (UniqueName: \"kubernetes.io/projected/5ee848ff-e538-4121-bcde-f0a77bc25a0f-kube-api-access-zxzpr\") pod \"kserve-controller-manager-d6f4b65b8-nrp9q\" (UID: \"5ee848ff-e538-4121-bcde-f0a77bc25a0f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q"
Jul 07 15:09:25.519651 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.519408    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fa8449e-d52f-4fa3-a953-7ec7bf5a9276-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wwrpw\" (UID: \"5fa8449e-d52f-4fa3-a953-7ec7bf5a9276\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw"
Jul 07 15:09:25.521710 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.521684    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fa8449e-d52f-4fa3-a953-7ec7bf5a9276-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wwrpw\" (UID: \"5fa8449e-d52f-4fa3-a953-7ec7bf5a9276\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw"
Jul 07 15:09:25.521853 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.521762    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ee848ff-e538-4121-bcde-f0a77bc25a0f-cert\") pod \"kserve-controller-manager-d6f4b65b8-nrp9q\" (UID: \"5ee848ff-e538-4121-bcde-f0a77bc25a0f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q"
Jul 07 15:09:25.531323 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.531280    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c6vj\" (UniqueName: \"kubernetes.io/projected/5fa8449e-d52f-4fa3-a953-7ec7bf5a9276-kube-api-access-7c6vj\") pod \"llmisvc-controller-manager-777c6bd7d5-wwrpw\" (UID: \"5fa8449e-d52f-4fa3-a953-7ec7bf5a9276\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw"
Jul 07 15:09:25.538225 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.538194    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxzpr\" (UniqueName: \"kubernetes.io/projected/5ee848ff-e538-4121-bcde-f0a77bc25a0f-kube-api-access-zxzpr\") pod \"kserve-controller-manager-d6f4b65b8-nrp9q\" (UID: \"5ee848ff-e538-4121-bcde-f0a77bc25a0f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q"
Jul 07 15:09:25.620237 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.620141    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q"
Jul 07 15:09:25.640708 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.640676    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw"
Jul 07 15:09:25.673693 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.673659    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-xm4gq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 15:09:25.673864 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.673725    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq" podUID="ca57750a-df1f-4f35-9962-922aab92e00a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 15:09:25.781090 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.781059    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q"]
Jul 07 15:09:25.783694 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:09:25.783661    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee848ff_e538_4121_bcde_f0a77bc25a0f.slice/crio-571a9e1bc7e211e7c796b09cd322860906ecf995941d99cfbe8a29d5b71d0fbd WatchSource:0}: Error finding container 571a9e1bc7e211e7c796b09cd322860906ecf995941d99cfbe8a29d5b71d0fbd: Status 404 returned error can't find the container with id 571a9e1bc7e211e7c796b09cd322860906ecf995941d99cfbe8a29d5b71d0fbd
Jul 07 15:09:25.805341 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:25.805303    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw"]
Jul 07 15:09:25.808565 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:09:25.808534    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5fa8449e_d52f_4fa3_a953_7ec7bf5a9276.slice/crio-b383e4362def76136dcd5be19ff6c8d17c6ce0e8b49c1dc9b972050b64cc5e34 WatchSource:0}: Error finding container b383e4362def76136dcd5be19ff6c8d17c6ce0e8b49c1dc9b972050b64cc5e34: Status 404 returned error can't find the container with id b383e4362def76136dcd5be19ff6c8d17c6ce0e8b49c1dc9b972050b64cc5e34
Jul 07 15:09:26.305574 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.305542    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"]
Jul 07 15:09:26.310068 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.310046    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.313278 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.313242    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-22wmp\""
Jul 07 15:09:26.322349 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.322324    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"]
Jul 07 15:09:26.427535 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.427488    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.427737 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.427542    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9msmn\" (UniqueName: \"kubernetes.io/projected/e4525301-c30d-4c4d-b43f-97885a571e67-kube-api-access-9msmn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.427737 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.427621    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.427737 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.427663    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.427737 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.427702    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4525301-c30d-4c4d-b43f-97885a571e67-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.427941 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.427739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4525301-c30d-4c4d-b43f-97885a571e67-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.427941 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.427795    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4525301-c30d-4c4d-b43f-97885a571e67-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.427941 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.427860    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.427941 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.427886    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.528365 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.528331    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.528901 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.528370    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.528901 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.528408    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.528901 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.528441    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9msmn\" (UniqueName: \"kubernetes.io/projected/e4525301-c30d-4c4d-b43f-97885a571e67-kube-api-access-9msmn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.528901 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.528492    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.528901 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.528531    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.528901 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.528568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4525301-c30d-4c4d-b43f-97885a571e67-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.529248 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.529116    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.529248 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.529187    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4525301-c30d-4c4d-b43f-97885a571e67-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.529355 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.529250    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4525301-c30d-4c4d-b43f-97885a571e67-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.529411 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.529363    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.529904 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.529657    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.530775 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.530127    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4525301-c30d-4c4d-b43f-97885a571e67-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.531017 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.530665    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.531777 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.531741    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4525301-c30d-4c4d-b43f-97885a571e67-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.532325 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.532299    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4525301-c30d-4c4d-b43f-97885a571e67-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.548626 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.548594    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4525301-c30d-4c4d-b43f-97885a571e67-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.548801 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.548776    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9msmn\" (UniqueName: \"kubernetes.io/projected/e4525301-c30d-4c4d-b43f-97885a571e67-kube-api-access-9msmn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bzw8p\" (UID: \"e4525301-c30d-4c4d-b43f-97885a571e67\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.622279 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.622203    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:26.680063 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.680001    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw" event={"ID":"5fa8449e-d52f-4fa3-a953-7ec7bf5a9276","Type":"ContainerStarted","Data":"b383e4362def76136dcd5be19ff6c8d17c6ce0e8b49c1dc9b972050b64cc5e34"}
Jul 07 15:09:26.681481 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.681448    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q" event={"ID":"5ee848ff-e538-4121-bcde-f0a77bc25a0f","Type":"ContainerStarted","Data":"571a9e1bc7e211e7c796b09cd322860906ecf995941d99cfbe8a29d5b71d0fbd"}
Jul 07 15:09:26.801513 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:26.801476    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"]
Jul 07 15:09:26.847255 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:09:26.847146    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4525301_c30d_4c4d_b43f_97885a571e67.slice/crio-0b0c1395b029229860113131b7e94d0f298daf3d79653873a282a3531b4bdb4d WatchSource:0}: Error finding container 0b0c1395b029229860113131b7e94d0f298daf3d79653873a282a3531b4bdb4d: Status 404 returned error can't find the container with id 0b0c1395b029229860113131b7e94d0f298daf3d79653873a282a3531b4bdb4d
Jul 07 15:09:27.687626 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:27.687583    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p" event={"ID":"e4525301-c30d-4c4d-b43f-97885a571e67","Type":"ContainerStarted","Data":"0b0c1395b029229860113131b7e94d0f298daf3d79653873a282a3531b4bdb4d"}
Jul 07 15:09:27.979214 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:27.979118    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"]
Jul 07 15:09:27.979429 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:27.979392    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq" podUID="ca57750a-df1f-4f35-9962-922aab92e00a" containerName="discovery" containerID="cri-o://0eec7c094ab7976174da7b9b8eb255cdbcf4f58bc1e6bd942d64f038dc0bd2e7" gracePeriod=30
Jul 07 15:09:27.980420 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:27.980293    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:28.694715 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:28.694683    2574 generic.go:356] "Generic (PLEG): container finished" podID="ca57750a-df1f-4f35-9962-922aab92e00a" containerID="0eec7c094ab7976174da7b9b8eb255cdbcf4f58bc1e6bd942d64f038dc0bd2e7" exitCode=0
Jul 07 15:09:28.695252 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:28.694770    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq" event={"ID":"ca57750a-df1f-4f35-9962-922aab92e00a","Type":"ContainerDied","Data":"0eec7c094ab7976174da7b9b8eb255cdbcf4f58bc1e6bd942d64f038dc0bd2e7"}
Jul 07 15:09:29.742778 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.742748    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:29.862310 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.862274    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-istio-kubeconfig\") pod \"ca57750a-df1f-4f35-9962-922aab92e00a\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") "
Jul 07 15:09:29.862485 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.862325    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr4qd\" (UniqueName: \"kubernetes.io/projected/ca57750a-df1f-4f35-9962-922aab92e00a-kube-api-access-mr4qd\") pod \"ca57750a-df1f-4f35-9962-922aab92e00a\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") "
Jul 07 15:09:29.862485 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.862372    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca57750a-df1f-4f35-9962-922aab92e00a-istio-csr-ca-configmap\") pod \"ca57750a-df1f-4f35-9962-922aab92e00a\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") "
Jul 07 15:09:29.862485 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.862406    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-istio-csr-dns-cert\") pod \"ca57750a-df1f-4f35-9962-922aab92e00a\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") "
Jul 07 15:09:29.862485 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.862441    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-cacerts\") pod \"ca57750a-df1f-4f35-9962-922aab92e00a\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") "
Jul 07 15:09:29.862704 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.862488    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca57750a-df1f-4f35-9962-922aab92e00a-istio-token\") pod \"ca57750a-df1f-4f35-9962-922aab92e00a\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") "
Jul 07 15:09:29.862704 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.862561    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca57750a-df1f-4f35-9962-922aab92e00a-local-certs\") pod \"ca57750a-df1f-4f35-9962-922aab92e00a\" (UID: \"ca57750a-df1f-4f35-9962-922aab92e00a\") "
Jul 07 15:09:29.862829 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.862800    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca57750a-df1f-4f35-9962-922aab92e00a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "ca57750a-df1f-4f35-9962-922aab92e00a" (UID: "ca57750a-df1f-4f35-9962-922aab92e00a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:09:29.865322 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.865287    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "ca57750a-df1f-4f35-9962-922aab92e00a" (UID: "ca57750a-df1f-4f35-9962-922aab92e00a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:09:29.865322 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.865296    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca57750a-df1f-4f35-9962-922aab92e00a-kube-api-access-mr4qd" (OuterVolumeSpecName: "kube-api-access-mr4qd") pod "ca57750a-df1f-4f35-9962-922aab92e00a" (UID: "ca57750a-df1f-4f35-9962-922aab92e00a"). InnerVolumeSpecName "kube-api-access-mr4qd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:09:29.865504 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.865414    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca57750a-df1f-4f35-9962-922aab92e00a-local-certs" (OuterVolumeSpecName: "local-certs") pod "ca57750a-df1f-4f35-9962-922aab92e00a" (UID: "ca57750a-df1f-4f35-9962-922aab92e00a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:09:29.865803 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.865765    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "ca57750a-df1f-4f35-9962-922aab92e00a" (UID: "ca57750a-df1f-4f35-9962-922aab92e00a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:09:29.865886 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.865827    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca57750a-df1f-4f35-9962-922aab92e00a-istio-token" (OuterVolumeSpecName: "istio-token") pod "ca57750a-df1f-4f35-9962-922aab92e00a" (UID: "ca57750a-df1f-4f35-9962-922aab92e00a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:09:29.866089 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.866066    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-cacerts" (OuterVolumeSpecName: "cacerts") pod "ca57750a-df1f-4f35-9962-922aab92e00a" (UID: "ca57750a-df1f-4f35-9962-922aab92e00a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:09:29.963710 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.963675    2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca57750a-df1f-4f35-9962-922aab92e00a-local-certs\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:09:29.963710 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.963706    2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-istio-kubeconfig\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:09:29.963710 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.963715    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr4qd\" (UniqueName: \"kubernetes.io/projected/ca57750a-df1f-4f35-9962-922aab92e00a-kube-api-access-mr4qd\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:09:29.963952 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.963725    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca57750a-df1f-4f35-9962-922aab92e00a-istio-csr-ca-configmap\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:09:29.963952 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.963734    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-istio-csr-dns-cert\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:09:29.963952 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.963742    2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca57750a-df1f-4f35-9962-922aab92e00a-cacerts\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:09:29.963952 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:29.963754    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca57750a-df1f-4f35-9962-922aab92e00a-istio-token\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:09:30.304440 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.304406    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 15:09:30.304520 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.304496    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 15:09:30.304555 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.304526    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 15:09:30.705347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.705266    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"
Jul 07 15:09:30.705522 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.705263    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq" event={"ID":"ca57750a-df1f-4f35-9962-922aab92e00a","Type":"ContainerDied","Data":"ea0c24133dae1f0368e73214483c7eca537e6a536f2f683354115d68c82a979d"}
Jul 07 15:09:30.705522 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.705402    2574 scope.go:117] "RemoveContainer" containerID="0eec7c094ab7976174da7b9b8eb255cdbcf4f58bc1e6bd942d64f038dc0bd2e7"
Jul 07 15:09:30.707129 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.707101    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw" event={"ID":"5fa8449e-d52f-4fa3-a953-7ec7bf5a9276","Type":"ContainerStarted","Data":"92e890c4cf7aa6994db2d0460f4e90dcd80abe68f20aacfb4b60cc5fd82f50ae"}
Jul 07 15:09:30.707256 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.707162    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw"
Jul 07 15:09:30.709000 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.708972    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q" event={"ID":"5ee848ff-e538-4121-bcde-f0a77bc25a0f","Type":"ContainerStarted","Data":"8a9ffe4561096923f3aa74c5284ab5f85352da685ca0696ee25cc1b283404369"}
Jul 07 15:09:30.709167 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.709063    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q"
Jul 07 15:09:30.710979 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.710950    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p" event={"ID":"e4525301-c30d-4c4d-b43f-97885a571e67","Type":"ContainerStarted","Data":"821aaf7d12f8f316ceb7686ed9c296a4c9d1e06253939f6fff7d8864644761b9"}
Jul 07 15:09:30.725877 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.725822    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q" podStartSLOduration=1.210456315 podStartE2EDuration="5.7258063s" totalImagesPullingTime="4.515349985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:09:30.724272184 +0000 UTC m=+530.458158568" watchObservedRunningTime="2026-07-07 15:09:30.7258063 +0000 UTC m=+530.459692685"
Jul 07 15:09:30.742307 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.742251    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw" podStartSLOduration=1.208467092 podStartE2EDuration="5.742233958s" totalImagesPullingTime="4.533766866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:09:30.740863903 +0000 UTC m=+530.474750287" watchObservedRunningTime="2026-07-07 15:09:30.742233958 +0000 UTC m=+530.476120339"
Jul 07 15:09:30.760086 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.760027    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p" podStartSLOduration=1.307045643 podStartE2EDuration="4.75999382s" totalImagesPullingTime="3.452948177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:09:30.758913593 +0000 UTC m=+530.492799978" watchObservedRunningTime="2026-07-07 15:09:30.75999382 +0000 UTC m=+530.493880201"
Jul 07 15:09:30.773206 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.773140    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"]
Jul 07 15:09:30.776744 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.776718    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xm4gq"]
Jul 07 15:09:30.869024 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:30.868965    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca57750a-df1f-4f35-9962-922aab92e00a" path="/var/lib/kubelet/pods/ca57750a-df1f-4f35-9962-922aab92e00a/volumes"
Jul 07 15:09:31.623322 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:31.623284    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:31.628169 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:31.628143    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:31.653801 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:31.653769    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-x5vpc"
Jul 07 15:09:31.655916 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:31.655895    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-9844g"
Jul 07 15:09:31.718466 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:31.718421    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:09:31.719381 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:09:31.719362    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bzw8p"
Jul 07 15:10:01.720092 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:01.720060    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wwrpw"
Jul 07 15:10:01.722913 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:01.722890    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nrp9q"
Jul 07 15:10:15.536100 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.536068    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d9bcs"]
Jul 07 15:10:15.536492 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.536372    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca57750a-df1f-4f35-9962-922aab92e00a" containerName="discovery"
Jul 07 15:10:15.536492 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.536385    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca57750a-df1f-4f35-9962-922aab92e00a" containerName="discovery"
Jul 07 15:10:15.536492 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.536450    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca57750a-df1f-4f35-9962-922aab92e00a" containerName="discovery"
Jul 07 15:10:15.538764 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.538741    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d9bcs"
Jul 07 15:10:15.541663 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.541639    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 15:10:15.542185 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.542166    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gjlsg\""
Jul 07 15:10:15.542185 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.542179    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 15:10:15.547081 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.547052    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d9bcs"]
Jul 07 15:10:15.616442 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.616409    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psrht\" (UniqueName: \"kubernetes.io/projected/a751f104-0a72-4659-a1ad-0a9a7ccc55c1-kube-api-access-psrht\") pod \"kuadrant-operator-catalog-d9bcs\" (UID: \"a751f104-0a72-4659-a1ad-0a9a7ccc55c1\") " pod="kuadrant-system/kuadrant-operator-catalog-d9bcs"
Jul 07 15:10:15.716964 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.716923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psrht\" (UniqueName: \"kubernetes.io/projected/a751f104-0a72-4659-a1ad-0a9a7ccc55c1-kube-api-access-psrht\") pod \"kuadrant-operator-catalog-d9bcs\" (UID: \"a751f104-0a72-4659-a1ad-0a9a7ccc55c1\") " pod="kuadrant-system/kuadrant-operator-catalog-d9bcs"
Jul 07 15:10:15.725481 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.725442    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psrht\" (UniqueName: \"kubernetes.io/projected/a751f104-0a72-4659-a1ad-0a9a7ccc55c1-kube-api-access-psrht\") pod \"kuadrant-operator-catalog-d9bcs\" (UID: \"a751f104-0a72-4659-a1ad-0a9a7ccc55c1\") " pod="kuadrant-system/kuadrant-operator-catalog-d9bcs"
Jul 07 15:10:15.851348 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.851254    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d9bcs"
Jul 07 15:10:15.876890 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.876848    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d9bcs"]
Jul 07 15:10:15.983569 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:15.983463    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d9bcs"]
Jul 07 15:10:15.986454 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:10:15.986424    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda751f104_0a72_4659_a1ad_0a9a7ccc55c1.slice/crio-0ee0250816dc0f42a8caace3358fa9fed9e3dee021400b897e071676cb2e472a WatchSource:0}: Error finding container 0ee0250816dc0f42a8caace3358fa9fed9e3dee021400b897e071676cb2e472a: Status 404 returned error can't find the container with id 0ee0250816dc0f42a8caace3358fa9fed9e3dee021400b897e071676cb2e472a
Jul 07 15:10:16.086518 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:16.086483    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4fmb7"]
Jul 07 15:10:16.090387 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:16.090370    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4fmb7"
Jul 07 15:10:16.098548 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:16.098524    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4fmb7"]
Jul 07 15:10:16.121066 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:16.120956    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l98ml\" (UniqueName: \"kubernetes.io/projected/2f993ec0-3651-42ef-8053-22badee4c172-kube-api-access-l98ml\") pod \"kuadrant-operator-catalog-4fmb7\" (UID: \"2f993ec0-3651-42ef-8053-22badee4c172\") " pod="kuadrant-system/kuadrant-operator-catalog-4fmb7"
Jul 07 15:10:16.222360 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:16.222319    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l98ml\" (UniqueName: \"kubernetes.io/projected/2f993ec0-3651-42ef-8053-22badee4c172-kube-api-access-l98ml\") pod \"kuadrant-operator-catalog-4fmb7\" (UID: \"2f993ec0-3651-42ef-8053-22badee4c172\") " pod="kuadrant-system/kuadrant-operator-catalog-4fmb7"
Jul 07 15:10:16.230245 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:16.230212    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l98ml\" (UniqueName: \"kubernetes.io/projected/2f993ec0-3651-42ef-8053-22badee4c172-kube-api-access-l98ml\") pod \"kuadrant-operator-catalog-4fmb7\" (UID: \"2f993ec0-3651-42ef-8053-22badee4c172\") " pod="kuadrant-system/kuadrant-operator-catalog-4fmb7"
Jul 07 15:10:16.399725 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:16.399622    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4fmb7"
Jul 07 15:10:16.528588 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:16.528557    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4fmb7"]
Jul 07 15:10:16.531704 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:10:16.531676    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f993ec0_3651_42ef_8053_22badee4c172.slice/crio-4a6be3d51d484006bbe3094ef51539db2ac43001610f8150b2b95279f1ec3fd6 WatchSource:0}: Error finding container 4a6be3d51d484006bbe3094ef51539db2ac43001610f8150b2b95279f1ec3fd6: Status 404 returned error can't find the container with id 4a6be3d51d484006bbe3094ef51539db2ac43001610f8150b2b95279f1ec3fd6
Jul 07 15:10:16.900417 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:16.900384    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d9bcs" event={"ID":"a751f104-0a72-4659-a1ad-0a9a7ccc55c1","Type":"ContainerStarted","Data":"0ee0250816dc0f42a8caace3358fa9fed9e3dee021400b897e071676cb2e472a"}
Jul 07 15:10:16.901558 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:16.901527    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4fmb7" event={"ID":"2f993ec0-3651-42ef-8053-22badee4c172","Type":"ContainerStarted","Data":"4a6be3d51d484006bbe3094ef51539db2ac43001610f8150b2b95279f1ec3fd6"}
Jul 07 15:10:18.913451 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:18.913406    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d9bcs" event={"ID":"a751f104-0a72-4659-a1ad-0a9a7ccc55c1","Type":"ContainerStarted","Data":"8c512ea51291a66716e7056f9b61580b1e9b53f423e4646bcfc208ac6d678c42"}
Jul 07 15:10:18.913451 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:18.913442    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-d9bcs" podUID="a751f104-0a72-4659-a1ad-0a9a7ccc55c1" containerName="registry-server" containerID="cri-o://8c512ea51291a66716e7056f9b61580b1e9b53f423e4646bcfc208ac6d678c42" gracePeriod=2
Jul 07 15:10:18.914970 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:18.914943    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4fmb7" event={"ID":"2f993ec0-3651-42ef-8053-22badee4c172","Type":"ContainerStarted","Data":"696669df41b85e541104a97635100c0b24efac0574e6f79c89e4f6b428c76c03"}
Jul 07 15:10:18.928789 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:18.928741    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-d9bcs" podStartSLOduration=1.792313628 podStartE2EDuration="3.928723792s" totalImagesPullingTime="2.136410164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:10:18.92717522 +0000 UTC m=+578.661061603" watchObservedRunningTime="2026-07-07 15:10:18.928723792 +0000 UTC m=+578.662610174"
Jul 07 15:10:18.942061 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:18.941984    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4fmb7" podStartSLOduration=1.350157474 podStartE2EDuration="2.941965241s" totalImagesPullingTime="1.591807767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:10:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:10:18.940814921 +0000 UTC m=+578.674701304" watchObservedRunningTime="2026-07-07 15:10:18.941965241 +0000 UTC m=+578.675851622"
Jul 07 15:10:19.154576 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:19.154548    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d9bcs"
Jul 07 15:10:19.249347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:19.249240    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psrht\" (UniqueName: \"kubernetes.io/projected/a751f104-0a72-4659-a1ad-0a9a7ccc55c1-kube-api-access-psrht\") pod \"a751f104-0a72-4659-a1ad-0a9a7ccc55c1\" (UID: \"a751f104-0a72-4659-a1ad-0a9a7ccc55c1\") "
Jul 07 15:10:19.251476 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:19.251445    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a751f104-0a72-4659-a1ad-0a9a7ccc55c1-kube-api-access-psrht" (OuterVolumeSpecName: "kube-api-access-psrht") pod "a751f104-0a72-4659-a1ad-0a9a7ccc55c1" (UID: "a751f104-0a72-4659-a1ad-0a9a7ccc55c1"). InnerVolumeSpecName "kube-api-access-psrht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:10:19.350657 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:19.350611    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psrht\" (UniqueName: \"kubernetes.io/projected/a751f104-0a72-4659-a1ad-0a9a7ccc55c1-kube-api-access-psrht\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:10:19.920755 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:19.920716    2574 generic.go:356] "Generic (PLEG): container finished" podID="a751f104-0a72-4659-a1ad-0a9a7ccc55c1" containerID="8c512ea51291a66716e7056f9b61580b1e9b53f423e4646bcfc208ac6d678c42" exitCode=0
Jul 07 15:10:19.921189 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:19.920763    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d9bcs"
Jul 07 15:10:19.921189 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:19.920806    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d9bcs" event={"ID":"a751f104-0a72-4659-a1ad-0a9a7ccc55c1","Type":"ContainerDied","Data":"8c512ea51291a66716e7056f9b61580b1e9b53f423e4646bcfc208ac6d678c42"}
Jul 07 15:10:19.921189 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:19.920857    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d9bcs" event={"ID":"a751f104-0a72-4659-a1ad-0a9a7ccc55c1","Type":"ContainerDied","Data":"0ee0250816dc0f42a8caace3358fa9fed9e3dee021400b897e071676cb2e472a"}
Jul 07 15:10:19.921189 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:19.920882    2574 scope.go:117] "RemoveContainer" containerID="8c512ea51291a66716e7056f9b61580b1e9b53f423e4646bcfc208ac6d678c42"
Jul 07 15:10:19.931331 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:19.931289    2574 scope.go:117] "RemoveContainer" containerID="8c512ea51291a66716e7056f9b61580b1e9b53f423e4646bcfc208ac6d678c42"
Jul 07 15:10:19.931776 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:10:19.931747    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c512ea51291a66716e7056f9b61580b1e9b53f423e4646bcfc208ac6d678c42\": container with ID starting with 8c512ea51291a66716e7056f9b61580b1e9b53f423e4646bcfc208ac6d678c42 not found: ID does not exist" containerID="8c512ea51291a66716e7056f9b61580b1e9b53f423e4646bcfc208ac6d678c42"
Jul 07 15:10:19.931873 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:19.931789    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c512ea51291a66716e7056f9b61580b1e9b53f423e4646bcfc208ac6d678c42"} err="failed to get container status \"8c512ea51291a66716e7056f9b61580b1e9b53f423e4646bcfc208ac6d678c42\": rpc error: code = NotFound desc = could not find container \"8c512ea51291a66716e7056f9b61580b1e9b53f423e4646bcfc208ac6d678c42\": container with ID starting with 8c512ea51291a66716e7056f9b61580b1e9b53f423e4646bcfc208ac6d678c42 not found: ID does not exist"
Jul 07 15:10:19.940657 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:19.940625    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d9bcs"]
Jul 07 15:10:19.945962 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:19.945937    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d9bcs"]
Jul 07 15:10:20.866940 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:20.866900    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a751f104-0a72-4659-a1ad-0a9a7ccc55c1" path="/var/lib/kubelet/pods/a751f104-0a72-4659-a1ad-0a9a7ccc55c1/volumes"
Jul 07 15:10:26.400235 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:26.400200    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4fmb7"
Jul 07 15:10:26.400663 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:26.400260    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4fmb7"
Jul 07 15:10:26.422931 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:26.422897    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4fmb7"
Jul 07 15:10:26.971846 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:26.971820    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4fmb7"
Jul 07 15:10:40.692980 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:40.692948    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:10:40.693901 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:40.693878    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:10:46.893540 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:46.893501    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4d6r4"]
Jul 07 15:10:46.896248 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:46.893793    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a751f104-0a72-4659-a1ad-0a9a7ccc55c1" containerName="registry-server"
Jul 07 15:10:46.896248 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:46.893803    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a751f104-0a72-4659-a1ad-0a9a7ccc55c1" containerName="registry-server"
Jul 07 15:10:46.896248 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:46.893861    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a751f104-0a72-4659-a1ad-0a9a7ccc55c1" containerName="registry-server"
Jul 07 15:10:46.897090 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:46.897071    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4d6r4"
Jul 07 15:10:46.901381 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:46.901360    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 15:10:46.901500 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:46.901439    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tb4c4\""
Jul 07 15:10:46.924302 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:46.924270    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4d6r4"]
Jul 07 15:10:46.987189 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:46.987115    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqpqn\" (UniqueName: \"kubernetes.io/projected/2c7c8521-5d2a-46d6-b8a4-8d94d8fdd9d0-kube-api-access-mqpqn\") pod \"dns-operator-controller-manager-864dd78c4c-4d6r4\" (UID: \"2c7c8521-5d2a-46d6-b8a4-8d94d8fdd9d0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4d6r4"
Jul 07 15:10:47.088473 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:47.088432    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqpqn\" (UniqueName: \"kubernetes.io/projected/2c7c8521-5d2a-46d6-b8a4-8d94d8fdd9d0-kube-api-access-mqpqn\") pod \"dns-operator-controller-manager-864dd78c4c-4d6r4\" (UID: \"2c7c8521-5d2a-46d6-b8a4-8d94d8fdd9d0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4d6r4"
Jul 07 15:10:47.099524 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:47.099492    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqpqn\" (UniqueName: \"kubernetes.io/projected/2c7c8521-5d2a-46d6-b8a4-8d94d8fdd9d0-kube-api-access-mqpqn\") pod \"dns-operator-controller-manager-864dd78c4c-4d6r4\" (UID: \"2c7c8521-5d2a-46d6-b8a4-8d94d8fdd9d0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4d6r4"
Jul 07 15:10:47.206941 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:47.206851    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4d6r4"
Jul 07 15:10:47.342199 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:47.342121    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4d6r4"]
Jul 07 15:10:47.346609 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:10:47.346581    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c7c8521_5d2a_46d6_b8a4_8d94d8fdd9d0.slice/crio-24dfd1260fd0c95a018a77c34423a50be89dbde978e7ed924004482c48b6669c WatchSource:0}: Error finding container 24dfd1260fd0c95a018a77c34423a50be89dbde978e7ed924004482c48b6669c: Status 404 returned error can't find the container with id 24dfd1260fd0c95a018a77c34423a50be89dbde978e7ed924004482c48b6669c
Jul 07 15:10:48.041423 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:48.041388    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4d6r4" event={"ID":"2c7c8521-5d2a-46d6-b8a4-8d94d8fdd9d0","Type":"ContainerStarted","Data":"24dfd1260fd0c95a018a77c34423a50be89dbde978e7ed924004482c48b6669c"}
Jul 07 15:10:50.051630 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:50.051590    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4d6r4" event={"ID":"2c7c8521-5d2a-46d6-b8a4-8d94d8fdd9d0","Type":"ContainerStarted","Data":"913d666c500ddbabdcf65761b8ee2b0adfdfc75f1f995ffb492f091ceb845775"}
Jul 07 15:10:50.052165 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:50.051748    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4d6r4"
Jul 07 15:10:50.067647 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:50.067561    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4d6r4" podStartSLOduration=1.9394031840000001 podStartE2EDuration="4.067541989s" totalImagesPullingTime="2.128138805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:10:50.067230256 +0000 UTC m=+609.801116639" watchObservedRunningTime="2026-07-07 15:10:50.067541989 +0000 UTC m=+609.801428372"
Jul 07 15:10:50.380399 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:50.380317    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"]
Jul 07 15:10:50.383722 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:50.383700    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"
Jul 07 15:10:50.385892 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:50.385861    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5zzdl\""
Jul 07 15:10:50.393898 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:50.393871    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"]
Jul 07 15:10:50.420813 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:50.420778    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfq45\" (UniqueName: \"kubernetes.io/projected/b13632d8-9e24-432c-b5d8-0e373320ce7f-kube-api-access-vfq45\") pod \"limitador-operator-controller-manager-859d7b78bd-x2gmt\" (UID: \"b13632d8-9e24-432c-b5d8-0e373320ce7f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"
Jul 07 15:10:50.521232 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:50.521186    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfq45\" (UniqueName: \"kubernetes.io/projected/b13632d8-9e24-432c-b5d8-0e373320ce7f-kube-api-access-vfq45\") pod \"limitador-operator-controller-manager-859d7b78bd-x2gmt\" (UID: \"b13632d8-9e24-432c-b5d8-0e373320ce7f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"
Jul 07 15:10:50.534789 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:50.534753    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfq45\" (UniqueName: \"kubernetes.io/projected/b13632d8-9e24-432c-b5d8-0e373320ce7f-kube-api-access-vfq45\") pod \"limitador-operator-controller-manager-859d7b78bd-x2gmt\" (UID: \"b13632d8-9e24-432c-b5d8-0e373320ce7f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"
Jul 07 15:10:50.694358 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:50.694270    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"
Jul 07 15:10:50.829503 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:50.829473    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"]
Jul 07 15:10:50.832957 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:10:50.832930    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb13632d8_9e24_432c_b5d8_0e373320ce7f.slice/crio-27500d5009d5e116c395279211be96f177ad48a2b2da2e8d1edf31dabc98f0cb WatchSource:0}: Error finding container 27500d5009d5e116c395279211be96f177ad48a2b2da2e8d1edf31dabc98f0cb: Status 404 returned error can't find the container with id 27500d5009d5e116c395279211be96f177ad48a2b2da2e8d1edf31dabc98f0cb
Jul 07 15:10:51.057354 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:51.057313    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt" event={"ID":"b13632d8-9e24-432c-b5d8-0e373320ce7f","Type":"ContainerStarted","Data":"27500d5009d5e116c395279211be96f177ad48a2b2da2e8d1edf31dabc98f0cb"}
Jul 07 15:10:53.067333 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:53.067296    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt" event={"ID":"b13632d8-9e24-432c-b5d8-0e373320ce7f","Type":"ContainerStarted","Data":"e8dd02afa53b643013cd76a2ea3015f485daf2fa470c7f1710ccb3102621fd83"}
Jul 07 15:10:53.067812 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:53.067405    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"
Jul 07 15:10:53.083658 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:53.083608    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt" podStartSLOduration=1.175341622 podStartE2EDuration="3.083590297s" totalImagesPullingTime="1.908248675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:10:53.082998029 +0000 UTC m=+612.816884411" watchObservedRunningTime="2026-07-07 15:10:53.083590297 +0000 UTC m=+612.817476678"
Jul 07 15:10:54.267556 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:54.267519    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-twsng"]
Jul 07 15:10:54.271087 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:54.271065    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-twsng"
Jul 07 15:10:54.274776 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:54.274754    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bqdmg\""
Jul 07 15:10:54.281278 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:54.281250    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-twsng"]
Jul 07 15:10:54.351377 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:54.351334    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm6dk\" (UniqueName: \"kubernetes.io/projected/6ba1eec0-5477-44eb-9bb6-2a3a6c1fad0d-kube-api-access-fm6dk\") pod \"authorino-operator-75cc8d5cb7-twsng\" (UID: \"6ba1eec0-5477-44eb-9bb6-2a3a6c1fad0d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-twsng"
Jul 07 15:10:54.452662 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:54.452623    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm6dk\" (UniqueName: \"kubernetes.io/projected/6ba1eec0-5477-44eb-9bb6-2a3a6c1fad0d-kube-api-access-fm6dk\") pod \"authorino-operator-75cc8d5cb7-twsng\" (UID: \"6ba1eec0-5477-44eb-9bb6-2a3a6c1fad0d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-twsng"
Jul 07 15:10:54.465452 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:54.465415    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm6dk\" (UniqueName: \"kubernetes.io/projected/6ba1eec0-5477-44eb-9bb6-2a3a6c1fad0d-kube-api-access-fm6dk\") pod \"authorino-operator-75cc8d5cb7-twsng\" (UID: \"6ba1eec0-5477-44eb-9bb6-2a3a6c1fad0d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-twsng"
Jul 07 15:10:54.582722 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:54.582684    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-twsng"
Jul 07 15:10:54.715557 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:54.715522    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-twsng"]
Jul 07 15:10:54.718464 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:10:54.718429    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba1eec0_5477_44eb_9bb6_2a3a6c1fad0d.slice/crio-2200ceb34891c9b56cb67c63b70e297fbf93128093a9306cf5aa5fc437ef4efe WatchSource:0}: Error finding container 2200ceb34891c9b56cb67c63b70e297fbf93128093a9306cf5aa5fc437ef4efe: Status 404 returned error can't find the container with id 2200ceb34891c9b56cb67c63b70e297fbf93128093a9306cf5aa5fc437ef4efe
Jul 07 15:10:55.077145 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:55.077111    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-twsng" event={"ID":"6ba1eec0-5477-44eb-9bb6-2a3a6c1fad0d","Type":"ContainerStarted","Data":"2200ceb34891c9b56cb67c63b70e297fbf93128093a9306cf5aa5fc437ef4efe"}
Jul 07 15:10:58.091313 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:58.091277    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-twsng" event={"ID":"6ba1eec0-5477-44eb-9bb6-2a3a6c1fad0d","Type":"ContainerStarted","Data":"574bb307de8a2f97820349b22b18acb77a57e1c36ed89dbd97587e45c1bd18d0"}
Jul 07 15:10:58.091807 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:58.091391    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-twsng"
Jul 07 15:10:58.107695 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:58.107646    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-twsng" podStartSLOduration=1.389809775 podStartE2EDuration="4.107630774s" totalImagesPullingTime="2.717820999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:10:58.106485651 +0000 UTC m=+617.840372035" watchObservedRunningTime="2026-07-07 15:10:58.107630774 +0000 UTC m=+617.841517147"
Jul 07 15:10:59.102466 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:59.102432    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"]
Jul 07 15:10:59.106030 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:59.105996    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:10:59.108261 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:59.108236    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zwpmq\""
Jul 07 15:10:59.119576 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:59.119547    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"]
Jul 07 15:10:59.195559 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:59.195506    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brcpm\" (UniqueName: \"kubernetes.io/projected/f920e3d6-e7ce-4976-915e-15f97bb704ab-kube-api-access-brcpm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dp257\" (UID: \"f920e3d6-e7ce-4976-915e-15f97bb704ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:10:59.195772 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:59.195610    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f920e3d6-e7ce-4976-915e-15f97bb704ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dp257\" (UID: \"f920e3d6-e7ce-4976-915e-15f97bb704ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:10:59.296208 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:59.296158    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brcpm\" (UniqueName: \"kubernetes.io/projected/f920e3d6-e7ce-4976-915e-15f97bb704ab-kube-api-access-brcpm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dp257\" (UID: \"f920e3d6-e7ce-4976-915e-15f97bb704ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:10:59.296397 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:59.296243    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f920e3d6-e7ce-4976-915e-15f97bb704ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dp257\" (UID: \"f920e3d6-e7ce-4976-915e-15f97bb704ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:10:59.296590 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:59.296573    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f920e3d6-e7ce-4976-915e-15f97bb704ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dp257\" (UID: \"f920e3d6-e7ce-4976-915e-15f97bb704ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:10:59.308090 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:59.308059    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brcpm\" (UniqueName: \"kubernetes.io/projected/f920e3d6-e7ce-4976-915e-15f97bb704ab-kube-api-access-brcpm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dp257\" (UID: \"f920e3d6-e7ce-4976-915e-15f97bb704ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:10:59.417149 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:59.417054    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:10:59.549937 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:10:59.549913    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"]
Jul 07 15:10:59.552581 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:10:59.552546    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf920e3d6_e7ce_4976_915e_15f97bb704ab.slice/crio-f063ad4501a787646a96c40a27d6fa499f66cf2e1d78371439f246f0c4a63c17 WatchSource:0}: Error finding container f063ad4501a787646a96c40a27d6fa499f66cf2e1d78371439f246f0c4a63c17: Status 404 returned error can't find the container with id f063ad4501a787646a96c40a27d6fa499f66cf2e1d78371439f246f0c4a63c17
Jul 07 15:11:00.102027 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:00.101977    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257" event={"ID":"f920e3d6-e7ce-4976-915e-15f97bb704ab","Type":"ContainerStarted","Data":"f063ad4501a787646a96c40a27d6fa499f66cf2e1d78371439f246f0c4a63c17"}
Jul 07 15:11:01.059782 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:01.059746    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4d6r4"
Jul 07 15:11:04.075050 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:04.074943    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"
Jul 07 15:11:09.098687 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:09.098650    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-twsng"
Jul 07 15:11:09.146375 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:09.146334    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257" event={"ID":"f920e3d6-e7ce-4976-915e-15f97bb704ab","Type":"ContainerStarted","Data":"e74d32aad0c4e06cfe83a2f1d6fd427bc0e7e08c7b69c8dfe2df6bcbda649dd4"}
Jul 07 15:11:09.146572 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:09.146501    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:11:09.167860 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:09.167812    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257" podStartSLOduration=1.614857472 podStartE2EDuration="10.167795554s" totalImagesPullingTime="8.552938082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:11:09.166774519 +0000 UTC m=+628.900660914" watchObservedRunningTime="2026-07-07 15:11:09.167795554 +0000 UTC m=+628.901681936"
Jul 07 15:11:20.153904 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:20.153866    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:11:21.363078 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:21.363041    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"]
Jul 07 15:11:21.367538 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:21.367517    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:21.376124 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:21.376093    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"]
Jul 07 15:11:21.493153 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:21.493110    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98t2n\" (UniqueName: \"kubernetes.io/projected/f12ab58e-3dff-4087-af9f-ecb7699bf4c8-kube-api-access-98t2n\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6kpzh\" (UID: \"f12ab58e-3dff-4087-af9f-ecb7699bf4c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:21.493331 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:21.493170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f12ab58e-3dff-4087-af9f-ecb7699bf4c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6kpzh\" (UID: \"f12ab58e-3dff-4087-af9f-ecb7699bf4c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:21.594495 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:21.594456    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98t2n\" (UniqueName: \"kubernetes.io/projected/f12ab58e-3dff-4087-af9f-ecb7699bf4c8-kube-api-access-98t2n\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6kpzh\" (UID: \"f12ab58e-3dff-4087-af9f-ecb7699bf4c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:21.594661 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:21.594506    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f12ab58e-3dff-4087-af9f-ecb7699bf4c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6kpzh\" (UID: \"f12ab58e-3dff-4087-af9f-ecb7699bf4c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:21.594903 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:21.594885    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f12ab58e-3dff-4087-af9f-ecb7699bf4c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6kpzh\" (UID: \"f12ab58e-3dff-4087-af9f-ecb7699bf4c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:21.609850 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:21.609820    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98t2n\" (UniqueName: \"kubernetes.io/projected/f12ab58e-3dff-4087-af9f-ecb7699bf4c8-kube-api-access-98t2n\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6kpzh\" (UID: \"f12ab58e-3dff-4087-af9f-ecb7699bf4c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:21.677614 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:21.677519    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:21.838227 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:21.838199    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"]
Jul 07 15:11:21.840275 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:11:21.840247    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf12ab58e_3dff_4087_af9f_ecb7699bf4c8.slice/crio-7b53653fb8037b331780dd467aab716af3cb294e3eb44ce7650dd7403c88c418 WatchSource:0}: Error finding container 7b53653fb8037b331780dd467aab716af3cb294e3eb44ce7650dd7403c88c418: Status 404 returned error can't find the container with id 7b53653fb8037b331780dd467aab716af3cb294e3eb44ce7650dd7403c88c418
Jul 07 15:11:22.121414 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.121380    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"]
Jul 07 15:11:22.130655 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.130622    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"]
Jul 07 15:11:22.149817 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.149659    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"]
Jul 07 15:11:22.150238 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.150213    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f12ab58e-3dff-4087-af9f-ecb7699bf4c8" containerName="manager"
Jul 07 15:11:22.150238 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.150237    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f12ab58e-3dff-4087-af9f-ecb7699bf4c8" containerName="manager"
Jul 07 15:11:22.150427 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.150309    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f12ab58e-3dff-4087-af9f-ecb7699bf4c8" containerName="manager"
Jul 07 15:11:22.153648 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.153623    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"]
Jul 07 15:11:22.153751 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.153732    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"
Jul 07 15:11:22.153850 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.153824    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257" podUID="f920e3d6-e7ce-4976-915e-15f97bb704ab" containerName="manager" containerID="cri-o://e74d32aad0c4e06cfe83a2f1d6fd427bc0e7e08c7b69c8dfe2df6bcbda649dd4" gracePeriod=2
Jul 07 15:11:22.157998 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.157867    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"]
Jul 07 15:11:22.169820 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.169789    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"]
Jul 07 15:11:22.177087 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.177047    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"]
Jul 07 15:11:22.177344 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.177279    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt" podUID="b13632d8-9e24-432c-b5d8-0e373320ce7f" containerName="manager" containerID="cri-o://e8dd02afa53b643013cd76a2ea3015f485daf2fa470c7f1710ccb3102621fd83" gracePeriod=2
Jul 07 15:11:22.181818 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.181786    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"]
Jul 07 15:11:22.182330 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.182286    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f920e3d6-e7ce-4976-915e-15f97bb704ab" containerName="manager"
Jul 07 15:11:22.182429 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.182334    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f920e3d6-e7ce-4976-915e-15f97bb704ab" containerName="manager"
Jul 07 15:11:22.182494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.182438    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f920e3d6-e7ce-4976-915e-15f97bb704ab" containerName="manager"
Jul 07 15:11:22.186194 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.185833    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"]
Jul 07 15:11:22.186194 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.185953    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"
Jul 07 15:11:22.186194 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:22.185996    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dp257\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="f920e3d6-e7ce-4976-915e-15f97bb704ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:11:22.187957 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:22.187927    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-x2gmt\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="b13632d8-9e24-432c-b5d8-0e373320ce7f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"
Jul 07 15:11:22.191681 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:22.191647    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-x2gmt\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="b13632d8-9e24-432c-b5d8-0e373320ce7f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"
Jul 07 15:11:22.208138 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:22.207352    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh" container="manager"
Jul 07 15:11:22.208138 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.208131    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"]
Jul 07 15:11:22.230095 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:22.230057    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dp257\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="f920e3d6-e7ce-4976-915e-15f97bb704ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:11:22.231958 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:22.231925    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6kpzh\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="f12ab58e-3dff-4087-af9f-ecb7699bf4c8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:22.233627 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:22.233592    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-x2gmt\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="b13632d8-9e24-432c-b5d8-0e373320ce7f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"
Jul 07 15:11:22.235431 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:22.235403    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dp257\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="f920e3d6-e7ce-4976-915e-15f97bb704ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:11:22.300787 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.300744    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kv9h\" (UniqueName: \"kubernetes.io/projected/f217ddff-1884-4dc4-8375-f1dfcceb236f-kube-api-access-6kv9h\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gwrqg\" (UID: \"f217ddff-1884-4dc4-8375-f1dfcceb236f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"
Jul 07 15:11:22.300967 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.300858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2zwf\" (UID: \"ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"
Jul 07 15:11:22.300967 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.300908    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f217ddff-1884-4dc4-8375-f1dfcceb236f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gwrqg\" (UID: \"f217ddff-1884-4dc4-8375-f1dfcceb236f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"
Jul 07 15:11:22.301138 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.300989    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pttm\" (UniqueName: \"kubernetes.io/projected/ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20-kube-api-access-2pttm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2zwf\" (UID: \"ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"
Jul 07 15:11:22.401997 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.401918    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2zwf\" (UID: \"ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"
Jul 07 15:11:22.401997 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.401961    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f217ddff-1884-4dc4-8375-f1dfcceb236f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gwrqg\" (UID: \"f217ddff-1884-4dc4-8375-f1dfcceb236f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"
Jul 07 15:11:22.402600 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.401998    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pttm\" (UniqueName: \"kubernetes.io/projected/ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20-kube-api-access-2pttm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2zwf\" (UID: \"ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"
Jul 07 15:11:22.402600 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.402091    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kv9h\" (UniqueName: \"kubernetes.io/projected/f217ddff-1884-4dc4-8375-f1dfcceb236f-kube-api-access-6kv9h\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gwrqg\" (UID: \"f217ddff-1884-4dc4-8375-f1dfcceb236f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"
Jul 07 15:11:22.402600 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.402447    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2zwf\" (UID: \"ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"
Jul 07 15:11:22.402600 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.402465    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f217ddff-1884-4dc4-8375-f1dfcceb236f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gwrqg\" (UID: \"f217ddff-1884-4dc4-8375-f1dfcceb236f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"
Jul 07 15:11:22.410825 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.410801    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:11:22.410991 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.410971    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kv9h\" (UniqueName: \"kubernetes.io/projected/f217ddff-1884-4dc4-8375-f1dfcceb236f-kube-api-access-6kv9h\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gwrqg\" (UID: \"f217ddff-1884-4dc4-8375-f1dfcceb236f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"
Jul 07 15:11:22.411096 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.411079    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pttm\" (UniqueName: \"kubernetes.io/projected/ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20-kube-api-access-2pttm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2zwf\" (UID: \"ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"
Jul 07 15:11:22.412611 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:22.412586    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6kpzh\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="f12ab58e-3dff-4087-af9f-ecb7699bf4c8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:22.414099 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:22.414077    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-x2gmt\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="b13632d8-9e24-432c-b5d8-0e373320ce7f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"
Jul 07 15:11:22.415698 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:22.415671    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dp257\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="f920e3d6-e7ce-4976-915e-15f97bb704ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:11:22.417891 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.417876    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"
Jul 07 15:11:22.419756 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:22.419734    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dp257\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="f920e3d6-e7ce-4976-915e-15f97bb704ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:11:22.421230 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:22.421207    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6kpzh\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="f12ab58e-3dff-4087-af9f-ecb7699bf4c8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:22.422731 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:22.422710    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-x2gmt\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="b13632d8-9e24-432c-b5d8-0e373320ce7f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"
Jul 07 15:11:22.468165 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.468125    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"
Jul 07 15:11:22.503172 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.503136    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brcpm\" (UniqueName: \"kubernetes.io/projected/f920e3d6-e7ce-4976-915e-15f97bb704ab-kube-api-access-brcpm\") pod \"f920e3d6-e7ce-4976-915e-15f97bb704ab\" (UID: \"f920e3d6-e7ce-4976-915e-15f97bb704ab\") "
Jul 07 15:11:22.503334 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.503194    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfq45\" (UniqueName: \"kubernetes.io/projected/b13632d8-9e24-432c-b5d8-0e373320ce7f-kube-api-access-vfq45\") pod \"b13632d8-9e24-432c-b5d8-0e373320ce7f\" (UID: \"b13632d8-9e24-432c-b5d8-0e373320ce7f\") "
Jul 07 15:11:22.503334 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.503234    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f920e3d6-e7ce-4976-915e-15f97bb704ab-extensions-socket-volume\") pod \"f920e3d6-e7ce-4976-915e-15f97bb704ab\" (UID: \"f920e3d6-e7ce-4976-915e-15f97bb704ab\") "
Jul 07 15:11:22.503909 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.503876    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f920e3d6-e7ce-4976-915e-15f97bb704ab-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f920e3d6-e7ce-4976-915e-15f97bb704ab" (UID: "f920e3d6-e7ce-4976-915e-15f97bb704ab"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:11:22.505345 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.505317    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f920e3d6-e7ce-4976-915e-15f97bb704ab-kube-api-access-brcpm" (OuterVolumeSpecName: "kube-api-access-brcpm") pod "f920e3d6-e7ce-4976-915e-15f97bb704ab" (UID: "f920e3d6-e7ce-4976-915e-15f97bb704ab"). InnerVolumeSpecName "kube-api-access-brcpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:11:22.505435 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.505360    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b13632d8-9e24-432c-b5d8-0e373320ce7f-kube-api-access-vfq45" (OuterVolumeSpecName: "kube-api-access-vfq45") pod "b13632d8-9e24-432c-b5d8-0e373320ce7f" (UID: "b13632d8-9e24-432c-b5d8-0e373320ce7f"). InnerVolumeSpecName "kube-api-access-vfq45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:11:22.573318 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.573286    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"
Jul 07 15:11:22.604168 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.604135    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brcpm\" (UniqueName: \"kubernetes.io/projected/f920e3d6-e7ce-4976-915e-15f97bb704ab-kube-api-access-brcpm\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:11:22.604168 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.604167    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfq45\" (UniqueName: \"kubernetes.io/projected/b13632d8-9e24-432c-b5d8-0e373320ce7f-kube-api-access-vfq45\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:11:22.604168 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.604182    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f920e3d6-e7ce-4976-915e-15f97bb704ab-extensions-socket-volume\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:11:22.608612 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.608585    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"]
Jul 07 15:11:22.611111 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:11:22.611082    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf217ddff_1884_4dc4_8375_f1dfcceb236f.slice/crio-f49297a4534d3b49c6d96801983121741dba1f0edb78c18ebc42b3a3f286bf7a WatchSource:0}: Error finding container f49297a4534d3b49c6d96801983121741dba1f0edb78c18ebc42b3a3f286bf7a: Status 404 returned error can't find the container with id f49297a4534d3b49c6d96801983121741dba1f0edb78c18ebc42b3a3f286bf7a
Jul 07 15:11:22.729078 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.729052    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"]
Jul 07 15:11:22.732211 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:11:22.732182    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede8ecfb_7ce5_4a36_b9f4_dc8c76addc20.slice/crio-5af7d546320c5422ee187e39de5fa24980050aa6efdc8d5ed6d7d87f712e52ee WatchSource:0}: Error finding container 5af7d546320c5422ee187e39de5fa24980050aa6efdc8d5ed6d7d87f712e52ee: Status 404 returned error can't find the container with id 5af7d546320c5422ee187e39de5fa24980050aa6efdc8d5ed6d7d87f712e52ee
Jul 07 15:11:22.873326 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.873286    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b13632d8-9e24-432c-b5d8-0e373320ce7f" path="/var/lib/kubelet/pods/b13632d8-9e24-432c-b5d8-0e373320ce7f/volumes"
Jul 07 15:11:22.873641 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:22.873625    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f920e3d6-e7ce-4976-915e-15f97bb704ab" path="/var/lib/kubelet/pods/f920e3d6-e7ce-4976-915e-15f97bb704ab/volumes"
Jul 07 15:11:23.213757 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.213717    2574 generic.go:356] "Generic (PLEG): container finished" podID="b13632d8-9e24-432c-b5d8-0e373320ce7f" containerID="e8dd02afa53b643013cd76a2ea3015f485daf2fa470c7f1710ccb3102621fd83" exitCode=0
Jul 07 15:11:23.213945 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.213781    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2gmt"
Jul 07 15:11:23.213945 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.213816    2574 scope.go:117] "RemoveContainer" containerID="e8dd02afa53b643013cd76a2ea3015f485daf2fa470c7f1710ccb3102621fd83"
Jul 07 15:11:23.215305 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.215282    2574 generic.go:356] "Generic (PLEG): container finished" podID="f920e3d6-e7ce-4976-915e-15f97bb704ab" containerID="e74d32aad0c4e06cfe83a2f1d6fd427bc0e7e08c7b69c8dfe2df6bcbda649dd4" exitCode=0
Jul 07 15:11:23.215417 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.215342    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp257"
Jul 07 15:11:23.217380 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.217332    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh" podUID="f12ab58e-3dff-4087-af9f-ecb7699bf4c8" containerName="manager" containerID="cri-o://274068b99c8143f7d775b856d951fcd1250e6fb1e471fbd2e719fbd165cd4582" gracePeriod=2
Jul 07 15:11:23.219505 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.219473    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf" event={"ID":"ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20","Type":"ContainerStarted","Data":"c28d9b40408fe7011096344b083a56a2a542189d78d4abe898426e1713db23e1"}
Jul 07 15:11:23.219621 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.219535    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf" event={"ID":"ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20","Type":"ContainerStarted","Data":"5af7d546320c5422ee187e39de5fa24980050aa6efdc8d5ed6d7d87f712e52ee"}
Jul 07 15:11:23.219621 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.219566    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"
Jul 07 15:11:23.221360 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.221338    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg" event={"ID":"f217ddff-1884-4dc4-8375-f1dfcceb236f","Type":"ContainerStarted","Data":"ee1d0cf3c08685d933ab69df7f9be56172a1e16ccfa932fce260a0f47b7d7be0"}
Jul 07 15:11:23.221469 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.221383    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg" event={"ID":"f217ddff-1884-4dc4-8375-f1dfcceb236f","Type":"ContainerStarted","Data":"f49297a4534d3b49c6d96801983121741dba1f0edb78c18ebc42b3a3f286bf7a"}
Jul 07 15:11:23.221469 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.221422    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"
Jul 07 15:11:23.224329 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.224311    2574 scope.go:117] "RemoveContainer" containerID="e8dd02afa53b643013cd76a2ea3015f485daf2fa470c7f1710ccb3102621fd83"
Jul 07 15:11:23.224632 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:23.224601    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8dd02afa53b643013cd76a2ea3015f485daf2fa470c7f1710ccb3102621fd83\": container with ID starting with e8dd02afa53b643013cd76a2ea3015f485daf2fa470c7f1710ccb3102621fd83 not found: ID does not exist" containerID="e8dd02afa53b643013cd76a2ea3015f485daf2fa470c7f1710ccb3102621fd83"
Jul 07 15:11:23.224731 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.224644    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8dd02afa53b643013cd76a2ea3015f485daf2fa470c7f1710ccb3102621fd83"} err="failed to get container status \"e8dd02afa53b643013cd76a2ea3015f485daf2fa470c7f1710ccb3102621fd83\": rpc error: code = NotFound desc = could not find container \"e8dd02afa53b643013cd76a2ea3015f485daf2fa470c7f1710ccb3102621fd83\": container with ID starting with e8dd02afa53b643013cd76a2ea3015f485daf2fa470c7f1710ccb3102621fd83 not found: ID does not exist"
Jul 07 15:11:23.224731 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.224670    2574 scope.go:117] "RemoveContainer" containerID="e74d32aad0c4e06cfe83a2f1d6fd427bc0e7e08c7b69c8dfe2df6bcbda649dd4"
Jul 07 15:11:23.233346 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.233326    2574 scope.go:117] "RemoveContainer" containerID="e74d32aad0c4e06cfe83a2f1d6fd427bc0e7e08c7b69c8dfe2df6bcbda649dd4"
Jul 07 15:11:23.233699 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:23.233678    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e74d32aad0c4e06cfe83a2f1d6fd427bc0e7e08c7b69c8dfe2df6bcbda649dd4\": container with ID starting with e74d32aad0c4e06cfe83a2f1d6fd427bc0e7e08c7b69c8dfe2df6bcbda649dd4 not found: ID does not exist" containerID="e74d32aad0c4e06cfe83a2f1d6fd427bc0e7e08c7b69c8dfe2df6bcbda649dd4"
Jul 07 15:11:23.233742 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.233708    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e74d32aad0c4e06cfe83a2f1d6fd427bc0e7e08c7b69c8dfe2df6bcbda649dd4"} err="failed to get container status \"e74d32aad0c4e06cfe83a2f1d6fd427bc0e7e08c7b69c8dfe2df6bcbda649dd4\": rpc error: code = NotFound desc = could not find container \"e74d32aad0c4e06cfe83a2f1d6fd427bc0e7e08c7b69c8dfe2df6bcbda649dd4\": container with ID starting with e74d32aad0c4e06cfe83a2f1d6fd427bc0e7e08c7b69c8dfe2df6bcbda649dd4 not found: ID does not exist"
Jul 07 15:11:23.245397 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.245343    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf" podStartSLOduration=1.24532584 podStartE2EDuration="1.24532584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:11:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:11:23.243898541 +0000 UTC m=+642.977784922" watchObservedRunningTime="2026-07-07 15:11:23.24532584 +0000 UTC m=+642.979212222"
Jul 07 15:11:23.263417 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.263366    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg" podStartSLOduration=1.26334856 podStartE2EDuration="1.26334856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:11:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:11:23.262400403 +0000 UTC m=+642.996286785" watchObservedRunningTime="2026-07-07 15:11:23.26334856 +0000 UTC m=+642.997234944"
Jul 07 15:11:23.458380 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.458354    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:23.460252 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:23.460219    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6kpzh\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="f12ab58e-3dff-4087-af9f-ecb7699bf4c8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:23.612132 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.612099    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f12ab58e-3dff-4087-af9f-ecb7699bf4c8-extensions-socket-volume\") pod \"f12ab58e-3dff-4087-af9f-ecb7699bf4c8\" (UID: \"f12ab58e-3dff-4087-af9f-ecb7699bf4c8\") "
Jul 07 15:11:23.612321 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.612187    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98t2n\" (UniqueName: \"kubernetes.io/projected/f12ab58e-3dff-4087-af9f-ecb7699bf4c8-kube-api-access-98t2n\") pod \"f12ab58e-3dff-4087-af9f-ecb7699bf4c8\" (UID: \"f12ab58e-3dff-4087-af9f-ecb7699bf4c8\") "
Jul 07 15:11:23.612522 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.612499    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f12ab58e-3dff-4087-af9f-ecb7699bf4c8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f12ab58e-3dff-4087-af9f-ecb7699bf4c8" (UID: "f12ab58e-3dff-4087-af9f-ecb7699bf4c8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:11:23.614184 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.614160    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f12ab58e-3dff-4087-af9f-ecb7699bf4c8-kube-api-access-98t2n" (OuterVolumeSpecName: "kube-api-access-98t2n") pod "f12ab58e-3dff-4087-af9f-ecb7699bf4c8" (UID: "f12ab58e-3dff-4087-af9f-ecb7699bf4c8"). InnerVolumeSpecName "kube-api-access-98t2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:11:23.712908 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.712861    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98t2n\" (UniqueName: \"kubernetes.io/projected/f12ab58e-3dff-4087-af9f-ecb7699bf4c8-kube-api-access-98t2n\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:11:23.712908 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:23.712897    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f12ab58e-3dff-4087-af9f-ecb7699bf4c8-extensions-socket-volume\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:11:24.229649 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:24.229612    2574 generic.go:356] "Generic (PLEG): container finished" podID="f12ab58e-3dff-4087-af9f-ecb7699bf4c8" containerID="274068b99c8143f7d775b856d951fcd1250e6fb1e471fbd2e719fbd165cd4582" exitCode=0
Jul 07 15:11:24.229831 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:24.229659    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:24.229831 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:24.229710    2574 scope.go:117] "RemoveContainer" containerID="274068b99c8143f7d775b856d951fcd1250e6fb1e471fbd2e719fbd165cd4582"
Jul 07 15:11:24.231950 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:24.231920    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6kpzh\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="f12ab58e-3dff-4087-af9f-ecb7699bf4c8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:24.238219 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:24.238202    2574 scope.go:117] "RemoveContainer" containerID="274068b99c8143f7d775b856d951fcd1250e6fb1e471fbd2e719fbd165cd4582"
Jul 07 15:11:24.238533 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:24.238515    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"274068b99c8143f7d775b856d951fcd1250e6fb1e471fbd2e719fbd165cd4582\": container with ID starting with 274068b99c8143f7d775b856d951fcd1250e6fb1e471fbd2e719fbd165cd4582 not found: ID does not exist" containerID="274068b99c8143f7d775b856d951fcd1250e6fb1e471fbd2e719fbd165cd4582"
Jul 07 15:11:24.238575 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:24.238542    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"274068b99c8143f7d775b856d951fcd1250e6fb1e471fbd2e719fbd165cd4582"} err="failed to get container status \"274068b99c8143f7d775b856d951fcd1250e6fb1e471fbd2e719fbd165cd4582\": rpc error: code = NotFound desc = could not find container \"274068b99c8143f7d775b856d951fcd1250e6fb1e471fbd2e719fbd165cd4582\": container with ID starting with 274068b99c8143f7d775b856d951fcd1250e6fb1e471fbd2e719fbd165cd4582 not found: ID does not exist"
Jul 07 15:11:24.239792 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:24.239770    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6kpzh\" is forbidden: User \"system:node:ip-10-0-132-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-187.ec2.internal' and this object" podUID="f12ab58e-3dff-4087-af9f-ecb7699bf4c8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6kpzh"
Jul 07 15:11:24.866575 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:24.866544    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f12ab58e-3dff-4087-af9f-ecb7699bf4c8" path="/var/lib/kubelet/pods/f12ab58e-3dff-4087-af9f-ecb7699bf4c8/volumes"
Jul 07 15:11:34.232070 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.232038    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"
Jul 07 15:11:34.232650 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.232209    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"
Jul 07 15:11:34.304862 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.304827    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"]
Jul 07 15:11:34.305092 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.305066    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf" podUID="ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20" containerName="manager" containerID="cri-o://c28d9b40408fe7011096344b083a56a2a542189d78d4abe898426e1713db23e1" gracePeriod=10
Jul 07 15:11:34.563324 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.563299    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"
Jul 07 15:11:34.577365 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.577335    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"]
Jul 07 15:11:34.577634 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.577622    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b13632d8-9e24-432c-b5d8-0e373320ce7f" containerName="manager"
Jul 07 15:11:34.577675 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.577635    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b13632d8-9e24-432c-b5d8-0e373320ce7f" containerName="manager"
Jul 07 15:11:34.577675 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.577657    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20" containerName="manager"
Jul 07 15:11:34.577675 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.577662    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20" containerName="manager"
Jul 07 15:11:34.577766 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.577712    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20" containerName="manager"
Jul 07 15:11:34.577766 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.577721    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b13632d8-9e24-432c-b5d8-0e373320ce7f" containerName="manager"
Jul 07 15:11:34.580567 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.580543    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"
Jul 07 15:11:34.595379 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.595350    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"]
Jul 07 15:11:34.707211 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.707180    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pttm\" (UniqueName: \"kubernetes.io/projected/ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20-kube-api-access-2pttm\") pod \"ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20\" (UID: \"ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20\") "
Jul 07 15:11:34.707396 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.707234    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20-extensions-socket-volume\") pod \"ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20\" (UID: \"ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20\") "
Jul 07 15:11:34.707443 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.707398    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc8bc622-63fa-4e07-bed6-17b8a1ede10d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bksbx\" (UID: \"dc8bc622-63fa-4e07-bed6-17b8a1ede10d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"
Jul 07 15:11:34.707443 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.707433    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96nf7\" (UniqueName: \"kubernetes.io/projected/dc8bc622-63fa-4e07-bed6-17b8a1ede10d-kube-api-access-96nf7\") pod \"kuadrant-operator-controller-manager-86878c769f-bksbx\" (UID: \"dc8bc622-63fa-4e07-bed6-17b8a1ede10d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"
Jul 07 15:11:34.707630 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.707604    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20" (UID: "ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:11:34.709400 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.709380    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20-kube-api-access-2pttm" (OuterVolumeSpecName: "kube-api-access-2pttm") pod "ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20" (UID: "ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20"). InnerVolumeSpecName "kube-api-access-2pttm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:11:34.808176 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.808136    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc8bc622-63fa-4e07-bed6-17b8a1ede10d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bksbx\" (UID: \"dc8bc622-63fa-4e07-bed6-17b8a1ede10d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"
Jul 07 15:11:34.808384 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.808187    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96nf7\" (UniqueName: \"kubernetes.io/projected/dc8bc622-63fa-4e07-bed6-17b8a1ede10d-kube-api-access-96nf7\") pod \"kuadrant-operator-controller-manager-86878c769f-bksbx\" (UID: \"dc8bc622-63fa-4e07-bed6-17b8a1ede10d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"
Jul 07 15:11:34.808384 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.808217    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pttm\" (UniqueName: \"kubernetes.io/projected/ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20-kube-api-access-2pttm\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:11:34.808384 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.808227    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20-extensions-socket-volume\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:11:34.808642 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.808620    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc8bc622-63fa-4e07-bed6-17b8a1ede10d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bksbx\" (UID: \"dc8bc622-63fa-4e07-bed6-17b8a1ede10d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"
Jul 07 15:11:34.816456 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.816433    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96nf7\" (UniqueName: \"kubernetes.io/projected/dc8bc622-63fa-4e07-bed6-17b8a1ede10d-kube-api-access-96nf7\") pod \"kuadrant-operator-controller-manager-86878c769f-bksbx\" (UID: \"dc8bc622-63fa-4e07-bed6-17b8a1ede10d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"
Jul 07 15:11:34.891164 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:34.891128    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"
Jul 07 15:11:35.023805 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:35.023781    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"]
Jul 07 15:11:35.026727 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:11:35.026699    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc8bc622_63fa_4e07_bed6_17b8a1ede10d.slice/crio-839e7b16e782f81eabc82c607fba89e12d200ebdd9e317ce24654e16d871327f WatchSource:0}: Error finding container 839e7b16e782f81eabc82c607fba89e12d200ebdd9e317ce24654e16d871327f: Status 404 returned error can't find the container with id 839e7b16e782f81eabc82c607fba89e12d200ebdd9e317ce24654e16d871327f
Jul 07 15:11:35.290491 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:35.290453    2574 generic.go:356] "Generic (PLEG): container finished" podID="ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20" containerID="c28d9b40408fe7011096344b083a56a2a542189d78d4abe898426e1713db23e1" exitCode=0
Jul 07 15:11:35.290957 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:35.290496    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"
Jul 07 15:11:35.290957 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:35.290534    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf" event={"ID":"ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20","Type":"ContainerDied","Data":"c28d9b40408fe7011096344b083a56a2a542189d78d4abe898426e1713db23e1"}
Jul 07 15:11:35.290957 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:35.290580    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf" event={"ID":"ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20","Type":"ContainerDied","Data":"5af7d546320c5422ee187e39de5fa24980050aa6efdc8d5ed6d7d87f712e52ee"}
Jul 07 15:11:35.290957 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:35.290602    2574 scope.go:117] "RemoveContainer" containerID="c28d9b40408fe7011096344b083a56a2a542189d78d4abe898426e1713db23e1"
Jul 07 15:11:35.292384 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:35.292361    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx" event={"ID":"dc8bc622-63fa-4e07-bed6-17b8a1ede10d","Type":"ContainerStarted","Data":"283745779e7e6276cf69b3f5d9e4096b8f7a01875d212f3ddf1ffd80c8f8ab4e"}
Jul 07 15:11:35.292595 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:35.292406    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx" event={"ID":"dc8bc622-63fa-4e07-bed6-17b8a1ede10d","Type":"ContainerStarted","Data":"839e7b16e782f81eabc82c607fba89e12d200ebdd9e317ce24654e16d871327f"}
Jul 07 15:11:35.292595 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:35.292466    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"
Jul 07 15:11:35.299234 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:35.299213    2574 scope.go:117] "RemoveContainer" containerID="c28d9b40408fe7011096344b083a56a2a542189d78d4abe898426e1713db23e1"
Jul 07 15:11:35.299509 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:35.299490    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c28d9b40408fe7011096344b083a56a2a542189d78d4abe898426e1713db23e1\": container with ID starting with c28d9b40408fe7011096344b083a56a2a542189d78d4abe898426e1713db23e1 not found: ID does not exist" containerID="c28d9b40408fe7011096344b083a56a2a542189d78d4abe898426e1713db23e1"
Jul 07 15:11:35.299574 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:35.299516    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c28d9b40408fe7011096344b083a56a2a542189d78d4abe898426e1713db23e1"} err="failed to get container status \"c28d9b40408fe7011096344b083a56a2a542189d78d4abe898426e1713db23e1\": rpc error: code = NotFound desc = could not find container \"c28d9b40408fe7011096344b083a56a2a542189d78d4abe898426e1713db23e1\": container with ID starting with c28d9b40408fe7011096344b083a56a2a542189d78d4abe898426e1713db23e1 not found: ID does not exist"
Jul 07 15:11:35.310486 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:35.310386    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx" podStartSLOduration=1.310370016 podStartE2EDuration="1.310370016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:11:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:11:35.308849443 +0000 UTC m=+655.042735827" watchObservedRunningTime="2026-07-07 15:11:35.310370016 +0000 UTC m=+655.044256399"
Jul 07 15:11:35.326571 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:35.326539    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"]
Jul 07 15:11:35.329883 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:35.329855    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2zwf"]
Jul 07 15:11:36.867329 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:36.867295    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20" path="/var/lib/kubelet/pods/ede8ecfb-7ce5-4a36-b9f4-dc8c76addc20/volumes"
Jul 07 15:11:46.299589 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:46.299556    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"
Jul 07 15:11:46.361624 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:46.361587    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"]
Jul 07 15:11:46.361887 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:46.361860    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg" podUID="f217ddff-1884-4dc4-8375-f1dfcceb236f" containerName="manager" containerID="cri-o://ee1d0cf3c08685d933ab69df7f9be56172a1e16ccfa932fce260a0f47b7d7be0" gracePeriod=10
Jul 07 15:11:46.615777 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:46.615753    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"
Jul 07 15:11:46.706419 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:46.706378    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f217ddff-1884-4dc4-8375-f1dfcceb236f-extensions-socket-volume\") pod \"f217ddff-1884-4dc4-8375-f1dfcceb236f\" (UID: \"f217ddff-1884-4dc4-8375-f1dfcceb236f\") "
Jul 07 15:11:46.706589 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:46.706435    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kv9h\" (UniqueName: \"kubernetes.io/projected/f217ddff-1884-4dc4-8375-f1dfcceb236f-kube-api-access-6kv9h\") pod \"f217ddff-1884-4dc4-8375-f1dfcceb236f\" (UID: \"f217ddff-1884-4dc4-8375-f1dfcceb236f\") "
Jul 07 15:11:46.706776 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:46.706751    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f217ddff-1884-4dc4-8375-f1dfcceb236f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f217ddff-1884-4dc4-8375-f1dfcceb236f" (UID: "f217ddff-1884-4dc4-8375-f1dfcceb236f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:11:46.708495 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:46.708474    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f217ddff-1884-4dc4-8375-f1dfcceb236f-kube-api-access-6kv9h" (OuterVolumeSpecName: "kube-api-access-6kv9h") pod "f217ddff-1884-4dc4-8375-f1dfcceb236f" (UID: "f217ddff-1884-4dc4-8375-f1dfcceb236f"). InnerVolumeSpecName "kube-api-access-6kv9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:11:46.806954 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:46.806913    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f217ddff-1884-4dc4-8375-f1dfcceb236f-extensions-socket-volume\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:11:46.806954 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:46.806947    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kv9h\" (UniqueName: \"kubernetes.io/projected/f217ddff-1884-4dc4-8375-f1dfcceb236f-kube-api-access-6kv9h\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:11:47.346655 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:47.346624    2574 generic.go:356] "Generic (PLEG): container finished" podID="f217ddff-1884-4dc4-8375-f1dfcceb236f" containerID="ee1d0cf3c08685d933ab69df7f9be56172a1e16ccfa932fce260a0f47b7d7be0" exitCode=0
Jul 07 15:11:47.347107 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:47.346673    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"
Jul 07 15:11:47.347107 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:47.346692    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg" event={"ID":"f217ddff-1884-4dc4-8375-f1dfcceb236f","Type":"ContainerDied","Data":"ee1d0cf3c08685d933ab69df7f9be56172a1e16ccfa932fce260a0f47b7d7be0"}
Jul 07 15:11:47.347107 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:47.346735    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg" event={"ID":"f217ddff-1884-4dc4-8375-f1dfcceb236f","Type":"ContainerDied","Data":"f49297a4534d3b49c6d96801983121741dba1f0edb78c18ebc42b3a3f286bf7a"}
Jul 07 15:11:47.347107 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:47.346755    2574 scope.go:117] "RemoveContainer" containerID="ee1d0cf3c08685d933ab69df7f9be56172a1e16ccfa932fce260a0f47b7d7be0"
Jul 07 15:11:47.355380 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:47.355357    2574 scope.go:117] "RemoveContainer" containerID="ee1d0cf3c08685d933ab69df7f9be56172a1e16ccfa932fce260a0f47b7d7be0"
Jul 07 15:11:47.355645 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:11:47.355625    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee1d0cf3c08685d933ab69df7f9be56172a1e16ccfa932fce260a0f47b7d7be0\": container with ID starting with ee1d0cf3c08685d933ab69df7f9be56172a1e16ccfa932fce260a0f47b7d7be0 not found: ID does not exist" containerID="ee1d0cf3c08685d933ab69df7f9be56172a1e16ccfa932fce260a0f47b7d7be0"
Jul 07 15:11:47.355695 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:47.355654    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1d0cf3c08685d933ab69df7f9be56172a1e16ccfa932fce260a0f47b7d7be0"} err="failed to get container status \"ee1d0cf3c08685d933ab69df7f9be56172a1e16ccfa932fce260a0f47b7d7be0\": rpc error: code = NotFound desc = could not find container \"ee1d0cf3c08685d933ab69df7f9be56172a1e16ccfa932fce260a0f47b7d7be0\": container with ID starting with ee1d0cf3c08685d933ab69df7f9be56172a1e16ccfa932fce260a0f47b7d7be0 not found: ID does not exist"
Jul 07 15:11:47.367365 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:47.367341    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"]
Jul 07 15:11:47.376708 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:47.376684    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gwrqg"]
Jul 07 15:11:48.867113 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:48.867080    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f217ddff-1884-4dc4-8375-f1dfcceb236f" path="/var/lib/kubelet/pods/f217ddff-1884-4dc4-8375-f1dfcceb236f/volumes"
Jul 07 15:11:50.768084 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.768050    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"]
Jul 07 15:11:50.768445 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.768366    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f217ddff-1884-4dc4-8375-f1dfcceb236f" containerName="manager"
Jul 07 15:11:50.768445 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.768377    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f217ddff-1884-4dc4-8375-f1dfcceb236f" containerName="manager"
Jul 07 15:11:50.768526 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.768446    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f217ddff-1884-4dc4-8375-f1dfcceb236f" containerName="manager"
Jul 07 15:11:50.771549 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.771530    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.774129 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.774104    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rwnmj\""
Jul 07 15:11:50.788128 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.788095    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"]
Jul 07 15:11:50.839606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.839561    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.839606 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.839604    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.839874 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.839629    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.839874 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.839688    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.839874 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.839735    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.839874 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.839794    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.839874 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.839818    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvvcw\" (UniqueName: \"kubernetes.io/projected/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-kube-api-access-qvvcw\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.839874 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.839837    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.839874 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.839853    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.941157 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.941121    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.941157 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.941164    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.941423 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.941195    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.941423 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.941248    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.941423 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.941283    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvvcw\" (UniqueName: \"kubernetes.io/projected/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-kube-api-access-qvvcw\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.941423 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.941307    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.941423 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.941342    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.941423 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.941403    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.941707 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.941430    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.941707 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.941666    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.941812 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.941735    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.942033 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.941989    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.942033 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.942023    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.942147 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.942034    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.943444 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.943426    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.943683 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.943666    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.952127 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.952096    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvvcw\" (UniqueName: \"kubernetes.io/projected/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-kube-api-access-qvvcw\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:50.952440 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:50.952419    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f31700c-efe1-45d3-86cf-2e57eae0ea2c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dh9t5\" (UID: \"8f31700c-efe1-45d3-86cf-2e57eae0ea2c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:51.081417 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:51.081379    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:51.242561 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:51.242537    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"]
Jul 07 15:11:51.244287 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:11:51.244262    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f31700c_efe1_45d3_86cf_2e57eae0ea2c.slice/crio-4ad88f4a996b0d1dc91af1104229e73ce042705cae41d197c323e488be66e7d0 WatchSource:0}: Error finding container 4ad88f4a996b0d1dc91af1104229e73ce042705cae41d197c323e488be66e7d0: Status 404 returned error can't find the container with id 4ad88f4a996b0d1dc91af1104229e73ce042705cae41d197c323e488be66e7d0
Jul 07 15:11:51.246206 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:51.246168    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 15:11:51.246290 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:51.246236    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 15:11:51.246290 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:51.246271    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 15:11:51.366464 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:51.366358    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5" event={"ID":"8f31700c-efe1-45d3-86cf-2e57eae0ea2c","Type":"ContainerStarted","Data":"31b85b684572a153c939cb6a4b1f12e9ae2b4c87a1b4ccc9ac4b1d769a5d198e"}
Jul 07 15:11:51.366464 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:51.366424    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5" event={"ID":"8f31700c-efe1-45d3-86cf-2e57eae0ea2c","Type":"ContainerStarted","Data":"4ad88f4a996b0d1dc91af1104229e73ce042705cae41d197c323e488be66e7d0"}
Jul 07 15:11:51.394034 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:51.393958    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5" podStartSLOduration=1.393939426 podStartE2EDuration="1.393939426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:11:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:11:51.392625396 +0000 UTC m=+671.126511781" watchObservedRunningTime="2026-07-07 15:11:51.393939426 +0000 UTC m=+671.127825807"
Jul 07 15:11:52.082058 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:52.081986    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:52.086780 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:52.086754    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:52.371039 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:52.370946    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:11:52.372131 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:11:52.372110    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:12:07.789334 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:07.789294    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"]
Jul 07 15:12:07.792666 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:07.792649    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"
Jul 07 15:12:07.794877 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:07.794848    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 15:12:07.795074 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:07.794955    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-p75tw\""
Jul 07 15:12:07.802269 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:07.802217    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"]
Jul 07 15:12:07.877963 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:07.877925    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"]
Jul 07 15:12:07.883611 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:07.883574    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2-config-file\") pod \"limitador-limitador-64c94fd64f-rpcbn\" (UID: \"63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"
Jul 07 15:12:07.883772 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:07.883628    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhckf\" (UniqueName: \"kubernetes.io/projected/63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2-kube-api-access-hhckf\") pod \"limitador-limitador-64c94fd64f-rpcbn\" (UID: \"63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"
Jul 07 15:12:07.984543 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:07.984510    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2-config-file\") pod \"limitador-limitador-64c94fd64f-rpcbn\" (UID: \"63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"
Jul 07 15:12:07.984832 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:07.984563    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhckf\" (UniqueName: \"kubernetes.io/projected/63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2-kube-api-access-hhckf\") pod \"limitador-limitador-64c94fd64f-rpcbn\" (UID: \"63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"
Jul 07 15:12:07.986055 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:07.986027    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2-config-file\") pod \"limitador-limitador-64c94fd64f-rpcbn\" (UID: \"63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"
Jul 07 15:12:07.992567 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:07.992532    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhckf\" (UniqueName: \"kubernetes.io/projected/63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2-kube-api-access-hhckf\") pod \"limitador-limitador-64c94fd64f-rpcbn\" (UID: \"63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"
Jul 07 15:12:08.104738 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:08.104648    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"
Jul 07 15:12:08.243017 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:08.242982    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"]
Jul 07 15:12:08.245060 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:12:08.245001    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c3cf22_c77a_4a1f_8cc0_af1fa13c10b2.slice/crio-115b4bbdcc09ce6106dbdf179e61efa5b528037a5dd3f15ecf3578ed21b0dca2 WatchSource:0}: Error finding container 115b4bbdcc09ce6106dbdf179e61efa5b528037a5dd3f15ecf3578ed21b0dca2: Status 404 returned error can't find the container with id 115b4bbdcc09ce6106dbdf179e61efa5b528037a5dd3f15ecf3578ed21b0dca2
Jul 07 15:12:08.246936 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:08.246922    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:12:08.445088 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:08.444993    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn" event={"ID":"63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2","Type":"ContainerStarted","Data":"115b4bbdcc09ce6106dbdf179e61efa5b528037a5dd3f15ecf3578ed21b0dca2"}
Jul 07 15:12:08.569686 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:08.569646    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-klf8x"]
Jul 07 15:12:08.574107 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:08.574081    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-klf8x"
Jul 07 15:12:08.576188 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:08.576168    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qk84r\""
Jul 07 15:12:08.581265 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:08.581056    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-klf8x"]
Jul 07 15:12:08.691080 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:08.691041    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pmmc\" (UniqueName: \"kubernetes.io/projected/1aa9d37b-3805-4a4f-928b-07819bba87ee-kube-api-access-9pmmc\") pod \"authorino-58cd955675-klf8x\" (UID: \"1aa9d37b-3805-4a4f-928b-07819bba87ee\") " pod="kuadrant-system/authorino-58cd955675-klf8x"
Jul 07 15:12:08.792338 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:08.792299    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pmmc\" (UniqueName: \"kubernetes.io/projected/1aa9d37b-3805-4a4f-928b-07819bba87ee-kube-api-access-9pmmc\") pod \"authorino-58cd955675-klf8x\" (UID: \"1aa9d37b-3805-4a4f-928b-07819bba87ee\") " pod="kuadrant-system/authorino-58cd955675-klf8x"
Jul 07 15:12:08.800016 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:08.799984    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pmmc\" (UniqueName: \"kubernetes.io/projected/1aa9d37b-3805-4a4f-928b-07819bba87ee-kube-api-access-9pmmc\") pod \"authorino-58cd955675-klf8x\" (UID: \"1aa9d37b-3805-4a4f-928b-07819bba87ee\") " pod="kuadrant-system/authorino-58cd955675-klf8x"
Jul 07 15:12:08.884530 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:08.884494    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-klf8x"
Jul 07 15:12:09.024287 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:09.024257    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-klf8x"]
Jul 07 15:12:09.027459 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:12:09.027419    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1aa9d37b_3805_4a4f_928b_07819bba87ee.slice/crio-a45bc7cae1071a9a30a112ec3bb2c61f98bd0022125daa95de9cc0923c2f807b WatchSource:0}: Error finding container a45bc7cae1071a9a30a112ec3bb2c61f98bd0022125daa95de9cc0923c2f807b: Status 404 returned error can't find the container with id a45bc7cae1071a9a30a112ec3bb2c61f98bd0022125daa95de9cc0923c2f807b
Jul 07 15:12:09.453209 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:09.453169    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-klf8x" event={"ID":"1aa9d37b-3805-4a4f-928b-07819bba87ee","Type":"ContainerStarted","Data":"a45bc7cae1071a9a30a112ec3bb2c61f98bd0022125daa95de9cc0923c2f807b"}
Jul 07 15:12:13.283538 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:13.283500    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-klf8x"]
Jul 07 15:12:13.476790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:13.476757    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-klf8x" event={"ID":"1aa9d37b-3805-4a4f-928b-07819bba87ee","Type":"ContainerStarted","Data":"8f08d2f591d63f438fb19cf69ce3d911f9dc623994047b040bb3a2986f04ce9e"}
Jul 07 15:12:13.478331 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:13.478307    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn" event={"ID":"63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2","Type":"ContainerStarted","Data":"87a773b6546500c9547cb20fb59401f8dfff4f04d437b87a4bb94be70333871c"}
Jul 07 15:12:13.478483 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:13.478370    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"
Jul 07 15:12:13.490558 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:13.490509    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-klf8x" podStartSLOduration=1.60945026 podStartE2EDuration="5.490492655s" totalImagesPullingTime="3.881042395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:12:13.489696881 +0000 UTC m=+693.223583264" watchObservedRunningTime="2026-07-07 15:12:13.490492655 +0000 UTC m=+693.224379037"
Jul 07 15:12:13.505928 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:13.505869    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn" podStartSLOduration=1.900426623 podStartE2EDuration="6.505850291s" totalImagesPullingTime="4.605423668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:12:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:12:13.503648486 +0000 UTC m=+693.237534870" watchObservedRunningTime="2026-07-07 15:12:13.505850291 +0000 UTC m=+693.239736675"
Jul 07 15:12:14.483196 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:14.483139    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-klf8x" podUID="1aa9d37b-3805-4a4f-928b-07819bba87ee" containerName="authorino" containerID="cri-o://8f08d2f591d63f438fb19cf69ce3d911f9dc623994047b040bb3a2986f04ce9e" gracePeriod=30
Jul 07 15:12:14.733563 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:14.733490    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-klf8x"
Jul 07 15:12:14.849669 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:14.849623    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pmmc\" (UniqueName: \"kubernetes.io/projected/1aa9d37b-3805-4a4f-928b-07819bba87ee-kube-api-access-9pmmc\") pod \"1aa9d37b-3805-4a4f-928b-07819bba87ee\" (UID: \"1aa9d37b-3805-4a4f-928b-07819bba87ee\") "
Jul 07 15:12:14.851717 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:14.851683    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aa9d37b-3805-4a4f-928b-07819bba87ee-kube-api-access-9pmmc" (OuterVolumeSpecName: "kube-api-access-9pmmc") pod "1aa9d37b-3805-4a4f-928b-07819bba87ee" (UID: "1aa9d37b-3805-4a4f-928b-07819bba87ee"). InnerVolumeSpecName "kube-api-access-9pmmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:12:14.951472 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:14.951430    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pmmc\" (UniqueName: \"kubernetes.io/projected/1aa9d37b-3805-4a4f-928b-07819bba87ee-kube-api-access-9pmmc\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:12:15.488520 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:15.488482    2574 generic.go:356] "Generic (PLEG): container finished" podID="1aa9d37b-3805-4a4f-928b-07819bba87ee" containerID="8f08d2f591d63f438fb19cf69ce3d911f9dc623994047b040bb3a2986f04ce9e" exitCode=0
Jul 07 15:12:15.488932 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:15.488540    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-klf8x"
Jul 07 15:12:15.488932 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:15.488572    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-klf8x" event={"ID":"1aa9d37b-3805-4a4f-928b-07819bba87ee","Type":"ContainerDied","Data":"8f08d2f591d63f438fb19cf69ce3d911f9dc623994047b040bb3a2986f04ce9e"}
Jul 07 15:12:15.488932 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:15.488620    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-klf8x" event={"ID":"1aa9d37b-3805-4a4f-928b-07819bba87ee","Type":"ContainerDied","Data":"a45bc7cae1071a9a30a112ec3bb2c61f98bd0022125daa95de9cc0923c2f807b"}
Jul 07 15:12:15.488932 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:15.488642    2574 scope.go:117] "RemoveContainer" containerID="8f08d2f591d63f438fb19cf69ce3d911f9dc623994047b040bb3a2986f04ce9e"
Jul 07 15:12:15.497243 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:15.497224    2574 scope.go:117] "RemoveContainer" containerID="8f08d2f591d63f438fb19cf69ce3d911f9dc623994047b040bb3a2986f04ce9e"
Jul 07 15:12:15.497533 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:12:15.497514    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f08d2f591d63f438fb19cf69ce3d911f9dc623994047b040bb3a2986f04ce9e\": container with ID starting with 8f08d2f591d63f438fb19cf69ce3d911f9dc623994047b040bb3a2986f04ce9e not found: ID does not exist" containerID="8f08d2f591d63f438fb19cf69ce3d911f9dc623994047b040bb3a2986f04ce9e"
Jul 07 15:12:15.497583 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:15.497542    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f08d2f591d63f438fb19cf69ce3d911f9dc623994047b040bb3a2986f04ce9e"} err="failed to get container status \"8f08d2f591d63f438fb19cf69ce3d911f9dc623994047b040bb3a2986f04ce9e\": rpc error: code = NotFound desc = could not find container \"8f08d2f591d63f438fb19cf69ce3d911f9dc623994047b040bb3a2986f04ce9e\": container with ID starting with 8f08d2f591d63f438fb19cf69ce3d911f9dc623994047b040bb3a2986f04ce9e not found: ID does not exist"
Jul 07 15:12:15.503893 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:15.503861    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-klf8x"]
Jul 07 15:12:15.506556 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:15.506529    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-klf8x"]
Jul 07 15:12:16.867540 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:16.867507    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aa9d37b-3805-4a4f-928b-07819bba87ee" path="/var/lib/kubelet/pods/1aa9d37b-3805-4a4f-928b-07819bba87ee/volumes"
Jul 07 15:12:23.285926 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:23.285884    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"]
Jul 07 15:12:23.286493 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:23.286153    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn" podUID="63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2" containerName="limitador" containerID="cri-o://87a773b6546500c9547cb20fb59401f8dfff4f04d437b87a4bb94be70333871c" gracePeriod=30
Jul 07 15:12:23.286800 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:23.286738    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"
Jul 07 15:12:23.856668 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:23.856639    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"
Jul 07 15:12:24.027191 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.027156    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2-config-file\") pod \"63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2\" (UID: \"63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2\") "
Jul 07 15:12:24.027366 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.027197    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhckf\" (UniqueName: \"kubernetes.io/projected/63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2-kube-api-access-hhckf\") pod \"63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2\" (UID: \"63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2\") "
Jul 07 15:12:24.027650 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.027619    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2-config-file" (OuterVolumeSpecName: "config-file") pod "63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2" (UID: "63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:12:24.029278 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.029242    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2-kube-api-access-hhckf" (OuterVolumeSpecName: "kube-api-access-hhckf") pod "63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2" (UID: "63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2"). InnerVolumeSpecName "kube-api-access-hhckf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:12:24.128338 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.128246    2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2-config-file\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:12:24.128338 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.128280    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhckf\" (UniqueName: \"kubernetes.io/projected/63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2-kube-api-access-hhckf\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:12:24.533068 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.533030    2574 generic.go:356] "Generic (PLEG): container finished" podID="63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2" containerID="87a773b6546500c9547cb20fb59401f8dfff4f04d437b87a4bb94be70333871c" exitCode=0
Jul 07 15:12:24.533605 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.533084    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"
Jul 07 15:12:24.533605 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.533087    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn" event={"ID":"63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2","Type":"ContainerDied","Data":"87a773b6546500c9547cb20fb59401f8dfff4f04d437b87a4bb94be70333871c"}
Jul 07 15:12:24.533605 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.533143    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rpcbn" event={"ID":"63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2","Type":"ContainerDied","Data":"115b4bbdcc09ce6106dbdf179e61efa5b528037a5dd3f15ecf3578ed21b0dca2"}
Jul 07 15:12:24.533605 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.533159    2574 scope.go:117] "RemoveContainer" containerID="87a773b6546500c9547cb20fb59401f8dfff4f04d437b87a4bb94be70333871c"
Jul 07 15:12:24.541461 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.541440    2574 scope.go:117] "RemoveContainer" containerID="87a773b6546500c9547cb20fb59401f8dfff4f04d437b87a4bb94be70333871c"
Jul 07 15:12:24.541775 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:12:24.541755    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87a773b6546500c9547cb20fb59401f8dfff4f04d437b87a4bb94be70333871c\": container with ID starting with 87a773b6546500c9547cb20fb59401f8dfff4f04d437b87a4bb94be70333871c not found: ID does not exist" containerID="87a773b6546500c9547cb20fb59401f8dfff4f04d437b87a4bb94be70333871c"
Jul 07 15:12:24.541840 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.541791    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87a773b6546500c9547cb20fb59401f8dfff4f04d437b87a4bb94be70333871c"} err="failed to get container status \"87a773b6546500c9547cb20fb59401f8dfff4f04d437b87a4bb94be70333871c\": rpc error: code = NotFound desc = could not find container \"87a773b6546500c9547cb20fb59401f8dfff4f04d437b87a4bb94be70333871c\": container with ID starting with 87a773b6546500c9547cb20fb59401f8dfff4f04d437b87a4bb94be70333871c not found: ID does not exist"
Jul 07 15:12:24.553757 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.553727    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"]
Jul 07 15:12:24.556722 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.556695    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rpcbn"]
Jul 07 15:12:24.866746 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:24.866663    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2" path="/var/lib/kubelet/pods/63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2/volumes"
Jul 07 15:12:29.586069 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.586034    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-zqndj"]
Jul 07 15:12:29.586571 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.586550    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa9d37b-3805-4a4f-928b-07819bba87ee" containerName="authorino"
Jul 07 15:12:29.586643 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.586575    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa9d37b-3805-4a4f-928b-07819bba87ee" containerName="authorino"
Jul 07 15:12:29.586643 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.586602    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2" containerName="limitador"
Jul 07 15:12:29.586643 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.586611    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2" containerName="limitador"
Jul 07 15:12:29.586794 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.586710    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aa9d37b-3805-4a4f-928b-07819bba87ee" containerName="authorino"
Jul 07 15:12:29.586794 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.586726    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="63c3cf22-c77a-4a1f-8cc0-af1fa13c10b2" containerName="limitador"
Jul 07 15:12:29.590815 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.590790    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-zqndj"
Jul 07 15:12:29.593226 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.593201    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 15:12:29.593416 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.593241    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qhhbh\""
Jul 07 15:12:29.598089 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.598061    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-zqndj"]
Jul 07 15:12:29.673631 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.673588    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/13d257de-bdf5-4799-8216-e4df06b277c0-data\") pod \"postgres-69fb4594cf-zqndj\" (UID: \"13d257de-bdf5-4799-8216-e4df06b277c0\") " pod="opendatahub/postgres-69fb4594cf-zqndj"
Jul 07 15:12:29.673822 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.673641    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwkkf\" (UniqueName: \"kubernetes.io/projected/13d257de-bdf5-4799-8216-e4df06b277c0-kube-api-access-qwkkf\") pod \"postgres-69fb4594cf-zqndj\" (UID: \"13d257de-bdf5-4799-8216-e4df06b277c0\") " pod="opendatahub/postgres-69fb4594cf-zqndj"
Jul 07 15:12:29.775100 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.775062    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/13d257de-bdf5-4799-8216-e4df06b277c0-data\") pod \"postgres-69fb4594cf-zqndj\" (UID: \"13d257de-bdf5-4799-8216-e4df06b277c0\") " pod="opendatahub/postgres-69fb4594cf-zqndj"
Jul 07 15:12:29.775100 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.775103    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwkkf\" (UniqueName: \"kubernetes.io/projected/13d257de-bdf5-4799-8216-e4df06b277c0-kube-api-access-qwkkf\") pod \"postgres-69fb4594cf-zqndj\" (UID: \"13d257de-bdf5-4799-8216-e4df06b277c0\") " pod="opendatahub/postgres-69fb4594cf-zqndj"
Jul 07 15:12:29.775473 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.775453    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/13d257de-bdf5-4799-8216-e4df06b277c0-data\") pod \"postgres-69fb4594cf-zqndj\" (UID: \"13d257de-bdf5-4799-8216-e4df06b277c0\") " pod="opendatahub/postgres-69fb4594cf-zqndj"
Jul 07 15:12:29.783142 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.783110    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwkkf\" (UniqueName: \"kubernetes.io/projected/13d257de-bdf5-4799-8216-e4df06b277c0-kube-api-access-qwkkf\") pod \"postgres-69fb4594cf-zqndj\" (UID: \"13d257de-bdf5-4799-8216-e4df06b277c0\") " pod="opendatahub/postgres-69fb4594cf-zqndj"
Jul 07 15:12:29.903548 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:29.903442    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-zqndj"
Jul 07 15:12:30.040202 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:30.040174    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-zqndj"]
Jul 07 15:12:30.042914 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:12:30.042883    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d257de_bdf5_4799_8216_e4df06b277c0.slice/crio-6f11634546dd277ad1f595a4b59ec3a5cff7b7a57e310312b60c1ac0e07dc523 WatchSource:0}: Error finding container 6f11634546dd277ad1f595a4b59ec3a5cff7b7a57e310312b60c1ac0e07dc523: Status 404 returned error can't find the container with id 6f11634546dd277ad1f595a4b59ec3a5cff7b7a57e310312b60c1ac0e07dc523
Jul 07 15:12:30.562065 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:30.562031    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-zqndj" event={"ID":"13d257de-bdf5-4799-8216-e4df06b277c0","Type":"ContainerStarted","Data":"6f11634546dd277ad1f595a4b59ec3a5cff7b7a57e310312b60c1ac0e07dc523"}
Jul 07 15:12:35.589299 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:35.589259    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-zqndj" event={"ID":"13d257de-bdf5-4799-8216-e4df06b277c0","Type":"ContainerStarted","Data":"0e5b3d473d1bf89dcb09f24f5caee4b38547b297e05f27d5fec1a17980f660b5"}
Jul 07 15:12:35.589712 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:35.589352    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-zqndj"
Jul 07 15:12:35.605323 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:35.605264    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-zqndj" podStartSLOduration=1.51619415 podStartE2EDuration="6.605247705s" totalImagesPullingTime="5.089053555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:12:35.60372726 +0000 UTC m=+715.337613643" watchObservedRunningTime="2026-07-07 15:12:35.605247705 +0000 UTC m=+715.339134088"
Jul 07 15:12:41.625661 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:41.625631    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-zqndj"
Jul 07 15:12:49.762583 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.762544    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6789dd54fb-lcgrv"]
Jul 07 15:12:49.787246 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.787215    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6789dd54fb-lcgrv"]
Jul 07 15:12:49.787412 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.787286    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6789dd54fb-lcgrv"
Jul 07 15:12:49.790087 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.790065    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 15:12:49.790241 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.790103    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gbsdv\""
Jul 07 15:12:49.790241 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.790120    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 15:12:49.853061 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.853019    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9kn8\" (UniqueName: \"kubernetes.io/projected/8fff87a9-b1ed-4d71-8d89-6f800e6bcae3-kube-api-access-d9kn8\") pod \"maas-controller-6789dd54fb-lcgrv\" (UID: \"8fff87a9-b1ed-4d71-8d89-6f800e6bcae3\") " pod="opendatahub/maas-controller-6789dd54fb-lcgrv"
Jul 07 15:12:49.853061 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.853068    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fff87a9-b1ed-4d71-8d89-6f800e6bcae3-webhook-cert\") pod \"maas-controller-6789dd54fb-lcgrv\" (UID: \"8fff87a9-b1ed-4d71-8d89-6f800e6bcae3\") " pod="opendatahub/maas-controller-6789dd54fb-lcgrv"
Jul 07 15:12:49.954272 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.954228    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kn8\" (UniqueName: \"kubernetes.io/projected/8fff87a9-b1ed-4d71-8d89-6f800e6bcae3-kube-api-access-d9kn8\") pod \"maas-controller-6789dd54fb-lcgrv\" (UID: \"8fff87a9-b1ed-4d71-8d89-6f800e6bcae3\") " pod="opendatahub/maas-controller-6789dd54fb-lcgrv"
Jul 07 15:12:49.954272 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.954275    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fff87a9-b1ed-4d71-8d89-6f800e6bcae3-webhook-cert\") pod \"maas-controller-6789dd54fb-lcgrv\" (UID: \"8fff87a9-b1ed-4d71-8d89-6f800e6bcae3\") " pod="opendatahub/maas-controller-6789dd54fb-lcgrv"
Jul 07 15:12:49.956933 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.956902    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fff87a9-b1ed-4d71-8d89-6f800e6bcae3-webhook-cert\") pod \"maas-controller-6789dd54fb-lcgrv\" (UID: \"8fff87a9-b1ed-4d71-8d89-6f800e6bcae3\") " pod="opendatahub/maas-controller-6789dd54fb-lcgrv"
Jul 07 15:12:49.964805 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.964770    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9kn8\" (UniqueName: \"kubernetes.io/projected/8fff87a9-b1ed-4d71-8d89-6f800e6bcae3-kube-api-access-d9kn8\") pod \"maas-controller-6789dd54fb-lcgrv\" (UID: \"8fff87a9-b1ed-4d71-8d89-6f800e6bcae3\") " pod="opendatahub/maas-controller-6789dd54fb-lcgrv"
Jul 07 15:12:49.970083 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.970056    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79565bf89-8v9kx"]
Jul 07 15:12:49.974330 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.974311    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79565bf89-8v9kx"
Jul 07 15:12:49.983512 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:49.983483    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79565bf89-8v9kx"]
Jul 07 15:12:50.055623 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:50.055584    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc023bd2-6fb6-41de-94de-e7e22f3ff9a8-webhook-cert\") pod \"maas-controller-79565bf89-8v9kx\" (UID: \"dc023bd2-6fb6-41de-94de-e7e22f3ff9a8\") " pod="opendatahub/maas-controller-79565bf89-8v9kx"
Jul 07 15:12:50.055796 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:50.055626    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kftzr\" (UniqueName: \"kubernetes.io/projected/dc023bd2-6fb6-41de-94de-e7e22f3ff9a8-kube-api-access-kftzr\") pod \"maas-controller-79565bf89-8v9kx\" (UID: \"dc023bd2-6fb6-41de-94de-e7e22f3ff9a8\") " pod="opendatahub/maas-controller-79565bf89-8v9kx"
Jul 07 15:12:50.097862 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:50.097830    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6789dd54fb-lcgrv"
Jul 07 15:12:50.156988 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:50.156951    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc023bd2-6fb6-41de-94de-e7e22f3ff9a8-webhook-cert\") pod \"maas-controller-79565bf89-8v9kx\" (UID: \"dc023bd2-6fb6-41de-94de-e7e22f3ff9a8\") " pod="opendatahub/maas-controller-79565bf89-8v9kx"
Jul 07 15:12:50.156988 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:50.156993    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kftzr\" (UniqueName: \"kubernetes.io/projected/dc023bd2-6fb6-41de-94de-e7e22f3ff9a8-kube-api-access-kftzr\") pod \"maas-controller-79565bf89-8v9kx\" (UID: \"dc023bd2-6fb6-41de-94de-e7e22f3ff9a8\") " pod="opendatahub/maas-controller-79565bf89-8v9kx"
Jul 07 15:12:50.159815 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:50.159785    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc023bd2-6fb6-41de-94de-e7e22f3ff9a8-webhook-cert\") pod \"maas-controller-79565bf89-8v9kx\" (UID: \"dc023bd2-6fb6-41de-94de-e7e22f3ff9a8\") " pod="opendatahub/maas-controller-79565bf89-8v9kx"
Jul 07 15:12:50.166120 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:50.166077    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kftzr\" (UniqueName: \"kubernetes.io/projected/dc023bd2-6fb6-41de-94de-e7e22f3ff9a8-kube-api-access-kftzr\") pod \"maas-controller-79565bf89-8v9kx\" (UID: \"dc023bd2-6fb6-41de-94de-e7e22f3ff9a8\") " pod="opendatahub/maas-controller-79565bf89-8v9kx"
Jul 07 15:12:50.238951 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:50.238916    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6789dd54fb-lcgrv"]
Jul 07 15:12:50.241956 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:12:50.241928    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fff87a9_b1ed_4d71_8d89_6f800e6bcae3.slice/crio-42b15d63900fa8cb8112eb55ea34f41a0233832c0192cfbc0eef548058792f77 WatchSource:0}: Error finding container 42b15d63900fa8cb8112eb55ea34f41a0233832c0192cfbc0eef548058792f77: Status 404 returned error can't find the container with id 42b15d63900fa8cb8112eb55ea34f41a0233832c0192cfbc0eef548058792f77
Jul 07 15:12:50.290296 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:50.290258    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79565bf89-8v9kx"
Jul 07 15:12:50.423757 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:50.423728    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79565bf89-8v9kx"]
Jul 07 15:12:50.426018 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:12:50.425981    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc023bd2_6fb6_41de_94de_e7e22f3ff9a8.slice/crio-655da47eeebec1e8acfa42974e0432ee9bc9fe420ecbf2f03a30a44695d377c0 WatchSource:0}: Error finding container 655da47eeebec1e8acfa42974e0432ee9bc9fe420ecbf2f03a30a44695d377c0: Status 404 returned error can't find the container with id 655da47eeebec1e8acfa42974e0432ee9bc9fe420ecbf2f03a30a44695d377c0
Jul 07 15:12:50.660922 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:50.660826    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79565bf89-8v9kx" event={"ID":"dc023bd2-6fb6-41de-94de-e7e22f3ff9a8","Type":"ContainerStarted","Data":"655da47eeebec1e8acfa42974e0432ee9bc9fe420ecbf2f03a30a44695d377c0"}
Jul 07 15:12:50.661897 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:50.661876    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6789dd54fb-lcgrv" event={"ID":"8fff87a9-b1ed-4d71-8d89-6f800e6bcae3","Type":"ContainerStarted","Data":"42b15d63900fa8cb8112eb55ea34f41a0233832c0192cfbc0eef548058792f77"}
Jul 07 15:12:52.680095 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:52.680053    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6789dd54fb-lcgrv" event={"ID":"8fff87a9-b1ed-4d71-8d89-6f800e6bcae3","Type":"ContainerStarted","Data":"5c190993289870992054753d88d8e238edb47f9935ad996d1c63c655919ca5e0"}
Jul 07 15:12:52.680540 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:52.680126    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6789dd54fb-lcgrv"
Jul 07 15:12:52.681618 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:52.681589    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79565bf89-8v9kx" event={"ID":"dc023bd2-6fb6-41de-94de-e7e22f3ff9a8","Type":"ContainerStarted","Data":"94d784b39031370de23e0a71e181dcea1b1feb09ffbc5fa367d7b7e641a49bd7"}
Jul 07 15:12:52.681740 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:52.681652    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79565bf89-8v9kx"
Jul 07 15:12:52.708366 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:52.708256    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6789dd54fb-lcgrv" podStartSLOduration=1.478893856 podStartE2EDuration="3.708237469s" totalImagesPullingTime="2.229343613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:12:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:12:52.706504088 +0000 UTC m=+732.440390472" watchObservedRunningTime="2026-07-07 15:12:52.708237469 +0000 UTC m=+732.442123851"
Jul 07 15:12:52.739890 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:12:52.739837    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79565bf89-8v9kx" podStartSLOduration=1.705202135 podStartE2EDuration="3.739819091s" totalImagesPullingTime="2.034616956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:12:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:12:52.73923892 +0000 UTC m=+732.473125325" watchObservedRunningTime="2026-07-07 15:12:52.739819091 +0000 UTC m=+732.473705473"
Jul 07 15:13:03.693862 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:03.693829    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6789dd54fb-lcgrv"
Jul 07 15:13:03.694396 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:03.694191    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79565bf89-8v9kx"
Jul 07 15:13:03.747514 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:03.747485    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6789dd54fb-lcgrv"]
Jul 07 15:13:03.747695 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:03.747661    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6789dd54fb-lcgrv" podUID="8fff87a9-b1ed-4d71-8d89-6f800e6bcae3" containerName="manager" containerID="cri-o://5c190993289870992054753d88d8e238edb47f9935ad996d1c63c655919ca5e0" gracePeriod=30
Jul 07 15:13:03.997800 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:03.997775    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6789dd54fb-lcgrv"
Jul 07 15:13:04.079107 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.079065    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9kn8\" (UniqueName: \"kubernetes.io/projected/8fff87a9-b1ed-4d71-8d89-6f800e6bcae3-kube-api-access-d9kn8\") pod \"8fff87a9-b1ed-4d71-8d89-6f800e6bcae3\" (UID: \"8fff87a9-b1ed-4d71-8d89-6f800e6bcae3\") "
Jul 07 15:13:04.079107 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.079108    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fff87a9-b1ed-4d71-8d89-6f800e6bcae3-webhook-cert\") pod \"8fff87a9-b1ed-4d71-8d89-6f800e6bcae3\" (UID: \"8fff87a9-b1ed-4d71-8d89-6f800e6bcae3\") "
Jul 07 15:13:04.081388 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.081353    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fff87a9-b1ed-4d71-8d89-6f800e6bcae3-kube-api-access-d9kn8" (OuterVolumeSpecName: "kube-api-access-d9kn8") pod "8fff87a9-b1ed-4d71-8d89-6f800e6bcae3" (UID: "8fff87a9-b1ed-4d71-8d89-6f800e6bcae3"). InnerVolumeSpecName "kube-api-access-d9kn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:13:04.081485 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.081390    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fff87a9-b1ed-4d71-8d89-6f800e6bcae3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8fff87a9-b1ed-4d71-8d89-6f800e6bcae3" (UID: "8fff87a9-b1ed-4d71-8d89-6f800e6bcae3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:13:04.180197 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.180161    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9kn8\" (UniqueName: \"kubernetes.io/projected/8fff87a9-b1ed-4d71-8d89-6f800e6bcae3-kube-api-access-d9kn8\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:13:04.180197 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.180191    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fff87a9-b1ed-4d71-8d89-6f800e6bcae3-webhook-cert\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:13:04.740106 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.740072    2574 generic.go:356] "Generic (PLEG): container finished" podID="8fff87a9-b1ed-4d71-8d89-6f800e6bcae3" containerID="5c190993289870992054753d88d8e238edb47f9935ad996d1c63c655919ca5e0" exitCode=0
Jul 07 15:13:04.740553 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.740126    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6789dd54fb-lcgrv" event={"ID":"8fff87a9-b1ed-4d71-8d89-6f800e6bcae3","Type":"ContainerDied","Data":"5c190993289870992054753d88d8e238edb47f9935ad996d1c63c655919ca5e0"}
Jul 07 15:13:04.740553 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.740142    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6789dd54fb-lcgrv"
Jul 07 15:13:04.740553 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.740194    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6789dd54fb-lcgrv" event={"ID":"8fff87a9-b1ed-4d71-8d89-6f800e6bcae3","Type":"ContainerDied","Data":"42b15d63900fa8cb8112eb55ea34f41a0233832c0192cfbc0eef548058792f77"}
Jul 07 15:13:04.740553 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.740216    2574 scope.go:117] "RemoveContainer" containerID="5c190993289870992054753d88d8e238edb47f9935ad996d1c63c655919ca5e0"
Jul 07 15:13:04.749184 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.749049    2574 scope.go:117] "RemoveContainer" containerID="5c190993289870992054753d88d8e238edb47f9935ad996d1c63c655919ca5e0"
Jul 07 15:13:04.749345 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:13:04.749327    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c190993289870992054753d88d8e238edb47f9935ad996d1c63c655919ca5e0\": container with ID starting with 5c190993289870992054753d88d8e238edb47f9935ad996d1c63c655919ca5e0 not found: ID does not exist" containerID="5c190993289870992054753d88d8e238edb47f9935ad996d1c63c655919ca5e0"
Jul 07 15:13:04.749392 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.749356    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c190993289870992054753d88d8e238edb47f9935ad996d1c63c655919ca5e0"} err="failed to get container status \"5c190993289870992054753d88d8e238edb47f9935ad996d1c63c655919ca5e0\": rpc error: code = NotFound desc = could not find container \"5c190993289870992054753d88d8e238edb47f9935ad996d1c63c655919ca5e0\": container with ID starting with 5c190993289870992054753d88d8e238edb47f9935ad996d1c63c655919ca5e0 not found: ID does not exist"
Jul 07 15:13:04.761374 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.761342    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6789dd54fb-lcgrv"]
Jul 07 15:13:04.764794 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.764766    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6789dd54fb-lcgrv"]
Jul 07 15:13:04.867592 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:04.867560    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fff87a9-b1ed-4d71-8d89-6f800e6bcae3" path="/var/lib/kubelet/pods/8fff87a9-b1ed-4d71-8d89-6f800e6bcae3/volumes"
Jul 07 15:13:25.776855 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:25.776820    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-67fdfd6fd7-qq84k"]
Jul 07 15:13:25.777353 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:25.777154    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fff87a9-b1ed-4d71-8d89-6f800e6bcae3" containerName="manager"
Jul 07 15:13:25.777353 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:25.777165    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fff87a9-b1ed-4d71-8d89-6f800e6bcae3" containerName="manager"
Jul 07 15:13:25.777353 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:25.777233    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fff87a9-b1ed-4d71-8d89-6f800e6bcae3" containerName="manager"
Jul 07 15:13:25.783629 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:25.783611    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-67fdfd6fd7-qq84k"
Jul 07 15:13:25.785852 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:25.785829    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-td6sd\""
Jul 07 15:13:25.786439 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:25.786411    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 07 15:13:25.789919 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:25.789893    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-67fdfd6fd7-qq84k"]
Jul 07 15:13:25.968382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:25.968339    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0123178f-908f-41c3-9c90-7e041f345754-maas-api-tls\") pod \"maas-api-67fdfd6fd7-qq84k\" (UID: \"0123178f-908f-41c3-9c90-7e041f345754\") " pod="opendatahub/maas-api-67fdfd6fd7-qq84k"
Jul 07 15:13:25.968600 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:25.968409    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0123178f-908f-41c3-9c90-7e041f345754-openshift-service-ca\") pod \"maas-api-67fdfd6fd7-qq84k\" (UID: \"0123178f-908f-41c3-9c90-7e041f345754\") " pod="opendatahub/maas-api-67fdfd6fd7-qq84k"
Jul 07 15:13:25.968600 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:25.968501    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8smp6\" (UniqueName: \"kubernetes.io/projected/0123178f-908f-41c3-9c90-7e041f345754-kube-api-access-8smp6\") pod \"maas-api-67fdfd6fd7-qq84k\" (UID: \"0123178f-908f-41c3-9c90-7e041f345754\") " pod="opendatahub/maas-api-67fdfd6fd7-qq84k"
Jul 07 15:13:26.069599 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.069516    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0123178f-908f-41c3-9c90-7e041f345754-openshift-service-ca\") pod \"maas-api-67fdfd6fd7-qq84k\" (UID: \"0123178f-908f-41c3-9c90-7e041f345754\") " pod="opendatahub/maas-api-67fdfd6fd7-qq84k"
Jul 07 15:13:26.069599 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.069562    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8smp6\" (UniqueName: \"kubernetes.io/projected/0123178f-908f-41c3-9c90-7e041f345754-kube-api-access-8smp6\") pod \"maas-api-67fdfd6fd7-qq84k\" (UID: \"0123178f-908f-41c3-9c90-7e041f345754\") " pod="opendatahub/maas-api-67fdfd6fd7-qq84k"
Jul 07 15:13:26.069830 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.069608    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0123178f-908f-41c3-9c90-7e041f345754-maas-api-tls\") pod \"maas-api-67fdfd6fd7-qq84k\" (UID: \"0123178f-908f-41c3-9c90-7e041f345754\") " pod="opendatahub/maas-api-67fdfd6fd7-qq84k"
Jul 07 15:13:26.070240 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.070219    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0123178f-908f-41c3-9c90-7e041f345754-openshift-service-ca\") pod \"maas-api-67fdfd6fd7-qq84k\" (UID: \"0123178f-908f-41c3-9c90-7e041f345754\") " pod="opendatahub/maas-api-67fdfd6fd7-qq84k"
Jul 07 15:13:26.071972 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.071952    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0123178f-908f-41c3-9c90-7e041f345754-maas-api-tls\") pod \"maas-api-67fdfd6fd7-qq84k\" (UID: \"0123178f-908f-41c3-9c90-7e041f345754\") " pod="opendatahub/maas-api-67fdfd6fd7-qq84k"
Jul 07 15:13:26.077145 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.077117    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8smp6\" (UniqueName: \"kubernetes.io/projected/0123178f-908f-41c3-9c90-7e041f345754-kube-api-access-8smp6\") pod \"maas-api-67fdfd6fd7-qq84k\" (UID: \"0123178f-908f-41c3-9c90-7e041f345754\") " pod="opendatahub/maas-api-67fdfd6fd7-qq84k"
Jul 07 15:13:26.095889 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.095861    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-67fdfd6fd7-qq84k"
Jul 07 15:13:26.250071 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.250043    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-67fdfd6fd7-qq84k"]
Jul 07 15:13:26.252059 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:13:26.252026    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0123178f_908f_41c3_9c90_7e041f345754.slice/crio-22cf02e3e58619b8397461d3aa93cfbf3a6dbcb03c998e4f27ee6ad0b1579f9d WatchSource:0}: Error finding container 22cf02e3e58619b8397461d3aa93cfbf3a6dbcb03c998e4f27ee6ad0b1579f9d: Status 404 returned error can't find the container with id 22cf02e3e58619b8397461d3aa93cfbf3a6dbcb03c998e4f27ee6ad0b1579f9d
Jul 07 15:13:26.267687 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.267656    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-pkzkp"]
Jul 07 15:13:26.273809 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.273787    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-pkzkp"
Jul 07 15:13:26.276052 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.275997    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ghgh9\""
Jul 07 15:13:26.276170 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.275998    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 15:13:26.282760 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.282736    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-pkzkp"]
Jul 07 15:13:26.473525 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.473441    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lld55\" (UniqueName: \"kubernetes.io/projected/96e74d29-e4c7-4212-94ea-9842908c29d2-kube-api-access-lld55\") pod \"payload-pre-processing-7964457696-pkzkp\" (UID: \"96e74d29-e4c7-4212-94ea-9842908c29d2\") " pod="openshift-ingress/payload-pre-processing-7964457696-pkzkp"
Jul 07 15:13:26.473525 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.473502    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96e74d29-e4c7-4212-94ea-9842908c29d2-plugins-config-volume\") pod \"payload-pre-processing-7964457696-pkzkp\" (UID: \"96e74d29-e4c7-4212-94ea-9842908c29d2\") " pod="openshift-ingress/payload-pre-processing-7964457696-pkzkp"
Jul 07 15:13:26.574138 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.574108    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lld55\" (UniqueName: \"kubernetes.io/projected/96e74d29-e4c7-4212-94ea-9842908c29d2-kube-api-access-lld55\") pod \"payload-pre-processing-7964457696-pkzkp\" (UID: \"96e74d29-e4c7-4212-94ea-9842908c29d2\") " pod="openshift-ingress/payload-pre-processing-7964457696-pkzkp"
Jul 07 15:13:26.574316 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.574159    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96e74d29-e4c7-4212-94ea-9842908c29d2-plugins-config-volume\") pod \"payload-pre-processing-7964457696-pkzkp\" (UID: \"96e74d29-e4c7-4212-94ea-9842908c29d2\") " pod="openshift-ingress/payload-pre-processing-7964457696-pkzkp"
Jul 07 15:13:26.574848 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.574830    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96e74d29-e4c7-4212-94ea-9842908c29d2-plugins-config-volume\") pod \"payload-pre-processing-7964457696-pkzkp\" (UID: \"96e74d29-e4c7-4212-94ea-9842908c29d2\") " pod="openshift-ingress/payload-pre-processing-7964457696-pkzkp"
Jul 07 15:13:26.585798 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.585775    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lld55\" (UniqueName: \"kubernetes.io/projected/96e74d29-e4c7-4212-94ea-9842908c29d2-kube-api-access-lld55\") pod \"payload-pre-processing-7964457696-pkzkp\" (UID: \"96e74d29-e4c7-4212-94ea-9842908c29d2\") " pod="openshift-ingress/payload-pre-processing-7964457696-pkzkp"
Jul 07 15:13:26.841472 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.841419    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-67fdfd6fd7-qq84k" event={"ID":"0123178f-908f-41c3-9c90-7e041f345754","Type":"ContainerStarted","Data":"22cf02e3e58619b8397461d3aa93cfbf3a6dbcb03c998e4f27ee6ad0b1579f9d"}
Jul 07 15:13:26.885362 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:26.885332    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-pkzkp"
Jul 07 15:13:27.051326 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:27.051257    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-pkzkp"]
Jul 07 15:13:27.061296 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:13:27.061257    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e74d29_e4c7_4212_94ea_9842908c29d2.slice/crio-4e22866ca537de9822c90403694b8b0b99c45e9c85ed81a9006ad94d8598dd80 WatchSource:0}: Error finding container 4e22866ca537de9822c90403694b8b0b99c45e9c85ed81a9006ad94d8598dd80: Status 404 returned error can't find the container with id 4e22866ca537de9822c90403694b8b0b99c45e9c85ed81a9006ad94d8598dd80
Jul 07 15:13:27.871940 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:27.870672    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-pkzkp" event={"ID":"96e74d29-e4c7-4212-94ea-9842908c29d2","Type":"ContainerStarted","Data":"4e22866ca537de9822c90403694b8b0b99c45e9c85ed81a9006ad94d8598dd80"}
Jul 07 15:13:29.883225 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:29.883190    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-67fdfd6fd7-qq84k" event={"ID":"0123178f-908f-41c3-9c90-7e041f345754","Type":"ContainerStarted","Data":"2b97db708479a8d39a7fdad65ad1124d4a1d85930efa3293b977c64fe7665d56"}
Jul 07 15:13:29.883700 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:29.883318    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-67fdfd6fd7-qq84k"
Jul 07 15:13:29.884957 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:29.884933    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-pkzkp" event={"ID":"96e74d29-e4c7-4212-94ea-9842908c29d2","Type":"ContainerStarted","Data":"4585f12ffe875914139eb25de62f1d486a9243d8bb2f4ceefa2362a1645636cc"}
Jul 07 15:13:29.885096 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:29.885032    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-pkzkp"
Jul 07 15:13:29.900260 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:29.900207    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-67fdfd6fd7-qq84k" podStartSLOduration=2.347174249 podStartE2EDuration="4.900191133s" totalImagesPullingTime="2.553016884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:29.897954291 +0000 UTC m=+769.631840675" watchObservedRunningTime="2026-07-07 15:13:29.900191133 +0000 UTC m=+769.634077515"
Jul 07 15:13:29.913536 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:29.913487    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-pkzkp" podStartSLOduration=2.171696388 podStartE2EDuration="3.9134688s" totalImagesPullingTime="1.741772412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:29.911750613 +0000 UTC m=+769.645636995" watchObservedRunningTime="2026-07-07 15:13:29.9134688 +0000 UTC m=+769.647355182"
Jul 07 15:13:33.906820 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:33.906785    2574 generic.go:356] "Generic (PLEG): container finished" podID="8f31700c-efe1-45d3-86cf-2e57eae0ea2c" containerID="31b85b684572a153c939cb6a4b1f12e9ae2b4c87a1b4ccc9ac4b1d769a5d198e" exitCode=0
Jul 07 15:13:33.907306 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:33.906858    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5" event={"ID":"8f31700c-efe1-45d3-86cf-2e57eae0ea2c","Type":"ContainerDied","Data":"31b85b684572a153c939cb6a4b1f12e9ae2b4c87a1b4ccc9ac4b1d769a5d198e"}
Jul 07 15:13:33.907306 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:33.907284    2574 scope.go:117] "RemoveContainer" containerID="31b85b684572a153c939cb6a4b1f12e9ae2b4c87a1b4ccc9ac4b1d769a5d198e"
Jul 07 15:13:33.908315 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:33.908283    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 15:13:33.908413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:33.908355    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 15:13:33.908413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:33.908388    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 15:13:34.913534 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:34.913498    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5" event={"ID":"8f31700c-efe1-45d3-86cf-2e57eae0ea2c","Type":"ContainerStarted","Data":"ef2a7602aef2a35ab5e21fd5adea173d6288d7da75ed42b1ee163ff2457fc6c5"}
Jul 07 15:13:35.081755 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:35.081721    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:13:35.082824 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:35.082803    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dh9t5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 07 15:13:35.082933 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:35.082847    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5" podUID="8f31700c-efe1-45d3-86cf-2e57eae0ea2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 07 15:13:35.896132 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:35.896103    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-67fdfd6fd7-qq84k"
Jul 07 15:13:36.082339 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:36.082289    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dh9t5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 07 15:13:36.082843 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:36.082360    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5" podUID="8f31700c-efe1-45d3-86cf-2e57eae0ea2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 07 15:13:37.082627 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:37.082587    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dh9t5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 07 15:13:37.083074 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:37.082643    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5" podUID="8f31700c-efe1-45d3-86cf-2e57eae0ea2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 07 15:13:37.371362 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:37.371243    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:13:38.081783 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:38.081745    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dh9t5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 07 15:13:38.081960 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:38.081804    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5" podUID="8f31700c-efe1-45d3-86cf-2e57eae0ea2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 07 15:13:39.086084 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:39.086054    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:13:39.086904 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:39.086888    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dh9t5"
Jul 07 15:13:40.891598 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:40.891563    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-pkzkp"
Jul 07 15:13:49.613592 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.613553    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"]
Jul 07 15:13:49.618404 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.618380    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.620794 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.620776    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 15:13:49.620794 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.620788    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 15:13:49.621287 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.621265    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-shgqg\""
Jul 07 15:13:49.621376 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.621297    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 15:13:49.626651 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.626630    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"]
Jul 07 15:13:49.683728 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.683690    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c76a69ee-fdb8-4fef-9386-b42acf577ec5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.683882 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.683737    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c76a69ee-fdb8-4fef-9386-b42acf577ec5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.683882 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.683765    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c76a69ee-fdb8-4fef-9386-b42acf577ec5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.683882 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.683807    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wclcq\" (UniqueName: \"kubernetes.io/projected/c76a69ee-fdb8-4fef-9386-b42acf577ec5-kube-api-access-wclcq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.683882 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.683857    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c76a69ee-fdb8-4fef-9386-b42acf577ec5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.684033 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.683888    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c76a69ee-fdb8-4fef-9386-b42acf577ec5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.784674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.784639    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c76a69ee-fdb8-4fef-9386-b42acf577ec5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.784866 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.784681    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c76a69ee-fdb8-4fef-9386-b42acf577ec5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.784866 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.784704    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c76a69ee-fdb8-4fef-9386-b42acf577ec5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.784866 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.784727    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c76a69ee-fdb8-4fef-9386-b42acf577ec5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.784866 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.784763    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c76a69ee-fdb8-4fef-9386-b42acf577ec5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.784866 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.784805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wclcq\" (UniqueName: \"kubernetes.io/projected/c76a69ee-fdb8-4fef-9386-b42acf577ec5-kube-api-access-wclcq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.785214 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.785179    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c76a69ee-fdb8-4fef-9386-b42acf577ec5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.785297 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.785213    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c76a69ee-fdb8-4fef-9386-b42acf577ec5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.785371 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.785350    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c76a69ee-fdb8-4fef-9386-b42acf577ec5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.787259 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.787230    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c76a69ee-fdb8-4fef-9386-b42acf577ec5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.787398 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.787382    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c76a69ee-fdb8-4fef-9386-b42acf577ec5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.793350 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.793320    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wclcq\" (UniqueName: \"kubernetes.io/projected/c76a69ee-fdb8-4fef-9386-b42acf577ec5-kube-api-access-wclcq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8\" (UID: \"c76a69ee-fdb8-4fef-9386-b42acf577ec5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:49.930611 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:49.930507    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:50.075932 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:50.075841    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"]
Jul 07 15:13:50.078598 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:13:50.078568    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76a69ee_fdb8_4fef_9386_b42acf577ec5.slice/crio-66c251fd97dac54a015e0da8fec48a09bc314395dfd35a383b3232fce156e3e7 WatchSource:0}: Error finding container 66c251fd97dac54a015e0da8fec48a09bc314395dfd35a383b3232fce156e3e7: Status 404 returned error can't find the container with id 66c251fd97dac54a015e0da8fec48a09bc314395dfd35a383b3232fce156e3e7
Jul 07 15:13:50.986672 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:50.986628    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8" event={"ID":"c76a69ee-fdb8-4fef-9386-b42acf577ec5","Type":"ContainerStarted","Data":"66c251fd97dac54a015e0da8fec48a09bc314395dfd35a383b3232fce156e3e7"}
Jul 07 15:13:51.992883 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:51.992843    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8" event={"ID":"c76a69ee-fdb8-4fef-9386-b42acf577ec5","Type":"ContainerStarted","Data":"3429c6826c257b48a485ea608836cc30a415f5f23a20dd6e50107d00b4000cbd"}
Jul 07 15:13:52.011086 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:52.010998    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8" podStartSLOduration=1.861621755 podStartE2EDuration="3.010976763s" totalImagesPullingTime="1.149355008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:52.01055178 +0000 UTC m=+791.744438162" watchObservedRunningTime="2026-07-07 15:13:52.010976763 +0000 UTC m=+791.744863149"
Jul 07 15:13:58.076861 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.076823    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"]
Jul 07 15:13:58.080825 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.080801    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.083061 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.082979    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 15:13:58.090821 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.090785    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"]
Jul 07 15:13:58.161547 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.161505    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d90b11b-7c32-4644-b877-9b4c7d236620-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.161728 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.161558    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d90b11b-7c32-4644-b877-9b4c7d236620-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.161728 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.161651    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d90b11b-7c32-4644-b877-9b4c7d236620-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.161728 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.161712    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d90b11b-7c32-4644-b877-9b4c7d236620-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.161866 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.161732    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dvx9\" (UniqueName: \"kubernetes.io/projected/8d90b11b-7c32-4644-b877-9b4c7d236620-kube-api-access-5dvx9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.161866 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.161758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d90b11b-7c32-4644-b877-9b4c7d236620-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.263149 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.263107    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d90b11b-7c32-4644-b877-9b4c7d236620-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.263149 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.263149    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dvx9\" (UniqueName: \"kubernetes.io/projected/8d90b11b-7c32-4644-b877-9b4c7d236620-kube-api-access-5dvx9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.263413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.263226    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d90b11b-7c32-4644-b877-9b4c7d236620-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.263413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.263282    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d90b11b-7c32-4644-b877-9b4c7d236620-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.263413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.263333    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d90b11b-7c32-4644-b877-9b4c7d236620-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.263413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.263393    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d90b11b-7c32-4644-b877-9b4c7d236620-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.263745 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.263720    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d90b11b-7c32-4644-b877-9b4c7d236620-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.263802 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.263759    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d90b11b-7c32-4644-b877-9b4c7d236620-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.263855 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.263804    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d90b11b-7c32-4644-b877-9b4c7d236620-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.265569 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.265548    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d90b11b-7c32-4644-b877-9b4c7d236620-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.265923 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.265907    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d90b11b-7c32-4644-b877-9b4c7d236620-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.271212 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.271188    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dvx9\" (UniqueName: \"kubernetes.io/projected/8d90b11b-7c32-4644-b877-9b4c7d236620-kube-api-access-5dvx9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ckd2\" (UID: \"8d90b11b-7c32-4644-b877-9b4c7d236620\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.395234 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.395134    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:13:58.535955 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:58.535824    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"]
Jul 07 15:13:58.538761 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:13:58.538728    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d90b11b_7c32_4644_b877_9b4c7d236620.slice/crio-c7e01f91d7f2e5eac2f1302a79762565a6bc8a4624932b6ed94147138ff2d286 WatchSource:0}: Error finding container c7e01f91d7f2e5eac2f1302a79762565a6bc8a4624932b6ed94147138ff2d286: Status 404 returned error can't find the container with id c7e01f91d7f2e5eac2f1302a79762565a6bc8a4624932b6ed94147138ff2d286
Jul 07 15:13:59.028769 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:59.028716    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2" event={"ID":"8d90b11b-7c32-4644-b877-9b4c7d236620","Type":"ContainerStarted","Data":"5a721d7fccea439f25d3bfedafaf9400c974dac8d52dc7001dc73a602aa2166b"}
Jul 07 15:13:59.028968 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:59.028798    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2" event={"ID":"8d90b11b-7c32-4644-b877-9b4c7d236620","Type":"ContainerStarted","Data":"c7e01f91d7f2e5eac2f1302a79762565a6bc8a4624932b6ed94147138ff2d286"}
Jul 07 15:13:59.048486 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:59.048427    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2" podStartSLOduration=0.688866703 podStartE2EDuration="1.048411048s" totalImagesPullingTime="359.544345ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:59.047592961 +0000 UTC m=+798.781479354" watchObservedRunningTime="2026-07-07 15:13:59.048411048 +0000 UTC m=+798.782297430"
Jul 07 15:13:59.930807 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:59.930765    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:59.931247 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:59.930840    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:13:59.944411 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:13:59.944378    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:14:00.045379 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:00.045345    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8"
Jul 07 15:14:08.395980 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:08.395881    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:14:08.395980 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:08.395951    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:14:08.408873 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:08.408846    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:14:09.087269 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:09.087232    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ckd2"
Jul 07 15:14:43.893457 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:43.893421    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"]
Jul 07 15:14:43.897138 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:43.897113    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:43.899851 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:43.899822    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 15:14:43.907176 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:43.907146    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"]
Jul 07 15:14:43.959893 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:43.959849    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:43.960225 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:43.960189    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:43.960339 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:43.960292    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmq5d\" (UniqueName: \"kubernetes.io/projected/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-kube-api-access-dmq5d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:43.960339 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:43.960326    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:43.960431 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:43.960386    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:43.960474 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:43.960439    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:44.061409 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:44.061373    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:44.061409 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:44.061410    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:44.061664 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:44.061446    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmq5d\" (UniqueName: \"kubernetes.io/projected/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-kube-api-access-dmq5d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:44.061664 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:44.061464    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:44.061664 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:44.061598    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:44.061664 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:44.061662    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:44.061879 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:44.061813    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:44.061935 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:44.061912    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:44.062056 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:44.062027    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:44.063919 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:44.063895    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:44.064164 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:44.064148    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:44.069882 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:44.069853    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmq5d\" (UniqueName: \"kubernetes.io/projected/5b30b685-e5bf-4a87-b176-bcf9c12b8ad8-kube-api-access-dmq5d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn\" (UID: \"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:44.209196 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:44.209099    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:44.347890 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:44.347729    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"]
Jul 07 15:14:44.350852 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:14:44.350818    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b30b685_e5bf_4a87_b176_bcf9c12b8ad8.slice/crio-1a4f474ad3d65a9e0d67a942e664bf7b7ef370b89d9a9d97212d96ea430f30f1 WatchSource:0}: Error finding container 1a4f474ad3d65a9e0d67a942e664bf7b7ef370b89d9a9d97212d96ea430f30f1: Status 404 returned error can't find the container with id 1a4f474ad3d65a9e0d67a942e664bf7b7ef370b89d9a9d97212d96ea430f30f1
Jul 07 15:14:45.254989 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:45.254951    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn" event={"ID":"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8","Type":"ContainerStarted","Data":"665819e39235e1c99a5a926de401d23fb0877f7d37fa2f161f68e3bcd328fbec"}
Jul 07 15:14:45.255402 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:45.255028    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn" event={"ID":"5b30b685-e5bf-4a87-b176-bcf9c12b8ad8","Type":"ContainerStarted","Data":"1a4f474ad3d65a9e0d67a942e664bf7b7ef370b89d9a9d97212d96ea430f30f1"}
Jul 07 15:14:45.271416 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:45.271356    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn" podStartSLOduration=2.058467235 podStartE2EDuration="2.271334328s" totalImagesPullingTime="212.867093ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:14:45.27122067 +0000 UTC m=+845.005107053" watchObservedRunningTime="2026-07-07 15:14:45.271334328 +0000 UTC m=+845.005220711"
Jul 07 15:14:54.209925 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:54.209889    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:54.210340 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:54.209944    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:54.222343 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:54.222312    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:54.308122 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:54.308089    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn"
Jul 07 15:14:57.214450 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.214416    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"]
Jul 07 15:14:57.217999 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.217980    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.220196 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.220178    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 07 15:14:57.227739 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.227718    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"]
Jul 07 15:14:57.385895 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.385848    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.386097 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.385910    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.386097 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.385997    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.386097 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.386072    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrghr\" (UniqueName: \"kubernetes.io/projected/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-kube-api-access-vrghr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.386233 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.386132    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.386233 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.386189    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.487753 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.487666    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.487753 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.487707    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.487753 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.487738    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.488064 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.487763    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.488064 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.487787    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrghr\" (UniqueName: \"kubernetes.io/projected/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-kube-api-access-vrghr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.488064 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.487841    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.488267 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.488244    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.488267 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.488257    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.488345 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.488280    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.490022 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.489992    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.490225 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.490205    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.496920 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.496896    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrghr\" (UniqueName: \"kubernetes.io/projected/b4c1ff21-92d3-4ac3-8a70-ace731e25e65-kube-api-access-vrghr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r5kx2\" (UID: \"b4c1ff21-92d3-4ac3-8a70-ace731e25e65\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.530001 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.529959    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:14:57.670660 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:57.670628    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"]
Jul 07 15:14:57.673192 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:14:57.673166    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c1ff21_92d3_4ac3_8a70_ace731e25e65.slice/crio-d7d070fa617524a0fbb8c2001a40a8f1f06af8566e6739e41afe5af2439755de WatchSource:0}: Error finding container d7d070fa617524a0fbb8c2001a40a8f1f06af8566e6739e41afe5af2439755de: Status 404 returned error can't find the container with id d7d070fa617524a0fbb8c2001a40a8f1f06af8566e6739e41afe5af2439755de
Jul 07 15:14:58.317178 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:58.317142    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2" event={"ID":"b4c1ff21-92d3-4ac3-8a70-ace731e25e65","Type":"ContainerStarted","Data":"5b1d978e930ff0fb21d0838de9508f2f947c6a1762f79c760c28f4e0d5a5678b"}
Jul 07 15:14:58.317566 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:58.317203    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2" event={"ID":"b4c1ff21-92d3-4ac3-8a70-ace731e25e65","Type":"ContainerStarted","Data":"d7d070fa617524a0fbb8c2001a40a8f1f06af8566e6739e41afe5af2439755de"}
Jul 07 15:14:58.333875 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:14:58.333821    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2" podStartSLOduration=1.131066965 podStartE2EDuration="1.333802742s" totalImagesPullingTime="202.735777ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:14:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:14:58.33239488 +0000 UTC m=+858.066281263" watchObservedRunningTime="2026-07-07 15:14:58.333802742 +0000 UTC m=+858.067689121"
Jul 07 15:15:07.531052 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:07.530997    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:15:07.531514 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:07.531076    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:15:07.544138 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:07.544113    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:15:08.378904 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:08.378866    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r5kx2"
Jul 07 15:15:10.688901 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.688862    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"]
Jul 07 15:15:10.692900 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.692877    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.695232 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.695209    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 07 15:15:10.701878 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.701805    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"]
Jul 07 15:15:10.709720 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.709696    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539f6463-05cf-4308-a3ff-14c0aae30687-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.709849 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.709733    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dltq\" (UniqueName: \"kubernetes.io/projected/539f6463-05cf-4308-a3ff-14c0aae30687-kube-api-access-5dltq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.709849 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.709759    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539f6463-05cf-4308-a3ff-14c0aae30687-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.709849 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.709839    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539f6463-05cf-4308-a3ff-14c0aae30687-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.710040 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.709879    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539f6463-05cf-4308-a3ff-14c0aae30687-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.710040 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.709912    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539f6463-05cf-4308-a3ff-14c0aae30687-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.810342 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.810307    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539f6463-05cf-4308-a3ff-14c0aae30687-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.810342 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.810351    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539f6463-05cf-4308-a3ff-14c0aae30687-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.810622 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.810382    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539f6463-05cf-4308-a3ff-14c0aae30687-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.810622 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.810410    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dltq\" (UniqueName: \"kubernetes.io/projected/539f6463-05cf-4308-a3ff-14c0aae30687-kube-api-access-5dltq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.810622 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.810439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539f6463-05cf-4308-a3ff-14c0aae30687-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.810622 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.810484    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539f6463-05cf-4308-a3ff-14c0aae30687-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.810893 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.810844    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539f6463-05cf-4308-a3ff-14c0aae30687-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.810952 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.810850    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539f6463-05cf-4308-a3ff-14c0aae30687-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.810991 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.810959    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539f6463-05cf-4308-a3ff-14c0aae30687-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.812865 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.812843    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539f6463-05cf-4308-a3ff-14c0aae30687-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.813178 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.813158    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539f6463-05cf-4308-a3ff-14c0aae30687-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:10.818020 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:10.817989    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dltq\" (UniqueName: \"kubernetes.io/projected/539f6463-05cf-4308-a3ff-14c0aae30687-kube-api-access-5dltq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2\" (UID: \"539f6463-05cf-4308-a3ff-14c0aae30687\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:11.004603 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:11.004506    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:11.145273 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:11.145180    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"]
Jul 07 15:15:11.148103 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:15:11.148074    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod539f6463_05cf_4308_a3ff_14c0aae30687.slice/crio-449abebd2d3ac4a278fdfec10bf9dcebe112af12783df35e766dd073a094c821 WatchSource:0}: Error finding container 449abebd2d3ac4a278fdfec10bf9dcebe112af12783df35e766dd073a094c821: Status 404 returned error can't find the container with id 449abebd2d3ac4a278fdfec10bf9dcebe112af12783df35e766dd073a094c821
Jul 07 15:15:11.381911 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:11.381877    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2" event={"ID":"539f6463-05cf-4308-a3ff-14c0aae30687","Type":"ContainerStarted","Data":"449abebd2d3ac4a278fdfec10bf9dcebe112af12783df35e766dd073a094c821"}
Jul 07 15:15:12.388842 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:12.388805    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2" event={"ID":"539f6463-05cf-4308-a3ff-14c0aae30687","Type":"ContainerStarted","Data":"df78bc1250283b9f3ec24488a687305f384cc2116dc102846ec334ca0e22624a"}
Jul 07 15:15:12.406811 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:12.406752    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2" podStartSLOduration=2.130860978 podStartE2EDuration="2.406736639s" totalImagesPullingTime="275.875661ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:15:12.405670134 +0000 UTC m=+872.139556517" watchObservedRunningTime="2026-07-07 15:15:12.406736639 +0000 UTC m=+872.140623021"
Jul 07 15:15:21.004999 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:21.004952    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:21.005637 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:21.005057    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:21.018039 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:21.017992    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:21.453355 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:21.453325    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2"
Jul 07 15:15:40.724299 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:40.724265    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:15:40.726239 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:15:40.726220    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:17:34.221326 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:34.221211    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79565bf89-8v9kx"]
Jul 07 15:17:34.221922 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:34.221464    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-79565bf89-8v9kx" podUID="dc023bd2-6fb6-41de-94de-e7e22f3ff9a8" containerName="manager" containerID="cri-o://94d784b39031370de23e0a71e181dcea1b1feb09ffbc5fa367d7b7e641a49bd7" gracePeriod=30
Jul 07 15:17:34.465172 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:34.465138    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79565bf89-8v9kx"
Jul 07 15:17:34.508104 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:34.507997    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc023bd2-6fb6-41de-94de-e7e22f3ff9a8-webhook-cert\") pod \"dc023bd2-6fb6-41de-94de-e7e22f3ff9a8\" (UID: \"dc023bd2-6fb6-41de-94de-e7e22f3ff9a8\") "
Jul 07 15:17:34.508275 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:34.508144    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kftzr\" (UniqueName: \"kubernetes.io/projected/dc023bd2-6fb6-41de-94de-e7e22f3ff9a8-kube-api-access-kftzr\") pod \"dc023bd2-6fb6-41de-94de-e7e22f3ff9a8\" (UID: \"dc023bd2-6fb6-41de-94de-e7e22f3ff9a8\") "
Jul 07 15:17:34.510191 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:34.510150    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc023bd2-6fb6-41de-94de-e7e22f3ff9a8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dc023bd2-6fb6-41de-94de-e7e22f3ff9a8" (UID: "dc023bd2-6fb6-41de-94de-e7e22f3ff9a8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:17:34.510191 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:34.510151    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc023bd2-6fb6-41de-94de-e7e22f3ff9a8-kube-api-access-kftzr" (OuterVolumeSpecName: "kube-api-access-kftzr") pod "dc023bd2-6fb6-41de-94de-e7e22f3ff9a8" (UID: "dc023bd2-6fb6-41de-94de-e7e22f3ff9a8"). InnerVolumeSpecName "kube-api-access-kftzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:17:34.609482 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:34.609435    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kftzr\" (UniqueName: \"kubernetes.io/projected/dc023bd2-6fb6-41de-94de-e7e22f3ff9a8-kube-api-access-kftzr\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:17:34.609482 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:34.609473    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc023bd2-6fb6-41de-94de-e7e22f3ff9a8-webhook-cert\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:17:35.101646 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.101612    2574 generic.go:356] "Generic (PLEG): container finished" podID="dc023bd2-6fb6-41de-94de-e7e22f3ff9a8" containerID="94d784b39031370de23e0a71e181dcea1b1feb09ffbc5fa367d7b7e641a49bd7" exitCode=0
Jul 07 15:17:35.101832 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.101653    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79565bf89-8v9kx"
Jul 07 15:17:35.101832 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.101703    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79565bf89-8v9kx" event={"ID":"dc023bd2-6fb6-41de-94de-e7e22f3ff9a8","Type":"ContainerDied","Data":"94d784b39031370de23e0a71e181dcea1b1feb09ffbc5fa367d7b7e641a49bd7"}
Jul 07 15:17:35.101832 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.101755    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79565bf89-8v9kx" event={"ID":"dc023bd2-6fb6-41de-94de-e7e22f3ff9a8","Type":"ContainerDied","Data":"655da47eeebec1e8acfa42974e0432ee9bc9fe420ecbf2f03a30a44695d377c0"}
Jul 07 15:17:35.101832 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.101780    2574 scope.go:117] "RemoveContainer" containerID="94d784b39031370de23e0a71e181dcea1b1feb09ffbc5fa367d7b7e641a49bd7"
Jul 07 15:17:35.110347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.110329    2574 scope.go:117] "RemoveContainer" containerID="94d784b39031370de23e0a71e181dcea1b1feb09ffbc5fa367d7b7e641a49bd7"
Jul 07 15:17:35.110642 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:17:35.110620    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94d784b39031370de23e0a71e181dcea1b1feb09ffbc5fa367d7b7e641a49bd7\": container with ID starting with 94d784b39031370de23e0a71e181dcea1b1feb09ffbc5fa367d7b7e641a49bd7 not found: ID does not exist" containerID="94d784b39031370de23e0a71e181dcea1b1feb09ffbc5fa367d7b7e641a49bd7"
Jul 07 15:17:35.110715 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.110654    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94d784b39031370de23e0a71e181dcea1b1feb09ffbc5fa367d7b7e641a49bd7"} err="failed to get container status \"94d784b39031370de23e0a71e181dcea1b1feb09ffbc5fa367d7b7e641a49bd7\": rpc error: code = NotFound desc = could not find container \"94d784b39031370de23e0a71e181dcea1b1feb09ffbc5fa367d7b7e641a49bd7\": container with ID starting with 94d784b39031370de23e0a71e181dcea1b1feb09ffbc5fa367d7b7e641a49bd7 not found: ID does not exist"
Jul 07 15:17:35.118641 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.118617    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79565bf89-8v9kx"]
Jul 07 15:17:35.121290 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.121263    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79565bf89-8v9kx"]
Jul 07 15:17:35.932318 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.932279    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79565bf89-7v2kc"]
Jul 07 15:17:35.932712 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.932669    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc023bd2-6fb6-41de-94de-e7e22f3ff9a8" containerName="manager"
Jul 07 15:17:35.932712 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.932681    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc023bd2-6fb6-41de-94de-e7e22f3ff9a8" containerName="manager"
Jul 07 15:17:35.932782 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.932752    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc023bd2-6fb6-41de-94de-e7e22f3ff9a8" containerName="manager"
Jul 07 15:17:35.937191 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.937164    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79565bf89-7v2kc"
Jul 07 15:17:35.940169 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.940143    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 15:17:35.940350 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.940159    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 15:17:35.940467 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.940221    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gbsdv\""
Jul 07 15:17:35.944000 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:35.943973    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79565bf89-7v2kc"]
Jul 07 15:17:36.023159 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:36.023114    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36a58b23-fe35-4bb7-91d5-7a181791954f-webhook-cert\") pod \"maas-controller-79565bf89-7v2kc\" (UID: \"36a58b23-fe35-4bb7-91d5-7a181791954f\") " pod="opendatahub/maas-controller-79565bf89-7v2kc"
Jul 07 15:17:36.023357 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:36.023166    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkhwc\" (UniqueName: \"kubernetes.io/projected/36a58b23-fe35-4bb7-91d5-7a181791954f-kube-api-access-wkhwc\") pod \"maas-controller-79565bf89-7v2kc\" (UID: \"36a58b23-fe35-4bb7-91d5-7a181791954f\") " pod="opendatahub/maas-controller-79565bf89-7v2kc"
Jul 07 15:17:36.124423 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:36.124385    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36a58b23-fe35-4bb7-91d5-7a181791954f-webhook-cert\") pod \"maas-controller-79565bf89-7v2kc\" (UID: \"36a58b23-fe35-4bb7-91d5-7a181791954f\") " pod="opendatahub/maas-controller-79565bf89-7v2kc"
Jul 07 15:17:36.124423 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:36.124425    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkhwc\" (UniqueName: \"kubernetes.io/projected/36a58b23-fe35-4bb7-91d5-7a181791954f-kube-api-access-wkhwc\") pod \"maas-controller-79565bf89-7v2kc\" (UID: \"36a58b23-fe35-4bb7-91d5-7a181791954f\") " pod="opendatahub/maas-controller-79565bf89-7v2kc"
Jul 07 15:17:36.126878 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:36.126854    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36a58b23-fe35-4bb7-91d5-7a181791954f-webhook-cert\") pod \"maas-controller-79565bf89-7v2kc\" (UID: \"36a58b23-fe35-4bb7-91d5-7a181791954f\") " pod="opendatahub/maas-controller-79565bf89-7v2kc"
Jul 07 15:17:36.132537 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:36.132511    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkhwc\" (UniqueName: \"kubernetes.io/projected/36a58b23-fe35-4bb7-91d5-7a181791954f-kube-api-access-wkhwc\") pod \"maas-controller-79565bf89-7v2kc\" (UID: \"36a58b23-fe35-4bb7-91d5-7a181791954f\") " pod="opendatahub/maas-controller-79565bf89-7v2kc"
Jul 07 15:17:36.249785 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:36.249695    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79565bf89-7v2kc"
Jul 07 15:17:36.389122 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:36.389097    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79565bf89-7v2kc"]
Jul 07 15:17:36.391019 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:17:36.390972    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a58b23_fe35_4bb7_91d5_7a181791954f.slice/crio-44c0ee6ef1593801cb44a1ddb2b3ec5573b18f6c5ba0ab21c1ec7b91e0ae9c07 WatchSource:0}: Error finding container 44c0ee6ef1593801cb44a1ddb2b3ec5573b18f6c5ba0ab21c1ec7b91e0ae9c07: Status 404 returned error can't find the container with id 44c0ee6ef1593801cb44a1ddb2b3ec5573b18f6c5ba0ab21c1ec7b91e0ae9c07
Jul 07 15:17:36.392305 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:36.392286    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:17:36.867749 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:36.867707    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc023bd2-6fb6-41de-94de-e7e22f3ff9a8" path="/var/lib/kubelet/pods/dc023bd2-6fb6-41de-94de-e7e22f3ff9a8/volumes"
Jul 07 15:17:37.114105 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:37.114064    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79565bf89-7v2kc" event={"ID":"36a58b23-fe35-4bb7-91d5-7a181791954f","Type":"ContainerStarted","Data":"44c0ee6ef1593801cb44a1ddb2b3ec5573b18f6c5ba0ab21c1ec7b91e0ae9c07"}
Jul 07 15:17:38.120645 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:38.120608    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79565bf89-7v2kc" event={"ID":"36a58b23-fe35-4bb7-91d5-7a181791954f","Type":"ContainerStarted","Data":"705c2ee5ca06acdbc159b97fc6b2cd4c230d8fcae13c132c8a25d819ca0bef34"}
Jul 07 15:17:38.121089 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:38.120740    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79565bf89-7v2kc"
Jul 07 15:17:38.137117 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:38.137051    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79565bf89-7v2kc" podStartSLOduration=1.831380821 podStartE2EDuration="3.136993521s" totalImagesPullingTime="1.3056127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:17:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:17:38.136878191 +0000 UTC m=+1017.870764576" watchObservedRunningTime="2026-07-07 15:17:38.136993521 +0000 UTC m=+1017.870879901"
Jul 07 15:17:49.131577 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:17:49.131546    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79565bf89-7v2kc"
Jul 07 15:20:40.754525 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:20:40.754492    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:20:40.757312 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:20:40.757293    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:22:23.382147 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:23.382109    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"]
Jul 07 15:22:23.382731 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:23.382332    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx" podUID="dc8bc622-63fa-4e07-bed6-17b8a1ede10d" containerName="manager" containerID="cri-o://283745779e7e6276cf69b3f5d9e4096b8f7a01875d212f3ddf1ffd80c8f8ab4e" gracePeriod=10
Jul 07 15:22:26.743915 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:26.743887    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"
Jul 07 15:22:26.887407 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:26.887316    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96nf7\" (UniqueName: \"kubernetes.io/projected/dc8bc622-63fa-4e07-bed6-17b8a1ede10d-kube-api-access-96nf7\") pod \"dc8bc622-63fa-4e07-bed6-17b8a1ede10d\" (UID: \"dc8bc622-63fa-4e07-bed6-17b8a1ede10d\") "
Jul 07 15:22:26.887407 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:26.887393    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc8bc622-63fa-4e07-bed6-17b8a1ede10d-extensions-socket-volume\") pod \"dc8bc622-63fa-4e07-bed6-17b8a1ede10d\" (UID: \"dc8bc622-63fa-4e07-bed6-17b8a1ede10d\") "
Jul 07 15:22:26.887797 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:26.887773    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc8bc622-63fa-4e07-bed6-17b8a1ede10d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dc8bc622-63fa-4e07-bed6-17b8a1ede10d" (UID: "dc8bc622-63fa-4e07-bed6-17b8a1ede10d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:22:26.889444 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:26.889420    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc8bc622-63fa-4e07-bed6-17b8a1ede10d-kube-api-access-96nf7" (OuterVolumeSpecName: "kube-api-access-96nf7") pod "dc8bc622-63fa-4e07-bed6-17b8a1ede10d" (UID: "dc8bc622-63fa-4e07-bed6-17b8a1ede10d"). InnerVolumeSpecName "kube-api-access-96nf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:22:26.988453 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:26.988420    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96nf7\" (UniqueName: \"kubernetes.io/projected/dc8bc622-63fa-4e07-bed6-17b8a1ede10d-kube-api-access-96nf7\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:22:26.988453 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:26.988448    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc8bc622-63fa-4e07-bed6-17b8a1ede10d-extensions-socket-volume\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:22:27.544925 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:27.544886    2574 generic.go:356] "Generic (PLEG): container finished" podID="dc8bc622-63fa-4e07-bed6-17b8a1ede10d" containerID="283745779e7e6276cf69b3f5d9e4096b8f7a01875d212f3ddf1ffd80c8f8ab4e" exitCode=0
Jul 07 15:22:27.545120 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:27.544933    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"
Jul 07 15:22:27.545120 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:27.544965    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx" event={"ID":"dc8bc622-63fa-4e07-bed6-17b8a1ede10d","Type":"ContainerDied","Data":"283745779e7e6276cf69b3f5d9e4096b8f7a01875d212f3ddf1ffd80c8f8ab4e"}
Jul 07 15:22:27.545120 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:27.545042    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx" event={"ID":"dc8bc622-63fa-4e07-bed6-17b8a1ede10d","Type":"ContainerDied","Data":"839e7b16e782f81eabc82c607fba89e12d200ebdd9e317ce24654e16d871327f"}
Jul 07 15:22:27.545120 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:27.545075    2574 scope.go:117] "RemoveContainer" containerID="283745779e7e6276cf69b3f5d9e4096b8f7a01875d212f3ddf1ffd80c8f8ab4e"
Jul 07 15:22:27.557689 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:27.557669    2574 scope.go:117] "RemoveContainer" containerID="283745779e7e6276cf69b3f5d9e4096b8f7a01875d212f3ddf1ffd80c8f8ab4e"
Jul 07 15:22:27.558036 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:22:27.557990    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"283745779e7e6276cf69b3f5d9e4096b8f7a01875d212f3ddf1ffd80c8f8ab4e\": container with ID starting with 283745779e7e6276cf69b3f5d9e4096b8f7a01875d212f3ddf1ffd80c8f8ab4e not found: ID does not exist" containerID="283745779e7e6276cf69b3f5d9e4096b8f7a01875d212f3ddf1ffd80c8f8ab4e"
Jul 07 15:22:27.558128 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:27.558047    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"283745779e7e6276cf69b3f5d9e4096b8f7a01875d212f3ddf1ffd80c8f8ab4e"} err="failed to get container status \"283745779e7e6276cf69b3f5d9e4096b8f7a01875d212f3ddf1ffd80c8f8ab4e\": rpc error: code = NotFound desc = could not find container \"283745779e7e6276cf69b3f5d9e4096b8f7a01875d212f3ddf1ffd80c8f8ab4e\": container with ID starting with 283745779e7e6276cf69b3f5d9e4096b8f7a01875d212f3ddf1ffd80c8f8ab4e not found: ID does not exist"
Jul 07 15:22:27.572310 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:27.569877    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"]
Jul 07 15:22:27.575479 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:27.575452    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bksbx"]
Jul 07 15:22:28.867815 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:22:28.867780    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc8bc622-63fa-4e07-bed6-17b8a1ede10d" path="/var/lib/kubelet/pods/dc8bc622-63fa-4e07-bed6-17b8a1ede10d/volumes"
Jul 07 15:23:24.675135 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:24.675050    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4"]
Jul 07 15:23:24.675617 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:24.675450    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc8bc622-63fa-4e07-bed6-17b8a1ede10d" containerName="manager"
Jul 07 15:23:24.675617 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:24.675462    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc8bc622-63fa-4e07-bed6-17b8a1ede10d" containerName="manager"
Jul 07 15:23:24.675617 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:24.675537    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc8bc622-63fa-4e07-bed6-17b8a1ede10d" containerName="manager"
Jul 07 15:23:24.678521 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:24.678505    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4"
Jul 07 15:23:24.681109 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:24.681091    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zwpmq\""
Jul 07 15:23:24.693696 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:24.693672    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4"]
Jul 07 15:23:24.824856 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:24.824817    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fee9d09-aa4c-4210-8b31-b4088c9176d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hn5f4\" (UID: \"9fee9d09-aa4c-4210-8b31-b4088c9176d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4"
Jul 07 15:23:24.825053 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:24.824864    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66zpr\" (UniqueName: \"kubernetes.io/projected/9fee9d09-aa4c-4210-8b31-b4088c9176d2-kube-api-access-66zpr\") pod \"kuadrant-operator-controller-manager-86878c769f-hn5f4\" (UID: \"9fee9d09-aa4c-4210-8b31-b4088c9176d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4"
Jul 07 15:23:24.925941 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:24.925843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66zpr\" (UniqueName: \"kubernetes.io/projected/9fee9d09-aa4c-4210-8b31-b4088c9176d2-kube-api-access-66zpr\") pod \"kuadrant-operator-controller-manager-86878c769f-hn5f4\" (UID: \"9fee9d09-aa4c-4210-8b31-b4088c9176d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4"
Jul 07 15:23:24.926120 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:24.925954    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fee9d09-aa4c-4210-8b31-b4088c9176d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hn5f4\" (UID: \"9fee9d09-aa4c-4210-8b31-b4088c9176d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4"
Jul 07 15:23:24.926356 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:24.926338    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fee9d09-aa4c-4210-8b31-b4088c9176d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hn5f4\" (UID: \"9fee9d09-aa4c-4210-8b31-b4088c9176d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4"
Jul 07 15:23:24.939830 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:24.939802    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66zpr\" (UniqueName: \"kubernetes.io/projected/9fee9d09-aa4c-4210-8b31-b4088c9176d2-kube-api-access-66zpr\") pod \"kuadrant-operator-controller-manager-86878c769f-hn5f4\" (UID: \"9fee9d09-aa4c-4210-8b31-b4088c9176d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4"
Jul 07 15:23:24.988649 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:24.988604    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4"
Jul 07 15:23:25.133347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:25.133168    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4"]
Jul 07 15:23:25.136374 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:23:25.136341    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fee9d09_aa4c_4210_8b31_b4088c9176d2.slice/crio-5cc46cb322b4c77c199efe36ba45df4062eefcf8e06679aa3374b9675418ac3d WatchSource:0}: Error finding container 5cc46cb322b4c77c199efe36ba45df4062eefcf8e06679aa3374b9675418ac3d: Status 404 returned error can't find the container with id 5cc46cb322b4c77c199efe36ba45df4062eefcf8e06679aa3374b9675418ac3d
Jul 07 15:23:25.832825 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:25.832786    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4" event={"ID":"9fee9d09-aa4c-4210-8b31-b4088c9176d2","Type":"ContainerStarted","Data":"33cb58dda72b24b2cadcb967597937be60045e7166275d1f55773ad0189c54ce"}
Jul 07 15:23:25.833339 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:25.832839    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4" event={"ID":"9fee9d09-aa4c-4210-8b31-b4088c9176d2","Type":"ContainerStarted","Data":"5cc46cb322b4c77c199efe36ba45df4062eefcf8e06679aa3374b9675418ac3d"}
Jul 07 15:23:25.833339 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:25.832945    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4"
Jul 07 15:23:25.862961 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:25.862909    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4" podStartSLOduration=1.862894294 podStartE2EDuration="1.862894294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:23:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:23:25.859505622 +0000 UTC m=+1365.593392005" watchObservedRunningTime="2026-07-07 15:23:25.862894294 +0000 UTC m=+1365.596780676"
Jul 07 15:23:36.840767 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:23:36.840733    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hn5f4"
Jul 07 15:25:40.787311 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:25:40.787286    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:25:40.791563 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:25:40.791541    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:30:07.819087 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:07.819050    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"]
Jul 07 15:30:07.822856 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:07.822833    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"
Jul 07 15:30:07.825477 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:07.825452    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-migrate-e1d0e765-serving-cert\""
Jul 07 15:30:07.834640 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:07.834614    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"]
Jul 07 15:30:07.946815 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:07.946778    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f8766b-2d99-4f97-8bfb-b52b3bf543de-openshift-service-ca\") pod \"maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg\" (UID: \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\") " pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"
Jul 07 15:30:07.946992 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:07.946835    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xflht\" (UniqueName: \"kubernetes.io/projected/17f8766b-2d99-4f97-8bfb-b52b3bf543de-kube-api-access-xflht\") pod \"maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg\" (UID: \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\") " pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"
Jul 07 15:30:07.946992 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:07.946954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f8766b-2d99-4f97-8bfb-b52b3bf543de-maas-api-tls\") pod \"maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg\" (UID: \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\") " pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"
Jul 07 15:30:08.048513 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:08.048471    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f8766b-2d99-4f97-8bfb-b52b3bf543de-openshift-service-ca\") pod \"maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg\" (UID: \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\") " pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"
Jul 07 15:30:08.048916 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:08.048532    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xflht\" (UniqueName: \"kubernetes.io/projected/17f8766b-2d99-4f97-8bfb-b52b3bf543de-kube-api-access-xflht\") pod \"maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg\" (UID: \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\") " pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"
Jul 07 15:30:08.048916 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:08.048594    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f8766b-2d99-4f97-8bfb-b52b3bf543de-maas-api-tls\") pod \"maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg\" (UID: \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\") " pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"
Jul 07 15:30:08.049249 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:08.049225    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f8766b-2d99-4f97-8bfb-b52b3bf543de-openshift-service-ca\") pod \"maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg\" (UID: \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\") " pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"
Jul 07 15:30:08.051215 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:08.051183    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f8766b-2d99-4f97-8bfb-b52b3bf543de-maas-api-tls\") pod \"maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg\" (UID: \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\") " pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"
Jul 07 15:30:08.056679 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:08.056646    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xflht\" (UniqueName: \"kubernetes.io/projected/17f8766b-2d99-4f97-8bfb-b52b3bf543de-kube-api-access-xflht\") pod \"maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg\" (UID: \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\") " pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"
Jul 07 15:30:08.134501 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:08.134402    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"
Jul 07 15:30:08.289397 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:08.289361    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"]
Jul 07 15:30:08.292597 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:30:08.292560    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f8766b_2d99_4f97_8bfb_b52b3bf543de.slice/crio-63629260cdeeeec18dc61456306e0e032971d92b89ae1f05b00fa8826b17cae9 WatchSource:0}: Error finding container 63629260cdeeeec18dc61456306e0e032971d92b89ae1f05b00fa8826b17cae9: Status 404 returned error can't find the container with id 63629260cdeeeec18dc61456306e0e032971d92b89ae1f05b00fa8826b17cae9
Jul 07 15:30:08.294119 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:08.294099    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:30:08.811909 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:08.811875    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg" event={"ID":"17f8766b-2d99-4f97-8bfb-b52b3bf543de","Type":"ContainerStarted","Data":"0bcf0590eff7ce1d6ec9e222701f5aa1fc778f3dfca043ef92d1980bee3494c5"}
Jul 07 15:30:08.812150 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:08.811926    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg" event={"ID":"17f8766b-2d99-4f97-8bfb-b52b3bf543de","Type":"ContainerStarted","Data":"63629260cdeeeec18dc61456306e0e032971d92b89ae1f05b00fa8826b17cae9"}
Jul 07 15:30:08.812150 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:08.812030    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"
Jul 07 15:30:08.835577 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:08.835523    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg" podStartSLOduration=1.409124287 podStartE2EDuration="1.835504967s" totalImagesPullingTime="426.38068ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:08.833277133 +0000 UTC m=+1768.567163518" watchObservedRunningTime="2026-07-07 15:30:08.835504967 +0000 UTC m=+1768.569391349"
Jul 07 15:30:12.772841 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:12.772807    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"]
Jul 07 15:30:12.773300 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:12.772995    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg" podUID="17f8766b-2d99-4f97-8bfb-b52b3bf543de" containerName="maas-api" containerID="cri-o://0bcf0590eff7ce1d6ec9e222701f5aa1fc778f3dfca043ef92d1980bee3494c5" gracePeriod=30
Jul 07 15:30:13.033251 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.033221    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"
Jul 07 15:30:13.203912 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.203872    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f8766b-2d99-4f97-8bfb-b52b3bf543de-maas-api-tls\") pod \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\" (UID: \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\") "
Jul 07 15:30:13.204110 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.203988    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xflht\" (UniqueName: \"kubernetes.io/projected/17f8766b-2d99-4f97-8bfb-b52b3bf543de-kube-api-access-xflht\") pod \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\" (UID: \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\") "
Jul 07 15:30:13.204110 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.204044    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f8766b-2d99-4f97-8bfb-b52b3bf543de-openshift-service-ca\") pod \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\" (UID: \"17f8766b-2d99-4f97-8bfb-b52b3bf543de\") "
Jul 07 15:30:13.204445 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.204415    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f8766b-2d99-4f97-8bfb-b52b3bf543de-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "17f8766b-2d99-4f97-8bfb-b52b3bf543de" (UID: "17f8766b-2d99-4f97-8bfb-b52b3bf543de"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:30:13.205988 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.205962    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17f8766b-2d99-4f97-8bfb-b52b3bf543de-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "17f8766b-2d99-4f97-8bfb-b52b3bf543de" (UID: "17f8766b-2d99-4f97-8bfb-b52b3bf543de"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:30:13.206102 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.206047    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f8766b-2d99-4f97-8bfb-b52b3bf543de-kube-api-access-xflht" (OuterVolumeSpecName: "kube-api-access-xflht") pod "17f8766b-2d99-4f97-8bfb-b52b3bf543de" (UID: "17f8766b-2d99-4f97-8bfb-b52b3bf543de"). InnerVolumeSpecName "kube-api-access-xflht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:30:13.305349 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.305249    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xflht\" (UniqueName: \"kubernetes.io/projected/17f8766b-2d99-4f97-8bfb-b52b3bf543de-kube-api-access-xflht\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:30:13.305349 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.305282    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f8766b-2d99-4f97-8bfb-b52b3bf543de-openshift-service-ca\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:30:13.305349 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.305294    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f8766b-2d99-4f97-8bfb-b52b3bf543de-maas-api-tls\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:30:13.837986 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.837947    2574 generic.go:356] "Generic (PLEG): container finished" podID="17f8766b-2d99-4f97-8bfb-b52b3bf543de" containerID="0bcf0590eff7ce1d6ec9e222701f5aa1fc778f3dfca043ef92d1980bee3494c5" exitCode=0
Jul 07 15:30:13.838517 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.838024    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"
Jul 07 15:30:13.838517 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.838036    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg" event={"ID":"17f8766b-2d99-4f97-8bfb-b52b3bf543de","Type":"ContainerDied","Data":"0bcf0590eff7ce1d6ec9e222701f5aa1fc778f3dfca043ef92d1980bee3494c5"}
Jul 07 15:30:13.838517 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.838103    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg" event={"ID":"17f8766b-2d99-4f97-8bfb-b52b3bf543de","Type":"ContainerDied","Data":"63629260cdeeeec18dc61456306e0e032971d92b89ae1f05b00fa8826b17cae9"}
Jul 07 15:30:13.838517 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.838138    2574 scope.go:117] "RemoveContainer" containerID="0bcf0590eff7ce1d6ec9e222701f5aa1fc778f3dfca043ef92d1980bee3494c5"
Jul 07 15:30:13.848537 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.848516    2574 scope.go:117] "RemoveContainer" containerID="0bcf0590eff7ce1d6ec9e222701f5aa1fc778f3dfca043ef92d1980bee3494c5"
Jul 07 15:30:13.848872 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:30:13.848853    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bcf0590eff7ce1d6ec9e222701f5aa1fc778f3dfca043ef92d1980bee3494c5\": container with ID starting with 0bcf0590eff7ce1d6ec9e222701f5aa1fc778f3dfca043ef92d1980bee3494c5 not found: ID does not exist" containerID="0bcf0590eff7ce1d6ec9e222701f5aa1fc778f3dfca043ef92d1980bee3494c5"
Jul 07 15:30:13.848931 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.848881    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bcf0590eff7ce1d6ec9e222701f5aa1fc778f3dfca043ef92d1980bee3494c5"} err="failed to get container status \"0bcf0590eff7ce1d6ec9e222701f5aa1fc778f3dfca043ef92d1980bee3494c5\": rpc error: code = NotFound desc = could not find container \"0bcf0590eff7ce1d6ec9e222701f5aa1fc778f3dfca043ef92d1980bee3494c5\": container with ID starting with 0bcf0590eff7ce1d6ec9e222701f5aa1fc778f3dfca043ef92d1980bee3494c5 not found: ID does not exist"
Jul 07 15:30:13.862306 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.862255    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"]
Jul 07 15:30:13.864073 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:13.864046    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-migrate-e1d0e765-9d794bf8b-ds8tg"]
Jul 07 15:30:14.867341 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:14.867307    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17f8766b-2d99-4f97-8bfb-b52b3bf543de" path="/var/lib/kubelet/pods/17f8766b-2d99-4f97-8bfb-b52b3bf543de/volumes"
Jul 07 15:30:18.943437 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:18.943396    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"]
Jul 07 15:30:18.944602 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:18.944575    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f8766b-2d99-4f97-8bfb-b52b3bf543de" containerName="maas-api"
Jul 07 15:30:18.944779 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:18.944765    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f8766b-2d99-4f97-8bfb-b52b3bf543de" containerName="maas-api"
Jul 07 15:30:18.945023 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:18.944974    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f8766b-2d99-4f97-8bfb-b52b3bf543de" containerName="maas-api"
Jul 07 15:30:18.949843 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:18.949817    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:18.952298 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:18.952272    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-61334271-openshift-default-dockercfg-m2w49\""
Jul 07 15:30:18.962566 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:18.962536    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"]
Jul 07 15:30:19.053516 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.053478    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-credential-socket\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.053516 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.053516    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-podinfo\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.053733 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.053537    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-workload-certs\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.053733 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.053606    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istiod-ca-cert\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.053733 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.053667    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-workload-socket\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.053733 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.053701    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-token\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.053866 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.053754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-data\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.053866 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.053770    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5cf5\" (UniqueName: \"kubernetes.io/projected/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-kube-api-access-n5cf5\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.053866 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.053796    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-envoy\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.154306 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.154275    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-data\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.154306 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.154309    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5cf5\" (UniqueName: \"kubernetes.io/projected/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-kube-api-access-n5cf5\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.154558 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.154332    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-envoy\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.154558 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.154377    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-credential-socket\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.154558 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.154470    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-podinfo\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.154558 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.154535    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-workload-certs\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.154815 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.154577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istiod-ca-cert\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.154815 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.154617    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-workload-socket\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.154815 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.154660    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-token\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.154815 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.154798    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-data\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.155081 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.154831    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-credential-socket\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.155081 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.154872    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-workload-certs\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.155195 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.155112    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-workload-socket\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.155309 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.155292    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istiod-ca-cert\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.156816 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.156790    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-envoy\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.156924 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.156893    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-podinfo\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.163803 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.163776    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-token\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.164044 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.163988    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5cf5\" (UniqueName: \"kubernetes.io/projected/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-kube-api-access-n5cf5\") pod \"e2e-ait-61334271-openshift-default-7b8496d9-j7w7x\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") " pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.262172 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.262072    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:19.455767 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.455741    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"]
Jul 07 15:30:19.460659 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:30:19.460588    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cefaa2a_719e_498a_8e6a_b772bfcac5d7.slice/crio-3c757c5dc17739468acc3f42ba7670344b068b30a2705c04c12d252c7acb8e46 WatchSource:0}: Error finding container 3c757c5dc17739468acc3f42ba7670344b068b30a2705c04c12d252c7acb8e46: Status 404 returned error can't find the container with id 3c757c5dc17739468acc3f42ba7670344b068b30a2705c04c12d252c7acb8e46
Jul 07 15:30:19.462549 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.462511    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 15:30:19.462652 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.462580    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 15:30:19.462652 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.462608    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 15:30:19.873720 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.873684    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x" event={"ID":"0cefaa2a-719e-498a-8e6a-b772bfcac5d7","Type":"ContainerStarted","Data":"b6bdf70139366ebb767be94cbe8c7818423c63f543f8e22cd8d01dc1a00ceb45"}
Jul 07 15:30:19.873947 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.873749    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x" event={"ID":"0cefaa2a-719e-498a-8e6a-b772bfcac5d7","Type":"ContainerStarted","Data":"3c757c5dc17739468acc3f42ba7670344b068b30a2705c04c12d252c7acb8e46"}
Jul 07 15:30:19.901486 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:19.901435    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x" podStartSLOduration=1.901417759 podStartE2EDuration="1.901417759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:19.900356977 +0000 UTC m=+1779.634243403" watchObservedRunningTime="2026-07-07 15:30:19.901417759 +0000 UTC m=+1779.635304141"
Jul 07 15:30:20.263149 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:20.263055    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:20.267983 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:20.267955    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:20.878170 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:20.878137    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:20.879237 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:20.879219    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:31.457522 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:31.457486    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"]
Jul 07 15:30:31.457986 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:31.457721    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x" podUID="0cefaa2a-719e-498a-8e6a-b772bfcac5d7" containerName="istio-proxy" containerID="cri-o://b6bdf70139366ebb767be94cbe8c7818423c63f543f8e22cd8d01dc1a00ceb45" gracePeriod=30
Jul 07 15:30:32.699945 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.699919    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:32.790129 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790101    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-envoy\") pod \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") "
Jul 07 15:30:32.790288 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790140    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-workload-socket\") pod \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") "
Jul 07 15:30:32.790288 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790173    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-workload-certs\") pod \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") "
Jul 07 15:30:32.790288 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790198    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istiod-ca-cert\") pod \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") "
Jul 07 15:30:32.790288 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790262    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-podinfo\") pod \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") "
Jul 07 15:30:32.790288 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790284    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-token\") pod \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") "
Jul 07 15:30:32.790575 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790331    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-data\") pod \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") "
Jul 07 15:30:32.790575 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790364    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-credential-socket\") pod \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") "
Jul 07 15:30:32.790575 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790402    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5cf5\" (UniqueName: \"kubernetes.io/projected/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-kube-api-access-n5cf5\") pod \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\" (UID: \"0cefaa2a-719e-498a-8e6a-b772bfcac5d7\") "
Jul 07 15:30:32.790575 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790453    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0cefaa2a-719e-498a-8e6a-b772bfcac5d7" (UID: "0cefaa2a-719e-498a-8e6a-b772bfcac5d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:30:32.790575 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790544    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0cefaa2a-719e-498a-8e6a-b772bfcac5d7" (UID: "0cefaa2a-719e-498a-8e6a-b772bfcac5d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:30:32.790816 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790789    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-workload-socket\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:30:32.790816 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790809    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-workload-certs\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:30:32.790908 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790823    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0cefaa2a-719e-498a-8e6a-b772bfcac5d7" (UID: "0cefaa2a-719e-498a-8e6a-b772bfcac5d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:30:32.790965 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.790923    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0cefaa2a-719e-498a-8e6a-b772bfcac5d7" (UID: "0cefaa2a-719e-498a-8e6a-b772bfcac5d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:30:32.791547 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.791504    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "0cefaa2a-719e-498a-8e6a-b772bfcac5d7" (UID: "0cefaa2a-719e-498a-8e6a-b772bfcac5d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:30:32.792660 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.792620    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "0cefaa2a-719e-498a-8e6a-b772bfcac5d7" (UID: "0cefaa2a-719e-498a-8e6a-b772bfcac5d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:30:32.792774 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.792681    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0cefaa2a-719e-498a-8e6a-b772bfcac5d7" (UID: "0cefaa2a-719e-498a-8e6a-b772bfcac5d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 15:30:32.792842 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.792822    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0cefaa2a-719e-498a-8e6a-b772bfcac5d7" (UID: "0cefaa2a-719e-498a-8e6a-b772bfcac5d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:30:32.792902 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.792823    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-kube-api-access-n5cf5" (OuterVolumeSpecName: "kube-api-access-n5cf5") pod "0cefaa2a-719e-498a-8e6a-b772bfcac5d7" (UID: "0cefaa2a-719e-498a-8e6a-b772bfcac5d7"). InnerVolumeSpecName "kube-api-access-n5cf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:30:32.891277 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.891241    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-data\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:30:32.891277 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.891271    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-credential-socket\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:30:32.891456 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.891304    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5cf5\" (UniqueName: \"kubernetes.io/projected/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-kube-api-access-n5cf5\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:30:32.891456 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.891315    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-envoy\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:30:32.891456 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.891323    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istiod-ca-cert\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:30:32.891456 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.891331    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-podinfo\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:30:32.891456 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.891339    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cefaa2a-719e-498a-8e6a-b772bfcac5d7-istio-token\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:30:32.938584 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.938537    2574 generic.go:356] "Generic (PLEG): container finished" podID="0cefaa2a-719e-498a-8e6a-b772bfcac5d7" containerID="b6bdf70139366ebb767be94cbe8c7818423c63f543f8e22cd8d01dc1a00ceb45" exitCode=0
Jul 07 15:30:32.938744 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.938581    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x" event={"ID":"0cefaa2a-719e-498a-8e6a-b772bfcac5d7","Type":"ContainerDied","Data":"b6bdf70139366ebb767be94cbe8c7818423c63f543f8e22cd8d01dc1a00ceb45"}
Jul 07 15:30:32.938744 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.938631    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"
Jul 07 15:30:32.938744 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.938647    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x" event={"ID":"0cefaa2a-719e-498a-8e6a-b772bfcac5d7","Type":"ContainerDied","Data":"3c757c5dc17739468acc3f42ba7670344b068b30a2705c04c12d252c7acb8e46"}
Jul 07 15:30:32.938744 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.938672    2574 scope.go:117] "RemoveContainer" containerID="b6bdf70139366ebb767be94cbe8c7818423c63f543f8e22cd8d01dc1a00ceb45"
Jul 07 15:30:32.947344 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.947319    2574 scope.go:117] "RemoveContainer" containerID="b6bdf70139366ebb767be94cbe8c7818423c63f543f8e22cd8d01dc1a00ceb45"
Jul 07 15:30:32.947644 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:30:32.947621    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6bdf70139366ebb767be94cbe8c7818423c63f543f8e22cd8d01dc1a00ceb45\": container with ID starting with b6bdf70139366ebb767be94cbe8c7818423c63f543f8e22cd8d01dc1a00ceb45 not found: ID does not exist" containerID="b6bdf70139366ebb767be94cbe8c7818423c63f543f8e22cd8d01dc1a00ceb45"
Jul 07 15:30:32.947718 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.947658    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6bdf70139366ebb767be94cbe8c7818423c63f543f8e22cd8d01dc1a00ceb45"} err="failed to get container status \"b6bdf70139366ebb767be94cbe8c7818423c63f543f8e22cd8d01dc1a00ceb45\": rpc error: code = NotFound desc = could not find container \"b6bdf70139366ebb767be94cbe8c7818423c63f543f8e22cd8d01dc1a00ceb45\": container with ID starting with b6bdf70139366ebb767be94cbe8c7818423c63f543f8e22cd8d01dc1a00ceb45 not found: ID does not exist"
Jul 07 15:30:32.955141 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.955113    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"]
Jul 07 15:30:32.959038 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:32.959000    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-61334271-openshift-default-7b8496d9-j7w7x"]
Jul 07 15:30:34.867868 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:34.867833    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cefaa2a-719e-498a-8e6a-b772bfcac5d7" path="/var/lib/kubelet/pods/0cefaa2a-719e-498a-8e6a-b772bfcac5d7/volumes"
Jul 07 15:30:40.821100 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:40.821071    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:30:40.825252 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:30:40.825225    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:33:11.354216 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.354177    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"]
Jul 07 15:33:11.354674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.354555    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cefaa2a-719e-498a-8e6a-b772bfcac5d7" containerName="istio-proxy"
Jul 07 15:33:11.354674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.354566    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cefaa2a-719e-498a-8e6a-b772bfcac5d7" containerName="istio-proxy"
Jul 07 15:33:11.354674 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.354637    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cefaa2a-719e-498a-8e6a-b772bfcac5d7" containerName="istio-proxy"
Jul 07 15:33:11.357992 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.357964    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:11.360749 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.360725    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-02505f19-serving-cert\""
Jul 07 15:33:11.371123 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.371095    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"]
Jul 07 15:33:11.408418 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.408378    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-maas-api-tls\") pod \"maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l\" (UID: \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\") " pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:11.408418 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.408420    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-openshift-service-ca\") pod \"maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l\" (UID: \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\") " pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:11.408684 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.408570    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9pxr\" (UniqueName: \"kubernetes.io/projected/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-kube-api-access-z9pxr\") pod \"maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l\" (UID: \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\") " pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:11.510020 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.509974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9pxr\" (UniqueName: \"kubernetes.io/projected/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-kube-api-access-z9pxr\") pod \"maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l\" (UID: \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\") " pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:11.510233 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.510102    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-maas-api-tls\") pod \"maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l\" (UID: \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\") " pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:11.510233 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.510132    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-openshift-service-ca\") pod \"maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l\" (UID: \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\") " pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:11.510367 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:33:11.510240    2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-02505f19-serving-cert: secret "maas-api-e2e-mt-02505f19-serving-cert" not found
Jul 07 15:33:11.510367 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:33:11.510312    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-maas-api-tls podName:2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b nodeName:}" failed. No retries permitted until 2026-07-07 15:33:12.010293814 +0000 UTC m=+1951.744180178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-maas-api-tls") pod "maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l" (UID: "2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b") : secret "maas-api-e2e-mt-02505f19-serving-cert" not found
Jul 07 15:33:11.510835 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.510811    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-openshift-service-ca\") pod \"maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l\" (UID: \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\") " pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:11.519571 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:11.519535    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9pxr\" (UniqueName: \"kubernetes.io/projected/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-kube-api-access-z9pxr\") pod \"maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l\" (UID: \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\") " pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:12.015277 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:12.015228    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-maas-api-tls\") pod \"maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l\" (UID: \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\") " pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:12.017772 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:12.017736    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-maas-api-tls\") pod \"maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l\" (UID: \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\") " pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:12.268367 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:12.268263    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:12.406479 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:12.406453    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"]
Jul 07 15:33:12.408874 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:33:12.408841    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fdbdcbc_a223_4fd9_91e9_5b7aa0c73d6b.slice/crio-88dfdcb6e20a71d110bc52acdeb9988173219e32a347a865aca4b479f600cc91 WatchSource:0}: Error finding container 88dfdcb6e20a71d110bc52acdeb9988173219e32a347a865aca4b479f600cc91: Status 404 returned error can't find the container with id 88dfdcb6e20a71d110bc52acdeb9988173219e32a347a865aca4b479f600cc91
Jul 07 15:33:12.706270 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:12.706231    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l" event={"ID":"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b","Type":"ContainerStarted","Data":"88dfdcb6e20a71d110bc52acdeb9988173219e32a347a865aca4b479f600cc91"}
Jul 07 15:33:13.712366 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:13.712327    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l" event={"ID":"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b","Type":"ContainerStarted","Data":"3502cfa574957c585e7e03a02b91f2d57fea87bc5c42d0f438f20314658733b1"}
Jul 07 15:33:13.712763 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:13.712418    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:13.729189 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:13.729132    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l" podStartSLOduration=2.197962123 podStartE2EDuration="2.729109927s" totalImagesPullingTime="531.147804ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:33:13.728547165 +0000 UTC m=+1953.462433548" watchObservedRunningTime="2026-07-07 15:33:13.729109927 +0000 UTC m=+1953.462996309"
Jul 07 15:33:19.723564 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:19.723529    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:53.827984 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:53.827936    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"]
Jul 07 15:33:53.828629 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:53.828187    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l" podUID="2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b" containerName="maas-api" containerID="cri-o://3502cfa574957c585e7e03a02b91f2d57fea87bc5c42d0f438f20314658733b1" gracePeriod=30
Jul 07 15:33:54.082710 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.082635    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:54.197965 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.197925    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-openshift-service-ca\") pod \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\" (UID: \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\") "
Jul 07 15:33:54.198213 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.198052    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9pxr\" (UniqueName: \"kubernetes.io/projected/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-kube-api-access-z9pxr\") pod \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\" (UID: \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\") "
Jul 07 15:33:54.198213 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.198122    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-maas-api-tls\") pod \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\" (UID: \"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b\") "
Jul 07 15:33:54.198363 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.198332    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b" (UID: "2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:33:54.200276 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.200241    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-kube-api-access-z9pxr" (OuterVolumeSpecName: "kube-api-access-z9pxr") pod "2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b" (UID: "2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b"). InnerVolumeSpecName "kube-api-access-z9pxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:33:54.200417 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.200285    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b" (UID: "2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:33:54.299832 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.299801    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-maas-api-tls\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:33:54.299832 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.299830    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-openshift-service-ca\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:33:54.299832 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.299840    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9pxr\" (UniqueName: \"kubernetes.io/projected/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b-kube-api-access-z9pxr\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:33:54.914473 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.914437    2574 generic.go:356] "Generic (PLEG): container finished" podID="2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b" containerID="3502cfa574957c585e7e03a02b91f2d57fea87bc5c42d0f438f20314658733b1" exitCode=0
Jul 07 15:33:54.914882 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.914506    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"
Jul 07 15:33:54.914882 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.914517    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l" event={"ID":"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b","Type":"ContainerDied","Data":"3502cfa574957c585e7e03a02b91f2d57fea87bc5c42d0f438f20314658733b1"}
Jul 07 15:33:54.914882 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.914573    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l" event={"ID":"2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b","Type":"ContainerDied","Data":"88dfdcb6e20a71d110bc52acdeb9988173219e32a347a865aca4b479f600cc91"}
Jul 07 15:33:54.914882 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.914594    2574 scope.go:117] "RemoveContainer" containerID="3502cfa574957c585e7e03a02b91f2d57fea87bc5c42d0f438f20314658733b1"
Jul 07 15:33:54.923350 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.923331    2574 scope.go:117] "RemoveContainer" containerID="3502cfa574957c585e7e03a02b91f2d57fea87bc5c42d0f438f20314658733b1"
Jul 07 15:33:54.923612 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:33:54.923593    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3502cfa574957c585e7e03a02b91f2d57fea87bc5c42d0f438f20314658733b1\": container with ID starting with 3502cfa574957c585e7e03a02b91f2d57fea87bc5c42d0f438f20314658733b1 not found: ID does not exist" containerID="3502cfa574957c585e7e03a02b91f2d57fea87bc5c42d0f438f20314658733b1"
Jul 07 15:33:54.923663 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.923622    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3502cfa574957c585e7e03a02b91f2d57fea87bc5c42d0f438f20314658733b1"} err="failed to get container status \"3502cfa574957c585e7e03a02b91f2d57fea87bc5c42d0f438f20314658733b1\": rpc error: code = NotFound desc = could not find container \"3502cfa574957c585e7e03a02b91f2d57fea87bc5c42d0f438f20314658733b1\": container with ID starting with 3502cfa574957c585e7e03a02b91f2d57fea87bc5c42d0f438f20314658733b1 not found: ID does not exist"
Jul 07 15:33:54.933066 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.933042    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"]
Jul 07 15:33:54.936965 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:54.936943    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-02505f19-6655cfdff7-w5n2l"]
Jul 07 15:33:56.868299 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:33:56.868264    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b" path="/var/lib/kubelet/pods/2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b/volumes"
Jul 07 15:35:40.848575 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:40.848540    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:35:40.853816 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:40.853789    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:35:54.194770 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.194731    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"]
Jul 07 15:35:54.195246 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.195229    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b" containerName="maas-api"
Jul 07 15:35:54.195296 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.195248    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b" containerName="maas-api"
Jul 07 15:35:54.195331 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.195314    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fdbdcbc-a223-4fd9-91e9-5b7aa0c73d6b" containerName="maas-api"
Jul 07 15:35:54.198525 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.198497    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:35:54.200833 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.200811    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-c5eea1-serving-cert\""
Jul 07 15:35:54.209164 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.209109    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxz7m\" (UniqueName: \"kubernetes.io/projected/d93d59ba-49a3-4621-a091-9fa3bec3de6f-kube-api-access-bxz7m\") pod \"maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p\" (UID: \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\") " pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:35:54.209340 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.209199    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d93d59ba-49a3-4621-a091-9fa3bec3de6f-maas-api-tls\") pod \"maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p\" (UID: \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\") " pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:35:54.209340 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.209270    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d93d59ba-49a3-4621-a091-9fa3bec3de6f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p\" (UID: \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\") " pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:35:54.209814 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.209791    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"]
Jul 07 15:35:54.310704 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.310666    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d93d59ba-49a3-4621-a091-9fa3bec3de6f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p\" (UID: \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\") " pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:35:54.310888 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.310752    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxz7m\" (UniqueName: \"kubernetes.io/projected/d93d59ba-49a3-4621-a091-9fa3bec3de6f-kube-api-access-bxz7m\") pod \"maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p\" (UID: \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\") " pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:35:54.310888 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.310796    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d93d59ba-49a3-4621-a091-9fa3bec3de6f-maas-api-tls\") pod \"maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p\" (UID: \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\") " pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:35:54.310978 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:35:54.310941    2574 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-c5eea1-serving-cert: secret "maas-api-e2e-inf-b-c5eea1-serving-cert" not found
Jul 07 15:35:54.311068 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:35:54.311056    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d93d59ba-49a3-4621-a091-9fa3bec3de6f-maas-api-tls podName:d93d59ba-49a3-4621-a091-9fa3bec3de6f nodeName:}" failed. No retries permitted until 2026-07-07 15:35:54.811031113 +0000 UTC m=+2114.544917485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d93d59ba-49a3-4621-a091-9fa3bec3de6f-maas-api-tls") pod "maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p" (UID: "d93d59ba-49a3-4621-a091-9fa3bec3de6f") : secret "maas-api-e2e-inf-b-c5eea1-serving-cert" not found
Jul 07 15:35:54.311451 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.311431    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d93d59ba-49a3-4621-a091-9fa3bec3de6f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p\" (UID: \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\") " pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:35:54.321613 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.321577    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxz7m\" (UniqueName: \"kubernetes.io/projected/d93d59ba-49a3-4621-a091-9fa3bec3de6f-kube-api-access-bxz7m\") pod \"maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p\" (UID: \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\") " pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:35:54.816502 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.816469    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d93d59ba-49a3-4621-a091-9fa3bec3de6f-maas-api-tls\") pod \"maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p\" (UID: \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\") " pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:35:54.818932 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:54.818910    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d93d59ba-49a3-4621-a091-9fa3bec3de6f-maas-api-tls\") pod \"maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p\" (UID: \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\") " pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:35:55.112940 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:55.112840    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:35:55.264187 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:55.264162    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"]
Jul 07 15:35:55.266251 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:35:55.266221    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd93d59ba_49a3_4621_a091_9fa3bec3de6f.slice/crio-b41df545b555e1848266b4b75c5dcdc56adefb5b52d8e69dbbc0fbe5f3e0fc2d WatchSource:0}: Error finding container b41df545b555e1848266b4b75c5dcdc56adefb5b52d8e69dbbc0fbe5f3e0fc2d: Status 404 returned error can't find the container with id b41df545b555e1848266b4b75c5dcdc56adefb5b52d8e69dbbc0fbe5f3e0fc2d
Jul 07 15:35:55.268194 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:55.268173    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:35:55.519981 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:55.519889    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p" event={"ID":"d93d59ba-49a3-4621-a091-9fa3bec3de6f","Type":"ContainerStarted","Data":"b41df545b555e1848266b4b75c5dcdc56adefb5b52d8e69dbbc0fbe5f3e0fc2d"}
Jul 07 15:35:56.533111 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:56.533075    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p" event={"ID":"d93d59ba-49a3-4621-a091-9fa3bec3de6f","Type":"ContainerStarted","Data":"bc838599a29433281ce272c55f25d439f7005230bbe132d043be119e249ae27f"}
Jul 07 15:35:56.533519 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:56.533182    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:35:56.551330 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:35:56.551280    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p" podStartSLOduration=2.118791946 podStartE2EDuration="2.551264078s" totalImagesPullingTime="432.472132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:35:56.549575309 +0000 UTC m=+2116.283461692" watchObservedRunningTime="2026-07-07 15:35:56.551264078 +0000 UTC m=+2116.285150460"
Jul 07 15:36:02.553433 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:02.553404    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:36:06.897738 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:06.897702    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"]
Jul 07 15:36:06.901620 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:06.901601    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:06.905356 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:06.905318    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6c4fac\"/\"default-dockercfg-5zmhs\""
Jul 07 15:36:06.905356 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:06.905343    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6c4fac\"/\"test-model-6c4fac-kserve-self-signed-certs\""
Jul 07 15:36:06.905356 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:06.905356    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6c4fac\"/\"kube-root-ca.crt\""
Jul 07 15:36:06.905602 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:06.905341    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6c4fac\"/\"openshift-service-ca.crt\""
Jul 07 15:36:06.910930 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:06.910905    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"]
Jul 07 15:36:06.927169 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:06.927134    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-home\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:06.927360 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:06.927212    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf5j4\" (UniqueName: \"kubernetes.io/projected/85b4687b-6045-4d50-b535-f6525183208e-kube-api-access-bf5j4\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:06.927360 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:06.927238    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85b4687b-6045-4d50-b535-f6525183208e-tls-certs\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:06.927360 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:06.927257    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-dshm\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:06.927360 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:06.927318    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-tmp-dir\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:06.927536 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:06.927467    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-model-cache\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:07.028203 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.028160    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-home\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:07.028381 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.028228    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf5j4\" (UniqueName: \"kubernetes.io/projected/85b4687b-6045-4d50-b535-f6525183208e-kube-api-access-bf5j4\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:07.028381 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.028249    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85b4687b-6045-4d50-b535-f6525183208e-tls-certs\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:07.028381 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.028266    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-dshm\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:07.028381 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.028290    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-tmp-dir\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:07.028381 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.028330    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-model-cache\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:07.028681 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.028621    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-home\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:07.028744 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.028682    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-tmp-dir\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:07.028788 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.028742    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-model-cache\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:07.030734 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.030703    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-dshm\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:07.030891 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.030846    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85b4687b-6045-4d50-b535-f6525183208e-tls-certs\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:07.035700 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.035680    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf5j4\" (UniqueName: \"kubernetes.io/projected/85b4687b-6045-4d50-b535-f6525183208e-kube-api-access-bf5j4\") pod \"test-model-6c4fac-kserve-78cb6d57c9-nlhcx\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") " pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:07.213250 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.213160    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:07.366166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.366140    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"]
Jul 07 15:36:07.368512 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:36:07.368476    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85b4687b_6045_4d50_b535_f6525183208e.slice/crio-d5da412342cc7446d2a9d833cb23b43e9a8ea342b9ef02f71a6745bc7ec23a5e WatchSource:0}: Error finding container d5da412342cc7446d2a9d833cb23b43e9a8ea342b9ef02f71a6745bc7ec23a5e: Status 404 returned error can't find the container with id d5da412342cc7446d2a9d833cb23b43e9a8ea342b9ef02f71a6745bc7ec23a5e
Jul 07 15:36:07.591347 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.591307    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx" event={"ID":"85b4687b-6045-4d50-b535-f6525183208e","Type":"ContainerStarted","Data":"a664975f8ea5528725dd647e9d4b53bcc10e2edc31edda923bafb99db5dc3abe"}
Jul 07 15:36:07.591573 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.591361    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx" event={"ID":"85b4687b-6045-4d50-b535-f6525183208e","Type":"ContainerStarted","Data":"d5da412342cc7446d2a9d833cb23b43e9a8ea342b9ef02f71a6745bc7ec23a5e"}
Jul 07 15:36:07.608402 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:07.608345    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx" podStartSLOduration=1.60832723 podStartE2EDuration="1.60832723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:36:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:36:07.606972403 +0000 UTC m=+2127.340858785" watchObservedRunningTime="2026-07-07 15:36:07.60832723 +0000 UTC m=+2127.342213612"
Jul 07 15:36:17.213385 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:17.213328    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:17.213803 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:17.213401    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:17.225960 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:17.225928    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:17.653989 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:17.653953    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:36:47.199890 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:36:47.199849    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"]
Jul 07 15:37:02.219929 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.219860    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx" podUID="85b4687b-6045-4d50-b535-f6525183208e" containerName="main" containerID="cri-o://a664975f8ea5528725dd647e9d4b53bcc10e2edc31edda923bafb99db5dc3abe" gracePeriod=45
Jul 07 15:37:02.492122 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.492095    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:37:02.555638 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.555606    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-tmp-dir\") pod \"85b4687b-6045-4d50-b535-f6525183208e\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") "
Jul 07 15:37:02.555835 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.555651    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-model-cache\") pod \"85b4687b-6045-4d50-b535-f6525183208e\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") "
Jul 07 15:37:02.555835 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.555672    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf5j4\" (UniqueName: \"kubernetes.io/projected/85b4687b-6045-4d50-b535-f6525183208e-kube-api-access-bf5j4\") pod \"85b4687b-6045-4d50-b535-f6525183208e\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") "
Jul 07 15:37:02.555835 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.555689    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-dshm\") pod \"85b4687b-6045-4d50-b535-f6525183208e\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") "
Jul 07 15:37:02.555835 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.555727    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85b4687b-6045-4d50-b535-f6525183208e-tls-certs\") pod \"85b4687b-6045-4d50-b535-f6525183208e\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") "
Jul 07 15:37:02.555835 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.555784    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-home\") pod \"85b4687b-6045-4d50-b535-f6525183208e\" (UID: \"85b4687b-6045-4d50-b535-f6525183208e\") "
Jul 07 15:37:02.556154 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.555893    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "85b4687b-6045-4d50-b535-f6525183208e" (UID: "85b4687b-6045-4d50-b535-f6525183208e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:37:02.556154 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.555914    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-model-cache" (OuterVolumeSpecName: "model-cache") pod "85b4687b-6045-4d50-b535-f6525183208e" (UID: "85b4687b-6045-4d50-b535-f6525183208e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:37:02.556154 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.556101    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-home" (OuterVolumeSpecName: "home") pod "85b4687b-6045-4d50-b535-f6525183208e" (UID: "85b4687b-6045-4d50-b535-f6525183208e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:37:02.556297 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.556154    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-tmp-dir\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:37:02.556297 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.556169    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-model-cache\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:37:02.557931 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.557906    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b4687b-6045-4d50-b535-f6525183208e-kube-api-access-bf5j4" (OuterVolumeSpecName: "kube-api-access-bf5j4") pod "85b4687b-6045-4d50-b535-f6525183208e" (UID: "85b4687b-6045-4d50-b535-f6525183208e"). InnerVolumeSpecName "kube-api-access-bf5j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:37:02.558311 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.558287    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85b4687b-6045-4d50-b535-f6525183208e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "85b4687b-6045-4d50-b535-f6525183208e" (UID: "85b4687b-6045-4d50-b535-f6525183208e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:37:02.558311 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.558296    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-dshm" (OuterVolumeSpecName: "dshm") pod "85b4687b-6045-4d50-b535-f6525183208e" (UID: "85b4687b-6045-4d50-b535-f6525183208e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:37:02.657190 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.657152    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf5j4\" (UniqueName: \"kubernetes.io/projected/85b4687b-6045-4d50-b535-f6525183208e-kube-api-access-bf5j4\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:37:02.657190 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.657186    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-dshm\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:37:02.657190 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.657196    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85b4687b-6045-4d50-b535-f6525183208e-tls-certs\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:37:02.657436 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.657206    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85b4687b-6045-4d50-b535-f6525183208e-home\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:37:02.874227 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.874185    2574 generic.go:356] "Generic (PLEG): container finished" podID="85b4687b-6045-4d50-b535-f6525183208e" containerID="a664975f8ea5528725dd647e9d4b53bcc10e2edc31edda923bafb99db5dc3abe" exitCode=0
Jul 07 15:37:02.874227 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.874233    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"
Jul 07 15:37:02.874525 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.874271    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx" event={"ID":"85b4687b-6045-4d50-b535-f6525183208e","Type":"ContainerDied","Data":"a664975f8ea5528725dd647e9d4b53bcc10e2edc31edda923bafb99db5dc3abe"}
Jul 07 15:37:02.874525 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.874316    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx" event={"ID":"85b4687b-6045-4d50-b535-f6525183208e","Type":"ContainerDied","Data":"d5da412342cc7446d2a9d833cb23b43e9a8ea342b9ef02f71a6745bc7ec23a5e"}
Jul 07 15:37:02.874525 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.874333    2574 scope.go:117] "RemoveContainer" containerID="a664975f8ea5528725dd647e9d4b53bcc10e2edc31edda923bafb99db5dc3abe"
Jul 07 15:37:02.883916 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.883901    2574 scope.go:117] "RemoveContainer" containerID="a664975f8ea5528725dd647e9d4b53bcc10e2edc31edda923bafb99db5dc3abe"
Jul 07 15:37:02.884208 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:37:02.884190    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a664975f8ea5528725dd647e9d4b53bcc10e2edc31edda923bafb99db5dc3abe\": container with ID starting with a664975f8ea5528725dd647e9d4b53bcc10e2edc31edda923bafb99db5dc3abe not found: ID does not exist" containerID="a664975f8ea5528725dd647e9d4b53bcc10e2edc31edda923bafb99db5dc3abe"
Jul 07 15:37:02.884260 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.884218    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a664975f8ea5528725dd647e9d4b53bcc10e2edc31edda923bafb99db5dc3abe"} err="failed to get container status \"a664975f8ea5528725dd647e9d4b53bcc10e2edc31edda923bafb99db5dc3abe\": rpc error: code = NotFound desc = could not find container \"a664975f8ea5528725dd647e9d4b53bcc10e2edc31edda923bafb99db5dc3abe\": container with ID starting with a664975f8ea5528725dd647e9d4b53bcc10e2edc31edda923bafb99db5dc3abe not found: ID does not exist"
Jul 07 15:37:02.892762 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.892732    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"]
Jul 07 15:37:02.894441 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:02.894422    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-6c4fac/test-model-6c4fac-kserve-78cb6d57c9-nlhcx"]
Jul 07 15:37:04.875561 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:04.875525    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85b4687b-6045-4d50-b535-f6525183208e" path="/var/lib/kubelet/pods/85b4687b-6045-4d50-b535-f6525183208e/volumes"
Jul 07 15:37:32.273685 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:32.273647    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"]
Jul 07 15:37:32.274372 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:32.273893    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p" podUID="d93d59ba-49a3-4621-a091-9fa3bec3de6f" containerName="maas-api" containerID="cri-o://bc838599a29433281ce272c55f25d439f7005230bbe132d043be119e249ae27f" gracePeriod=30
Jul 07 15:37:32.532442 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:32.532412    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:37:32.640383 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:32.640344    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d93d59ba-49a3-4621-a091-9fa3bec3de6f-openshift-service-ca\") pod \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\" (UID: \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\") "
Jul 07 15:37:32.640576 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:32.640420    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d93d59ba-49a3-4621-a091-9fa3bec3de6f-maas-api-tls\") pod \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\" (UID: \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\") "
Jul 07 15:37:32.640576 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:32.640489    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxz7m\" (UniqueName: \"kubernetes.io/projected/d93d59ba-49a3-4621-a091-9fa3bec3de6f-kube-api-access-bxz7m\") pod \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\" (UID: \"d93d59ba-49a3-4621-a091-9fa3bec3de6f\") "
Jul 07 15:37:32.640813 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:32.640783    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d93d59ba-49a3-4621-a091-9fa3bec3de6f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d93d59ba-49a3-4621-a091-9fa3bec3de6f" (UID: "d93d59ba-49a3-4621-a091-9fa3bec3de6f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:37:32.642700 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:32.642656    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d93d59ba-49a3-4621-a091-9fa3bec3de6f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d93d59ba-49a3-4621-a091-9fa3bec3de6f" (UID: "d93d59ba-49a3-4621-a091-9fa3bec3de6f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:37:32.643065 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:32.643041    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d93d59ba-49a3-4621-a091-9fa3bec3de6f-kube-api-access-bxz7m" (OuterVolumeSpecName: "kube-api-access-bxz7m") pod "d93d59ba-49a3-4621-a091-9fa3bec3de6f" (UID: "d93d59ba-49a3-4621-a091-9fa3bec3de6f"). InnerVolumeSpecName "kube-api-access-bxz7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:37:32.741600 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:32.741540    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxz7m\" (UniqueName: \"kubernetes.io/projected/d93d59ba-49a3-4621-a091-9fa3bec3de6f-kube-api-access-bxz7m\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:37:32.741600 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:32.741589    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d93d59ba-49a3-4621-a091-9fa3bec3de6f-openshift-service-ca\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:37:32.741600 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:32.741605    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d93d59ba-49a3-4621-a091-9fa3bec3de6f-maas-api-tls\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:37:33.030224 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:33.030188    2574 generic.go:356] "Generic (PLEG): container finished" podID="d93d59ba-49a3-4621-a091-9fa3bec3de6f" containerID="bc838599a29433281ce272c55f25d439f7005230bbe132d043be119e249ae27f" exitCode=0
Jul 07 15:37:33.030403 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:33.030237    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"
Jul 07 15:37:33.030403 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:33.030271    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p" event={"ID":"d93d59ba-49a3-4621-a091-9fa3bec3de6f","Type":"ContainerDied","Data":"bc838599a29433281ce272c55f25d439f7005230bbe132d043be119e249ae27f"}
Jul 07 15:37:33.030403 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:33.030327    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p" event={"ID":"d93d59ba-49a3-4621-a091-9fa3bec3de6f","Type":"ContainerDied","Data":"b41df545b555e1848266b4b75c5dcdc56adefb5b52d8e69dbbc0fbe5f3e0fc2d"}
Jul 07 15:37:33.030403 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:33.030359    2574 scope.go:117] "RemoveContainer" containerID="bc838599a29433281ce272c55f25d439f7005230bbe132d043be119e249ae27f"
Jul 07 15:37:33.040235 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:33.040211    2574 scope.go:117] "RemoveContainer" containerID="bc838599a29433281ce272c55f25d439f7005230bbe132d043be119e249ae27f"
Jul 07 15:37:33.040594 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:37:33.040572    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc838599a29433281ce272c55f25d439f7005230bbe132d043be119e249ae27f\": container with ID starting with bc838599a29433281ce272c55f25d439f7005230bbe132d043be119e249ae27f not found: ID does not exist" containerID="bc838599a29433281ce272c55f25d439f7005230bbe132d043be119e249ae27f"
Jul 07 15:37:33.040662 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:33.040610    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc838599a29433281ce272c55f25d439f7005230bbe132d043be119e249ae27f"} err="failed to get container status \"bc838599a29433281ce272c55f25d439f7005230bbe132d043be119e249ae27f\": rpc error: code = NotFound desc = could not find container \"bc838599a29433281ce272c55f25d439f7005230bbe132d043be119e249ae27f\": container with ID starting with bc838599a29433281ce272c55f25d439f7005230bbe132d043be119e249ae27f not found: ID does not exist"
Jul 07 15:37:33.047264 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:33.047237    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"]
Jul 07 15:37:33.051785 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:33.051760    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c5eea1-75876bd9cb-wsv6p"]
Jul 07 15:37:34.867512 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:34.867476    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d93d59ba-49a3-4621-a091-9fa3bec3de6f" path="/var/lib/kubelet/pods/d93d59ba-49a3-4621-a091-9fa3bec3de6f/volumes"
Jul 07 15:37:49.897389 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:49.897343    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"]
Jul 07 15:37:49.897996 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:49.897927    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93d59ba-49a3-4621-a091-9fa3bec3de6f" containerName="maas-api"
Jul 07 15:37:49.897996 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:49.897948    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93d59ba-49a3-4621-a091-9fa3bec3de6f" containerName="maas-api"
Jul 07 15:37:49.897996 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:49.897979    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b4687b-6045-4d50-b535-f6525183208e" containerName="main"
Jul 07 15:37:49.897996 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:49.897988    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b4687b-6045-4d50-b535-f6525183208e" containerName="main"
Jul 07 15:37:49.898247 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:49.898113    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d93d59ba-49a3-4621-a091-9fa3bec3de6f" containerName="maas-api"
Jul 07 15:37:49.898247 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:49.898133    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="85b4687b-6045-4d50-b535-f6525183208e" containerName="main"
Jul 07 15:37:49.901681 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:49.901656    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:37:49.906786 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:49.906758    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-83bd55-serving-cert\""
Jul 07 15:37:49.924962 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:49.924931    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"]
Jul 07 15:37:50.012028 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:50.011971    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/444ba328-43c1-48b1-8164-7132abbc8f62-maas-api-tls\") pod \"maas-api-e2e-api-b-83bd55-fff84b756-gpzvv\" (UID: \"444ba328-43c1-48b1-8164-7132abbc8f62\") " pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:37:50.012200 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:50.012086    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/444ba328-43c1-48b1-8164-7132abbc8f62-openshift-service-ca\") pod \"maas-api-e2e-api-b-83bd55-fff84b756-gpzvv\" (UID: \"444ba328-43c1-48b1-8164-7132abbc8f62\") " pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:37:50.012200 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:50.012128    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5lsb\" (UniqueName: \"kubernetes.io/projected/444ba328-43c1-48b1-8164-7132abbc8f62-kube-api-access-g5lsb\") pod \"maas-api-e2e-api-b-83bd55-fff84b756-gpzvv\" (UID: \"444ba328-43c1-48b1-8164-7132abbc8f62\") " pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:37:50.113471 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:50.113436    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5lsb\" (UniqueName: \"kubernetes.io/projected/444ba328-43c1-48b1-8164-7132abbc8f62-kube-api-access-g5lsb\") pod \"maas-api-e2e-api-b-83bd55-fff84b756-gpzvv\" (UID: \"444ba328-43c1-48b1-8164-7132abbc8f62\") " pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:37:50.113670 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:50.113491    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/444ba328-43c1-48b1-8164-7132abbc8f62-maas-api-tls\") pod \"maas-api-e2e-api-b-83bd55-fff84b756-gpzvv\" (UID: \"444ba328-43c1-48b1-8164-7132abbc8f62\") " pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:37:50.113670 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:50.113545    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/444ba328-43c1-48b1-8164-7132abbc8f62-openshift-service-ca\") pod \"maas-api-e2e-api-b-83bd55-fff84b756-gpzvv\" (UID: \"444ba328-43c1-48b1-8164-7132abbc8f62\") " pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:37:50.114176 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:50.114153    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/444ba328-43c1-48b1-8164-7132abbc8f62-openshift-service-ca\") pod \"maas-api-e2e-api-b-83bd55-fff84b756-gpzvv\" (UID: \"444ba328-43c1-48b1-8164-7132abbc8f62\") " pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:37:50.115999 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:50.115969    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/444ba328-43c1-48b1-8164-7132abbc8f62-maas-api-tls\") pod \"maas-api-e2e-api-b-83bd55-fff84b756-gpzvv\" (UID: \"444ba328-43c1-48b1-8164-7132abbc8f62\") " pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:37:50.136583 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:50.136553    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5lsb\" (UniqueName: \"kubernetes.io/projected/444ba328-43c1-48b1-8164-7132abbc8f62-kube-api-access-g5lsb\") pod \"maas-api-e2e-api-b-83bd55-fff84b756-gpzvv\" (UID: \"444ba328-43c1-48b1-8164-7132abbc8f62\") " pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:37:50.213667 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:50.213582    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:37:50.373087 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:50.373059    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"]
Jul 07 15:37:50.375728 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:37:50.375692    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod444ba328_43c1_48b1_8164_7132abbc8f62.slice/crio-c7bb24a776bad40cb838dfe9e482bb1d1844bb2ff1d7d74d553d7b77f8845eb2 WatchSource:0}: Error finding container c7bb24a776bad40cb838dfe9e482bb1d1844bb2ff1d7d74d553d7b77f8845eb2: Status 404 returned error can't find the container with id c7bb24a776bad40cb838dfe9e482bb1d1844bb2ff1d7d74d553d7b77f8845eb2
Jul 07 15:37:51.131934 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:51.131825    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv" event={"ID":"444ba328-43c1-48b1-8164-7132abbc8f62","Type":"ContainerStarted","Data":"64caeb2e8ff77d02807e2fd100f62a1cad06e520fa7c8348345db4539bae87a7"}
Jul 07 15:37:51.131934 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:51.131881    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv" event={"ID":"444ba328-43c1-48b1-8164-7132abbc8f62","Type":"ContainerStarted","Data":"c7bb24a776bad40cb838dfe9e482bb1d1844bb2ff1d7d74d553d7b77f8845eb2"}
Jul 07 15:37:51.132413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:51.131942    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:37:51.165193 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:51.165139    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv" podStartSLOduration=1.708532803 podStartE2EDuration="2.16512124s" totalImagesPullingTime="456.588437ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:37:51.164578132 +0000 UTC m=+2230.898464514" watchObservedRunningTime="2026-07-07 15:37:51.16512124 +0000 UTC m=+2230.899007621"
Jul 07 15:37:57.142315 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:37:57.142285    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:38:10.617433 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:10.617394    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"]
Jul 07 15:38:10.617942 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:10.617682    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv" podUID="444ba328-43c1-48b1-8164-7132abbc8f62" containerName="maas-api" containerID="cri-o://64caeb2e8ff77d02807e2fd100f62a1cad06e520fa7c8348345db4539bae87a7" gracePeriod=30
Jul 07 15:38:10.872973 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:10.872905    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:38:10.893198 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:10.893163    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/444ba328-43c1-48b1-8164-7132abbc8f62-openshift-service-ca\") pod \"444ba328-43c1-48b1-8164-7132abbc8f62\" (UID: \"444ba328-43c1-48b1-8164-7132abbc8f62\") "
Jul 07 15:38:10.893397 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:10.893231    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5lsb\" (UniqueName: \"kubernetes.io/projected/444ba328-43c1-48b1-8164-7132abbc8f62-kube-api-access-g5lsb\") pod \"444ba328-43c1-48b1-8164-7132abbc8f62\" (UID: \"444ba328-43c1-48b1-8164-7132abbc8f62\") "
Jul 07 15:38:10.893397 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:10.893265    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/444ba328-43c1-48b1-8164-7132abbc8f62-maas-api-tls\") pod \"444ba328-43c1-48b1-8164-7132abbc8f62\" (UID: \"444ba328-43c1-48b1-8164-7132abbc8f62\") "
Jul 07 15:38:10.893680 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:10.893549    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/444ba328-43c1-48b1-8164-7132abbc8f62-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "444ba328-43c1-48b1-8164-7132abbc8f62" (UID: "444ba328-43c1-48b1-8164-7132abbc8f62"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:38:10.895705 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:10.895677    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/444ba328-43c1-48b1-8164-7132abbc8f62-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "444ba328-43c1-48b1-8164-7132abbc8f62" (UID: "444ba328-43c1-48b1-8164-7132abbc8f62"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:38:10.895903 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:10.895881    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/444ba328-43c1-48b1-8164-7132abbc8f62-kube-api-access-g5lsb" (OuterVolumeSpecName: "kube-api-access-g5lsb") pod "444ba328-43c1-48b1-8164-7132abbc8f62" (UID: "444ba328-43c1-48b1-8164-7132abbc8f62"). InnerVolumeSpecName "kube-api-access-g5lsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:38:10.994162 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:10.994122    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/444ba328-43c1-48b1-8164-7132abbc8f62-openshift-service-ca\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:38:10.994162 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:10.994150    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5lsb\" (UniqueName: \"kubernetes.io/projected/444ba328-43c1-48b1-8164-7132abbc8f62-kube-api-access-g5lsb\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:38:10.994162 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:10.994160    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/444ba328-43c1-48b1-8164-7132abbc8f62-maas-api-tls\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:38:11.233653 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:11.233558    2574 generic.go:356] "Generic (PLEG): container finished" podID="444ba328-43c1-48b1-8164-7132abbc8f62" containerID="64caeb2e8ff77d02807e2fd100f62a1cad06e520fa7c8348345db4539bae87a7" exitCode=0
Jul 07 15:38:11.233653 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:11.233599    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"
Jul 07 15:38:11.233653 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:11.233635    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv" event={"ID":"444ba328-43c1-48b1-8164-7132abbc8f62","Type":"ContainerDied","Data":"64caeb2e8ff77d02807e2fd100f62a1cad06e520fa7c8348345db4539bae87a7"}
Jul 07 15:38:11.233902 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:11.233687    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv" event={"ID":"444ba328-43c1-48b1-8164-7132abbc8f62","Type":"ContainerDied","Data":"c7bb24a776bad40cb838dfe9e482bb1d1844bb2ff1d7d74d553d7b77f8845eb2"}
Jul 07 15:38:11.233902 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:11.233710    2574 scope.go:117] "RemoveContainer" containerID="64caeb2e8ff77d02807e2fd100f62a1cad06e520fa7c8348345db4539bae87a7"
Jul 07 15:38:11.245624 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:11.245605    2574 scope.go:117] "RemoveContainer" containerID="64caeb2e8ff77d02807e2fd100f62a1cad06e520fa7c8348345db4539bae87a7"
Jul 07 15:38:11.245960 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:38:11.245937    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64caeb2e8ff77d02807e2fd100f62a1cad06e520fa7c8348345db4539bae87a7\": container with ID starting with 64caeb2e8ff77d02807e2fd100f62a1cad06e520fa7c8348345db4539bae87a7 not found: ID does not exist" containerID="64caeb2e8ff77d02807e2fd100f62a1cad06e520fa7c8348345db4539bae87a7"
Jul 07 15:38:11.246113 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:11.245965    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64caeb2e8ff77d02807e2fd100f62a1cad06e520fa7c8348345db4539bae87a7"} err="failed to get container status \"64caeb2e8ff77d02807e2fd100f62a1cad06e520fa7c8348345db4539bae87a7\": rpc error: code = NotFound desc = could not find container \"64caeb2e8ff77d02807e2fd100f62a1cad06e520fa7c8348345db4539bae87a7\": container with ID starting with 64caeb2e8ff77d02807e2fd100f62a1cad06e520fa7c8348345db4539bae87a7 not found: ID does not exist"
Jul 07 15:38:11.261062 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:11.261028    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"]
Jul 07 15:38:11.263470 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:11.263448    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-83bd55-fff84b756-gpzvv"]
Jul 07 15:38:12.867440 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:12.867406    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="444ba328-43c1-48b1-8164-7132abbc8f62" path="/var/lib/kubelet/pods/444ba328-43c1-48b1-8164-7132abbc8f62/volumes"
Jul 07 15:38:29.055685 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.055641    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"]
Jul 07 15:38:29.056363 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.056337    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="444ba328-43c1-48b1-8164-7132abbc8f62" containerName="maas-api"
Jul 07 15:38:29.056466 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.056365    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="444ba328-43c1-48b1-8164-7132abbc8f62" containerName="maas-api"
Jul 07 15:38:29.056524 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.056483    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="444ba328-43c1-48b1-8164-7132abbc8f62" containerName="maas-api"
Jul 07 15:38:29.059951 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.059927    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:38:29.062432 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.062408    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-c9c5ee-serving-cert\""
Jul 07 15:38:29.070852 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.070822    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"]
Jul 07 15:38:29.161471 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.161432    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31810d32-4d64-40d8-8f8a-cfee456581ae-maas-api-tls\") pod \"maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm\" (UID: \"31810d32-4d64-40d8-8f8a-cfee456581ae\") " pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:38:29.161700 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.161488    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31810d32-4d64-40d8-8f8a-cfee456581ae-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm\" (UID: \"31810d32-4d64-40d8-8f8a-cfee456581ae\") " pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:38:29.161700 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.161662    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tln5d\" (UniqueName: \"kubernetes.io/projected/31810d32-4d64-40d8-8f8a-cfee456581ae-kube-api-access-tln5d\") pod \"maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm\" (UID: \"31810d32-4d64-40d8-8f8a-cfee456581ae\") " pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:38:29.262545 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.262508    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tln5d\" (UniqueName: \"kubernetes.io/projected/31810d32-4d64-40d8-8f8a-cfee456581ae-kube-api-access-tln5d\") pod \"maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm\" (UID: \"31810d32-4d64-40d8-8f8a-cfee456581ae\") " pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:38:29.262764 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.262555    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31810d32-4d64-40d8-8f8a-cfee456581ae-maas-api-tls\") pod \"maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm\" (UID: \"31810d32-4d64-40d8-8f8a-cfee456581ae\") " pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:38:29.262764 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.262590    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31810d32-4d64-40d8-8f8a-cfee456581ae-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm\" (UID: \"31810d32-4d64-40d8-8f8a-cfee456581ae\") " pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:38:29.263375 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.263353    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31810d32-4d64-40d8-8f8a-cfee456581ae-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm\" (UID: \"31810d32-4d64-40d8-8f8a-cfee456581ae\") " pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:38:29.265135 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.265112    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31810d32-4d64-40d8-8f8a-cfee456581ae-maas-api-tls\") pod \"maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm\" (UID: \"31810d32-4d64-40d8-8f8a-cfee456581ae\") " pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:38:29.271374 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.271337    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tln5d\" (UniqueName: \"kubernetes.io/projected/31810d32-4d64-40d8-8f8a-cfee456581ae-kube-api-access-tln5d\") pod \"maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm\" (UID: \"31810d32-4d64-40d8-8f8a-cfee456581ae\") " pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:38:29.373108 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.372977    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:38:29.516705 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:29.516635    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"]
Jul 07 15:38:29.519163 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:38:29.519116    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31810d32_4d64_40d8_8f8a_cfee456581ae.slice/crio-bae9b1903f7b68af7107ece7108fc116e750f004d45a5d615f36233fd01038a7 WatchSource:0}: Error finding container bae9b1903f7b68af7107ece7108fc116e750f004d45a5d615f36233fd01038a7: Status 404 returned error can't find the container with id bae9b1903f7b68af7107ece7108fc116e750f004d45a5d615f36233fd01038a7
Jul 07 15:38:30.336759 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:30.336723    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm" event={"ID":"31810d32-4d64-40d8-8f8a-cfee456581ae","Type":"ContainerStarted","Data":"bae9b1903f7b68af7107ece7108fc116e750f004d45a5d615f36233fd01038a7"}
Jul 07 15:38:31.342377 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:31.342338    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm" event={"ID":"31810d32-4d64-40d8-8f8a-cfee456581ae","Type":"ContainerStarted","Data":"dfcd7a61307d1187a83414106b87c8fe8a90c3a1bb56e5e998f5bcbd00a572f7"}
Jul 07 15:38:31.342881 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:31.342462    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:38:31.360589 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:31.360535    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm" podStartSLOduration=1.46102599 podStartE2EDuration="2.36051941s" totalImagesPullingTime="899.49342ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:38:31.358904901 +0000 UTC m=+2271.092791308" watchObservedRunningTime="2026-07-07 15:38:31.36051941 +0000 UTC m=+2271.094405851"
Jul 07 15:38:37.352585 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:38:37.352555    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:39:12.804775 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.804738    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"]
Jul 07 15:39:12.808584 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.808559    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.811533 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.811508    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c9c5ee\"/\"openshift-service-ca.crt\""
Jul 07 15:39:12.812241 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.812222    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c9c5ee\"/\"auth-test-model-c9c5ee-kserve-self-signed-certs\""
Jul 07 15:39:12.812241 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.812231    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c9c5ee\"/\"default-dockercfg-dsfxh\""
Jul 07 15:39:12.812382 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.812232    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c9c5ee\"/\"kube-root-ca.crt\""
Jul 07 15:39:12.819713 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.819678    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"]
Jul 07 15:39:12.876279 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.876243    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-home\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.876279 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.876276    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-dshm\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.876531 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.876298    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-tmp-dir\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.876531 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.876396    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-model-cache\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.876531 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.876442    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tj88\" (UniqueName: \"kubernetes.io/projected/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-kube-api-access-8tj88\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.876531 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.876508    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-tls-certs\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.977829 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.977792    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-home\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.977829 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.977836    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-dshm\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.978164 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.977873    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-tmp-dir\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.978164 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.977922    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-model-cache\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.978164 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.977952    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tj88\" (UniqueName: \"kubernetes.io/projected/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-kube-api-access-8tj88\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.978164 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.977992    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-tls-certs\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.978368 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.978282    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-home\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.978581 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.978559    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-tmp-dir\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.978669 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.978596    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-model-cache\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.980456 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.980424    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-dshm\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:12.980858 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:12.980836    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-tls-certs\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:13.000133 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:13.000100    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tj88\" (UniqueName: \"kubernetes.io/projected/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-kube-api-access-8tj88\") pod \"auth-test-model-c9c5ee-kserve-6d546765c9-82h47\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") " pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:13.119465 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:13.119370    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:13.264691 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:13.264651    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"]
Jul 07 15:39:13.266815 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:39:13.266788    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc31468c3_03c5_4fd1_b3b8_6b0191de3f5f.slice/crio-0f3605cc53672e26647f46132e199d1bcc7d0d7dd9fdb8aee206e88b68d2b2b9 WatchSource:0}: Error finding container 0f3605cc53672e26647f46132e199d1bcc7d0d7dd9fdb8aee206e88b68d2b2b9: Status 404 returned error can't find the container with id 0f3605cc53672e26647f46132e199d1bcc7d0d7dd9fdb8aee206e88b68d2b2b9
Jul 07 15:39:13.560697 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:13.560664    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47" event={"ID":"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f","Type":"ContainerStarted","Data":"a9c807dac4083d60f01bb8d2d4257485eaef804c322c72633369d0a87e5550cd"}
Jul 07 15:39:13.560886 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:13.560705    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47" event={"ID":"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f","Type":"ContainerStarted","Data":"0f3605cc53672e26647f46132e199d1bcc7d0d7dd9fdb8aee206e88b68d2b2b9"}
Jul 07 15:39:13.577284 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:13.577225    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47" podStartSLOduration=1.5772062550000001 podStartE2EDuration="1.577206255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:39:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:39:13.577149305 +0000 UTC m=+2313.311035687" watchObservedRunningTime="2026-07-07 15:39:13.577206255 +0000 UTC m=+2313.311092636"
Jul 07 15:39:23.120456 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:23.120404    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:23.120998 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:23.120469    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:23.133063 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:23.133037    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:39:23.624506 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:39:23.624474    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:40:40.878987 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:40:40.878874    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:40:40.885106 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:40:40.885083    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:41:13.378813 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:13.378727    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"]
Jul 07 15:41:21.802889 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.802852    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"]
Jul 07 15:41:21.811988 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.811952    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.814693 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.814665    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f09258\"/\"kube-root-ca.crt\""
Jul 07 15:41:21.814891 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.814723    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f09258\"/\"openshift-service-ca.crt\""
Jul 07 15:41:21.815644 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.815621    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f09258\"/\"default-dockercfg-qdlx9\""
Jul 07 15:41:21.815759 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.815645    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f09258\"/\"sub-test-model-f09258-kserve-self-signed-certs\""
Jul 07 15:41:21.816183 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.816163    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"]
Jul 07 15:41:21.896821 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.896780    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js8wq\" (UniqueName: \"kubernetes.io/projected/7565ab2a-b4b8-4057-aabd-751242111d82-kube-api-access-js8wq\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.897066 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.896841    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-tmp-dir\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.897066 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.896892    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7565ab2a-b4b8-4057-aabd-751242111d82-tls-certs\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.897066 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.896969    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-home\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.897254 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.897071    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-model-cache\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.897254 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.897121    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-dshm\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.997905 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.997865    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js8wq\" (UniqueName: \"kubernetes.io/projected/7565ab2a-b4b8-4057-aabd-751242111d82-kube-api-access-js8wq\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.998233 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.998207    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-tmp-dir\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.998367 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.998353    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7565ab2a-b4b8-4057-aabd-751242111d82-tls-certs\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.998520 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.998498    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-home\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.998663 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.998555    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-model-cache\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.998663 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.998609    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-dshm\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.998790 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.998680    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-tmp-dir\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.998882 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.998855    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-home\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:21.998954 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:21.998937    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-model-cache\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:22.001345 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:22.001311    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-dshm\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:22.001529 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:22.001382    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7565ab2a-b4b8-4057-aabd-751242111d82-tls-certs\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:22.008778 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:22.008748    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js8wq\" (UniqueName: \"kubernetes.io/projected/7565ab2a-b4b8-4057-aabd-751242111d82-kube-api-access-js8wq\") pod \"sub-test-model-f09258-kserve-5df885dd79-6bxt7\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") " pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:22.123234 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:22.123136    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:22.272168 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:22.272141    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"]
Jul 07 15:41:22.274442 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:41:22.274413    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7565ab2a_b4b8_4057_aabd_751242111d82.slice/crio-bf0ee5d9d3f08f9006a127b2d507a9d33098acd1a8af9ff7ffdbc3382c83c2f9 WatchSource:0}: Error finding container bf0ee5d9d3f08f9006a127b2d507a9d33098acd1a8af9ff7ffdbc3382c83c2f9: Status 404 returned error can't find the container with id bf0ee5d9d3f08f9006a127b2d507a9d33098acd1a8af9ff7ffdbc3382c83c2f9
Jul 07 15:41:23.203181 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:23.203145    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7" event={"ID":"7565ab2a-b4b8-4057-aabd-751242111d82","Type":"ContainerStarted","Data":"fc32118477bb5175739f3ddd11cd35f013ff626e501e7a8bafe9b2b2819cdcfc"}
Jul 07 15:41:23.203181 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:23.203189    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7" event={"ID":"7565ab2a-b4b8-4057-aabd-751242111d82","Type":"ContainerStarted","Data":"bf0ee5d9d3f08f9006a127b2d507a9d33098acd1a8af9ff7ffdbc3382c83c2f9"}
Jul 07 15:41:23.220713 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:23.220660    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7" podStartSLOduration=2.220644208 podStartE2EDuration="2.220644208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:23.2193963 +0000 UTC m=+2442.953282699" watchObservedRunningTime="2026-07-07 15:41:23.220644208 +0000 UTC m=+2442.954530590"
Jul 07 15:41:28.399686 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.399639    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47" podUID="c31468c3-03c5-4fd1-b3b8-6b0191de3f5f" containerName="main" containerID="cri-o://a9c807dac4083d60f01bb8d2d4257485eaef804c322c72633369d0a87e5550cd" gracePeriod=45
Jul 07 15:41:28.660956 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.660882    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:41:28.771075 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.771034    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-dshm\") pod \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") "
Jul 07 15:41:28.771075 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.771075    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-tmp-dir\") pod \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") "
Jul 07 15:41:28.771309 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.771095    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-home\") pod \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") "
Jul 07 15:41:28.771309 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.771129    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tj88\" (UniqueName: \"kubernetes.io/projected/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-kube-api-access-8tj88\") pod \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") "
Jul 07 15:41:28.771309 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.771284    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-model-cache\") pod \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") "
Jul 07 15:41:28.771466 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.771339    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-tls-certs\") pod \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\" (UID: \"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f\") "
Jul 07 15:41:28.771466 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.771336    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c31468c3-03c5-4fd1-b3b8-6b0191de3f5f" (UID: "c31468c3-03c5-4fd1-b3b8-6b0191de3f5f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:41:28.771466 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.771347    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-home" (OuterVolumeSpecName: "home") pod "c31468c3-03c5-4fd1-b3b8-6b0191de3f5f" (UID: "c31468c3-03c5-4fd1-b3b8-6b0191de3f5f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:41:28.771622 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.771576    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-model-cache" (OuterVolumeSpecName: "model-cache") pod "c31468c3-03c5-4fd1-b3b8-6b0191de3f5f" (UID: "c31468c3-03c5-4fd1-b3b8-6b0191de3f5f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:41:28.771669 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.771647    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-tmp-dir\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:41:28.771669 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.771664    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-home\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:41:28.773357 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.773332    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-dshm" (OuterVolumeSpecName: "dshm") pod "c31468c3-03c5-4fd1-b3b8-6b0191de3f5f" (UID: "c31468c3-03c5-4fd1-b3b8-6b0191de3f5f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:41:28.773507 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.773432    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-kube-api-access-8tj88" (OuterVolumeSpecName: "kube-api-access-8tj88") pod "c31468c3-03c5-4fd1-b3b8-6b0191de3f5f" (UID: "c31468c3-03c5-4fd1-b3b8-6b0191de3f5f"). InnerVolumeSpecName "kube-api-access-8tj88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:41:28.773567 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.773502    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c31468c3-03c5-4fd1-b3b8-6b0191de3f5f" (UID: "c31468c3-03c5-4fd1-b3b8-6b0191de3f5f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:41:28.872401 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.872371    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-model-cache\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:41:28.872401 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.872397    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-tls-certs\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:41:28.872401 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.872405    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-dshm\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:41:28.872642 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:28.872414    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tj88\" (UniqueName: \"kubernetes.io/projected/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f-kube-api-access-8tj88\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:41:29.235413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:29.235380    2574 generic.go:356] "Generic (PLEG): container finished" podID="c31468c3-03c5-4fd1-b3b8-6b0191de3f5f" containerID="a9c807dac4083d60f01bb8d2d4257485eaef804c322c72633369d0a87e5550cd" exitCode=0
Jul 07 15:41:29.235616 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:29.235428    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"
Jul 07 15:41:29.235616 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:29.235453    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47" event={"ID":"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f","Type":"ContainerDied","Data":"a9c807dac4083d60f01bb8d2d4257485eaef804c322c72633369d0a87e5550cd"}
Jul 07 15:41:29.235616 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:29.235485    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47" event={"ID":"c31468c3-03c5-4fd1-b3b8-6b0191de3f5f","Type":"ContainerDied","Data":"0f3605cc53672e26647f46132e199d1bcc7d0d7dd9fdb8aee206e88b68d2b2b9"}
Jul 07 15:41:29.235616 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:29.235502    2574 scope.go:117] "RemoveContainer" containerID="a9c807dac4083d60f01bb8d2d4257485eaef804c322c72633369d0a87e5550cd"
Jul 07 15:41:29.244762 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:29.244734    2574 scope.go:117] "RemoveContainer" containerID="a9c807dac4083d60f01bb8d2d4257485eaef804c322c72633369d0a87e5550cd"
Jul 07 15:41:29.245094 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:41:29.245063    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9c807dac4083d60f01bb8d2d4257485eaef804c322c72633369d0a87e5550cd\": container with ID starting with a9c807dac4083d60f01bb8d2d4257485eaef804c322c72633369d0a87e5550cd not found: ID does not exist" containerID="a9c807dac4083d60f01bb8d2d4257485eaef804c322c72633369d0a87e5550cd"
Jul 07 15:41:29.245188 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:29.245094    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c807dac4083d60f01bb8d2d4257485eaef804c322c72633369d0a87e5550cd"} err="failed to get container status \"a9c807dac4083d60f01bb8d2d4257485eaef804c322c72633369d0a87e5550cd\": rpc error: code = NotFound desc = could not find container \"a9c807dac4083d60f01bb8d2d4257485eaef804c322c72633369d0a87e5550cd\": container with ID starting with a9c807dac4083d60f01bb8d2d4257485eaef804c322c72633369d0a87e5550cd not found: ID does not exist"
Jul 07 15:41:29.250867 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:29.250845    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"]
Jul 07 15:41:29.254886 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:29.254864    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/auth-test-model-c9c5ee-kserve-6d546765c9-82h47"]
Jul 07 15:41:30.868208 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:30.868170    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c31468c3-03c5-4fd1-b3b8-6b0191de3f5f" path="/var/lib/kubelet/pods/c31468c3-03c5-4fd1-b3b8-6b0191de3f5f/volumes"
Jul 07 15:41:32.124134 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:32.124095    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:32.124524 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:32.124146    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:32.136905 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:32.136875    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:41:32.263949 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:41:32.263918    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:42:40.331112 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:40.331068    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"]
Jul 07 15:42:55.352900 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.352854    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7" podUID="7565ab2a-b4b8-4057-aabd-751242111d82" containerName="main" containerID="cri-o://fc32118477bb5175739f3ddd11cd35f013ff626e501e7a8bafe9b2b2819cdcfc" gracePeriod=45
Jul 07 15:42:55.616188 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.616116    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:42:55.678311 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.678270    2574 generic.go:356] "Generic (PLEG): container finished" podID="7565ab2a-b4b8-4057-aabd-751242111d82" containerID="fc32118477bb5175739f3ddd11cd35f013ff626e501e7a8bafe9b2b2819cdcfc" exitCode=0
Jul 07 15:42:55.678524 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.678321    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"
Jul 07 15:42:55.678524 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.678359    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7" event={"ID":"7565ab2a-b4b8-4057-aabd-751242111d82","Type":"ContainerDied","Data":"fc32118477bb5175739f3ddd11cd35f013ff626e501e7a8bafe9b2b2819cdcfc"}
Jul 07 15:42:55.678524 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.678416    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7" event={"ID":"7565ab2a-b4b8-4057-aabd-751242111d82","Type":"ContainerDied","Data":"bf0ee5d9d3f08f9006a127b2d507a9d33098acd1a8af9ff7ffdbc3382c83c2f9"}
Jul 07 15:42:55.678524 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.678441    2574 scope.go:117] "RemoveContainer" containerID="fc32118477bb5175739f3ddd11cd35f013ff626e501e7a8bafe9b2b2819cdcfc"
Jul 07 15:42:55.687000 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.686979    2574 scope.go:117] "RemoveContainer" containerID="fc32118477bb5175739f3ddd11cd35f013ff626e501e7a8bafe9b2b2819cdcfc"
Jul 07 15:42:55.687305 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:42:55.687286    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc32118477bb5175739f3ddd11cd35f013ff626e501e7a8bafe9b2b2819cdcfc\": container with ID starting with fc32118477bb5175739f3ddd11cd35f013ff626e501e7a8bafe9b2b2819cdcfc not found: ID does not exist" containerID="fc32118477bb5175739f3ddd11cd35f013ff626e501e7a8bafe9b2b2819cdcfc"
Jul 07 15:42:55.687365 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.687313    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc32118477bb5175739f3ddd11cd35f013ff626e501e7a8bafe9b2b2819cdcfc"} err="failed to get container status \"fc32118477bb5175739f3ddd11cd35f013ff626e501e7a8bafe9b2b2819cdcfc\": rpc error: code = NotFound desc = could not find container \"fc32118477bb5175739f3ddd11cd35f013ff626e501e7a8bafe9b2b2819cdcfc\": container with ID starting with fc32118477bb5175739f3ddd11cd35f013ff626e501e7a8bafe9b2b2819cdcfc not found: ID does not exist"
Jul 07 15:42:55.792941 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.792903    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-dshm\") pod \"7565ab2a-b4b8-4057-aabd-751242111d82\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") "
Jul 07 15:42:55.793166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.792960    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-tmp-dir\") pod \"7565ab2a-b4b8-4057-aabd-751242111d82\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") "
Jul 07 15:42:55.793166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.793056    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js8wq\" (UniqueName: \"kubernetes.io/projected/7565ab2a-b4b8-4057-aabd-751242111d82-kube-api-access-js8wq\") pod \"7565ab2a-b4b8-4057-aabd-751242111d82\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") "
Jul 07 15:42:55.793166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.793071    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-model-cache\") pod \"7565ab2a-b4b8-4057-aabd-751242111d82\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") "
Jul 07 15:42:55.793166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.793106    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7565ab2a-b4b8-4057-aabd-751242111d82-tls-certs\") pod \"7565ab2a-b4b8-4057-aabd-751242111d82\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") "
Jul 07 15:42:55.793166 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.793165    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-home\") pod \"7565ab2a-b4b8-4057-aabd-751242111d82\" (UID: \"7565ab2a-b4b8-4057-aabd-751242111d82\") "
Jul 07 15:42:55.793440 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.793323    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7565ab2a-b4b8-4057-aabd-751242111d82" (UID: "7565ab2a-b4b8-4057-aabd-751242111d82"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:42:55.793440 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.793361    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-model-cache" (OuterVolumeSpecName: "model-cache") pod "7565ab2a-b4b8-4057-aabd-751242111d82" (UID: "7565ab2a-b4b8-4057-aabd-751242111d82"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:42:55.793550 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.793466    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-home" (OuterVolumeSpecName: "home") pod "7565ab2a-b4b8-4057-aabd-751242111d82" (UID: "7565ab2a-b4b8-4057-aabd-751242111d82"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:42:55.793550 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.793533    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-tmp-dir\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:42:55.793550 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.793548    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-model-cache\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:42:55.795447 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.795404    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-dshm" (OuterVolumeSpecName: "dshm") pod "7565ab2a-b4b8-4057-aabd-751242111d82" (UID: "7565ab2a-b4b8-4057-aabd-751242111d82"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:42:55.795566 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.795441    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7565ab2a-b4b8-4057-aabd-751242111d82-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7565ab2a-b4b8-4057-aabd-751242111d82" (UID: "7565ab2a-b4b8-4057-aabd-751242111d82"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:42:55.795566 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.795501    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7565ab2a-b4b8-4057-aabd-751242111d82-kube-api-access-js8wq" (OuterVolumeSpecName: "kube-api-access-js8wq") pod "7565ab2a-b4b8-4057-aabd-751242111d82" (UID: "7565ab2a-b4b8-4057-aabd-751242111d82"). InnerVolumeSpecName "kube-api-access-js8wq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:42:55.894373 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.894289    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js8wq\" (UniqueName: \"kubernetes.io/projected/7565ab2a-b4b8-4057-aabd-751242111d82-kube-api-access-js8wq\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:42:55.894373 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.894323    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7565ab2a-b4b8-4057-aabd-751242111d82-tls-certs\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:42:55.894373 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.894333    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-home\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:42:55.894373 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:55.894340    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7565ab2a-b4b8-4057-aabd-751242111d82-dshm\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:42:56.000456 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:56.000420    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"]
Jul 07 15:42:56.003918 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:56.003891    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f09258/sub-test-model-f09258-kserve-5df885dd79-6bxt7"]
Jul 07 15:42:56.868112 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:42:56.868073    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7565ab2a-b4b8-4057-aabd-751242111d82" path="/var/lib/kubelet/pods/7565ab2a-b4b8-4057-aabd-751242111d82/volumes"
Jul 07 15:43:15.602572 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.602526    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"]
Jul 07 15:43:15.603040 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.603021    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7565ab2a-b4b8-4057-aabd-751242111d82" containerName="main"
Jul 07 15:43:15.603089 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.603045    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7565ab2a-b4b8-4057-aabd-751242111d82" containerName="main"
Jul 07 15:43:15.603089 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.603061    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c31468c3-03c5-4fd1-b3b8-6b0191de3f5f" containerName="main"
Jul 07 15:43:15.603089 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.603070    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c31468c3-03c5-4fd1-b3b8-6b0191de3f5f" containerName="main"
Jul 07 15:43:15.603203 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.603192    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c31468c3-03c5-4fd1-b3b8-6b0191de3f5f" containerName="main"
Jul 07 15:43:15.603238 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.603206    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7565ab2a-b4b8-4057-aabd-751242111d82" containerName="main"
Jul 07 15:43:15.607685 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.607668    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.610125 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.610101    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c9c5ee\"/\"openshift-service-ca.crt\""
Jul 07 15:43:15.610813 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.610791    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c9c5ee\"/\"default-dockercfg-dsfxh\""
Jul 07 15:43:15.610913 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.610811    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c9c5ee\"/\"kube-root-ca.crt\""
Jul 07 15:43:15.610913 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.610841    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c9c5ee\"/\"rate-test-model-c9c5ee-kserve-self-signed-certs\""
Jul 07 15:43:15.614764 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.614690    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"]
Jul 07 15:43:15.681979 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.681950    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-tmp-dir\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.682182 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.681995    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb559cba-e71b-43a9-b008-d72868a99bcb-tls-certs\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.682182 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.682084    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbdww\" (UniqueName: \"kubernetes.io/projected/fb559cba-e71b-43a9-b008-d72868a99bcb-kube-api-access-wbdww\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.682182 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.682138    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-home\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.682182 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.682161    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-dshm\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.682363 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.682223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-model-cache\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.782792 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.782752    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-model-cache\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.783047 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.782813    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-tmp-dir\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.783047 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.782843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb559cba-e71b-43a9-b008-d72868a99bcb-tls-certs\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.783047 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.782864    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbdww\" (UniqueName: \"kubernetes.io/projected/fb559cba-e71b-43a9-b008-d72868a99bcb-kube-api-access-wbdww\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.783047 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.782886    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-home\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.783047 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.782902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-dshm\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.783337 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.783266    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-model-cache\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.783337 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.783308    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-tmp-dir\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.783407 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.783375    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-home\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.785233 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.785210    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-dshm\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.785340 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.785319    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb559cba-e71b-43a9-b008-d72868a99bcb-tls-certs\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.790424 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.790400    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbdww\" (UniqueName: \"kubernetes.io/projected/fb559cba-e71b-43a9-b008-d72868a99bcb-kube-api-access-wbdww\") pod \"rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") " pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:15.918308 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:15.918206    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:16.059555 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:16.059528    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"]
Jul 07 15:43:16.062071 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:43:16.062043    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb559cba_e71b_43a9_b008_d72868a99bcb.slice/crio-e10fcfc36cb069acd80c8afaf5a53373b072d5eedf3cb8cbad65c4cc8dab0200 WatchSource:0}: Error finding container e10fcfc36cb069acd80c8afaf5a53373b072d5eedf3cb8cbad65c4cc8dab0200: Status 404 returned error can't find the container with id e10fcfc36cb069acd80c8afaf5a53373b072d5eedf3cb8cbad65c4cc8dab0200
Jul 07 15:43:16.785994 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:16.785951    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq" event={"ID":"fb559cba-e71b-43a9-b008-d72868a99bcb","Type":"ContainerStarted","Data":"1794ea84a324088d425702cef7cf88ad706bca238f98fdf5655299bda81d4d27"}
Jul 07 15:43:16.786411 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:16.786021    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq" event={"ID":"fb559cba-e71b-43a9-b008-d72868a99bcb","Type":"ContainerStarted","Data":"e10fcfc36cb069acd80c8afaf5a53373b072d5eedf3cb8cbad65c4cc8dab0200"}
Jul 07 15:43:16.802542 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:16.802481    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq" podStartSLOduration=1.802463656 podStartE2EDuration="1.802463656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:43:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:16.801430776 +0000 UTC m=+2556.535317162" watchObservedRunningTime="2026-07-07 15:43:16.802463656 +0000 UTC m=+2556.536350038"
Jul 07 15:43:25.918426 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:25.918379    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:25.918945 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:25.918441    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:25.931274 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:25.931245    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:43:26.847270 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:43:26.847232    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:44:02.924269 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:02.924178    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"]
Jul 07 15:44:17.946912 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:17.946865    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq" podUID="fb559cba-e71b-43a9-b008-d72868a99bcb" containerName="main" containerID="cri-o://1794ea84a324088d425702cef7cf88ad706bca238f98fdf5655299bda81d4d27" gracePeriod=45
Jul 07 15:44:18.094920 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.094878    2574 generic.go:356] "Generic (PLEG): container finished" podID="fb559cba-e71b-43a9-b008-d72868a99bcb" containerID="1794ea84a324088d425702cef7cf88ad706bca238f98fdf5655299bda81d4d27" exitCode=0
Jul 07 15:44:18.095104 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.094941    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq" event={"ID":"fb559cba-e71b-43a9-b008-d72868a99bcb","Type":"ContainerDied","Data":"1794ea84a324088d425702cef7cf88ad706bca238f98fdf5655299bda81d4d27"}
Jul 07 15:44:18.203524 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.203450    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:44:18.376823 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.376789    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbdww\" (UniqueName: \"kubernetes.io/projected/fb559cba-e71b-43a9-b008-d72868a99bcb-kube-api-access-wbdww\") pod \"fb559cba-e71b-43a9-b008-d72868a99bcb\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") "
Jul 07 15:44:18.377039 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.376849    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb559cba-e71b-43a9-b008-d72868a99bcb-tls-certs\") pod \"fb559cba-e71b-43a9-b008-d72868a99bcb\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") "
Jul 07 15:44:18.377039 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.376889    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-dshm\") pod \"fb559cba-e71b-43a9-b008-d72868a99bcb\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") "
Jul 07 15:44:18.377237 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.377046    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-tmp-dir\") pod \"fb559cba-e71b-43a9-b008-d72868a99bcb\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") "
Jul 07 15:44:18.377237 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.377084    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-home\") pod \"fb559cba-e71b-43a9-b008-d72868a99bcb\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") "
Jul 07 15:44:18.377237 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.377102    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-model-cache\") pod \"fb559cba-e71b-43a9-b008-d72868a99bcb\" (UID: \"fb559cba-e71b-43a9-b008-d72868a99bcb\") "
Jul 07 15:44:18.377397 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.377361    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb559cba-e71b-43a9-b008-d72868a99bcb" (UID: "fb559cba-e71b-43a9-b008-d72868a99bcb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:44:18.377397 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.377371    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-home" (OuterVolumeSpecName: "home") pod "fb559cba-e71b-43a9-b008-d72868a99bcb" (UID: "fb559cba-e71b-43a9-b008-d72868a99bcb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:44:18.377499 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.377444    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-home\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:44:18.377499 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.377460    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-tmp-dir\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:44:18.377601 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.377540    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb559cba-e71b-43a9-b008-d72868a99bcb" (UID: "fb559cba-e71b-43a9-b008-d72868a99bcb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:44:18.379116 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.379089    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb559cba-e71b-43a9-b008-d72868a99bcb-kube-api-access-wbdww" (OuterVolumeSpecName: "kube-api-access-wbdww") pod "fb559cba-e71b-43a9-b008-d72868a99bcb" (UID: "fb559cba-e71b-43a9-b008-d72868a99bcb"). InnerVolumeSpecName "kube-api-access-wbdww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:44:18.379522 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.379495    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-dshm" (OuterVolumeSpecName: "dshm") pod "fb559cba-e71b-43a9-b008-d72868a99bcb" (UID: "fb559cba-e71b-43a9-b008-d72868a99bcb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:44:18.379590 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.379500    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb559cba-e71b-43a9-b008-d72868a99bcb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb559cba-e71b-43a9-b008-d72868a99bcb" (UID: "fb559cba-e71b-43a9-b008-d72868a99bcb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:44:18.478743 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.478637    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-model-cache\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:44:18.478743 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.478669    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbdww\" (UniqueName: \"kubernetes.io/projected/fb559cba-e71b-43a9-b008-d72868a99bcb-kube-api-access-wbdww\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:44:18.478743 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.478683    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb559cba-e71b-43a9-b008-d72868a99bcb-tls-certs\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:44:18.478743 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:18.478694    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb559cba-e71b-43a9-b008-d72868a99bcb-dshm\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:44:19.102021 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:19.101986    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"
Jul 07 15:44:19.102021 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:19.101997    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq" event={"ID":"fb559cba-e71b-43a9-b008-d72868a99bcb","Type":"ContainerDied","Data":"e10fcfc36cb069acd80c8afaf5a53373b072d5eedf3cb8cbad65c4cc8dab0200"}
Jul 07 15:44:19.102548 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:19.102069    2574 scope.go:117] "RemoveContainer" containerID="1794ea84a324088d425702cef7cf88ad706bca238f98fdf5655299bda81d4d27"
Jul 07 15:44:19.117601 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:19.117575    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"]
Jul 07 15:44:19.121439 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:19.121414    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c9c5ee/rate-test-model-c9c5ee-kserve-8b6c854dc-h7tnq"]
Jul 07 15:44:20.868040 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:20.867990    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb559cba-e71b-43a9-b008-d72868a99bcb" path="/var/lib/kubelet/pods/fb559cba-e71b-43a9-b008-d72868a99bcb/volumes"
Jul 07 15:44:48.372332 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:48.372296    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"]
Jul 07 15:44:48.372859 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:48.372613    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm" podUID="31810d32-4d64-40d8-8f8a-cfee456581ae" containerName="maas-api" containerID="cri-o://dfcd7a61307d1187a83414106b87c8fe8a90c3a1bb56e5e998f5bcbd00a572f7" gracePeriod=30
Jul 07 15:44:48.625371 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:48.625304    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:44:48.743349 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:48.743315    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31810d32-4d64-40d8-8f8a-cfee456581ae-maas-api-tls\") pod \"31810d32-4d64-40d8-8f8a-cfee456581ae\" (UID: \"31810d32-4d64-40d8-8f8a-cfee456581ae\") "
Jul 07 15:44:48.743349 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:48.743360    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tln5d\" (UniqueName: \"kubernetes.io/projected/31810d32-4d64-40d8-8f8a-cfee456581ae-kube-api-access-tln5d\") pod \"31810d32-4d64-40d8-8f8a-cfee456581ae\" (UID: \"31810d32-4d64-40d8-8f8a-cfee456581ae\") "
Jul 07 15:44:48.743650 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:48.743501    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31810d32-4d64-40d8-8f8a-cfee456581ae-openshift-service-ca\") pod \"31810d32-4d64-40d8-8f8a-cfee456581ae\" (UID: \"31810d32-4d64-40d8-8f8a-cfee456581ae\") "
Jul 07 15:44:48.744078 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:48.744051    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31810d32-4d64-40d8-8f8a-cfee456581ae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "31810d32-4d64-40d8-8f8a-cfee456581ae" (UID: "31810d32-4d64-40d8-8f8a-cfee456581ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:44:48.745861 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:48.745833    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31810d32-4d64-40d8-8f8a-cfee456581ae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "31810d32-4d64-40d8-8f8a-cfee456581ae" (UID: "31810d32-4d64-40d8-8f8a-cfee456581ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:44:48.746041 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:48.745964    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31810d32-4d64-40d8-8f8a-cfee456581ae-kube-api-access-tln5d" (OuterVolumeSpecName: "kube-api-access-tln5d") pod "31810d32-4d64-40d8-8f8a-cfee456581ae" (UID: "31810d32-4d64-40d8-8f8a-cfee456581ae"). InnerVolumeSpecName "kube-api-access-tln5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:44:48.844538 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:48.844499    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31810d32-4d64-40d8-8f8a-cfee456581ae-openshift-service-ca\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:44:48.844538 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:48.844532    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31810d32-4d64-40d8-8f8a-cfee456581ae-maas-api-tls\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:44:48.844538 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:48.844541    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tln5d\" (UniqueName: \"kubernetes.io/projected/31810d32-4d64-40d8-8f8a-cfee456581ae-kube-api-access-tln5d\") on node \"ip-10-0-132-187.ec2.internal\" DevicePath \"\""
Jul 07 15:44:49.247377 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:49.247339    2574 generic.go:356] "Generic (PLEG): container finished" podID="31810d32-4d64-40d8-8f8a-cfee456581ae" containerID="dfcd7a61307d1187a83414106b87c8fe8a90c3a1bb56e5e998f5bcbd00a572f7" exitCode=0
Jul 07 15:44:49.247541 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:49.247388    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm" event={"ID":"31810d32-4d64-40d8-8f8a-cfee456581ae","Type":"ContainerDied","Data":"dfcd7a61307d1187a83414106b87c8fe8a90c3a1bb56e5e998f5bcbd00a572f7"}
Jul 07 15:44:49.247541 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:49.247397    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"
Jul 07 15:44:49.247541 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:49.247437    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm" event={"ID":"31810d32-4d64-40d8-8f8a-cfee456581ae","Type":"ContainerDied","Data":"bae9b1903f7b68af7107ece7108fc116e750f004d45a5d615f36233fd01038a7"}
Jul 07 15:44:49.247541 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:49.247459    2574 scope.go:117] "RemoveContainer" containerID="dfcd7a61307d1187a83414106b87c8fe8a90c3a1bb56e5e998f5bcbd00a572f7"
Jul 07 15:44:49.257685 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:49.257665    2574 scope.go:117] "RemoveContainer" containerID="dfcd7a61307d1187a83414106b87c8fe8a90c3a1bb56e5e998f5bcbd00a572f7"
Jul 07 15:44:49.257968 ip-10-0-132-187 kubenswrapper[2574]: E0707 15:44:49.257949    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfcd7a61307d1187a83414106b87c8fe8a90c3a1bb56e5e998f5bcbd00a572f7\": container with ID starting with dfcd7a61307d1187a83414106b87c8fe8a90c3a1bb56e5e998f5bcbd00a572f7 not found: ID does not exist" containerID="dfcd7a61307d1187a83414106b87c8fe8a90c3a1bb56e5e998f5bcbd00a572f7"
Jul 07 15:44:49.258035 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:49.257977    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfcd7a61307d1187a83414106b87c8fe8a90c3a1bb56e5e998f5bcbd00a572f7"} err="failed to get container status \"dfcd7a61307d1187a83414106b87c8fe8a90c3a1bb56e5e998f5bcbd00a572f7\": rpc error: code = NotFound desc = could not find container \"dfcd7a61307d1187a83414106b87c8fe8a90c3a1bb56e5e998f5bcbd00a572f7\": container with ID starting with dfcd7a61307d1187a83414106b87c8fe8a90c3a1bb56e5e998f5bcbd00a572f7 not found: ID does not exist"
Jul 07 15:44:49.263754 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:49.263726    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"]
Jul 07 15:44:49.268164 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:49.268141    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-c9c5ee-789d8b96fd-gllbm"]
Jul 07 15:44:50.867586 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:50.867554    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31810d32-4d64-40d8-8f8a-cfee456581ae" path="/var/lib/kubelet/pods/31810d32-4d64-40d8-8f8a-cfee456581ae/volumes"
Jul 07 15:44:59.825884 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:59.825854    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nrp9q_5ee848ff-e538-4121-bcde-f0a77bc25a0f/manager/0.log"
Jul 07 15:44:59.956915 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:44:59.956885    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wwrpw_5fa8449e-d52f-4fa3-a953-7ec7bf5a9276/manager/0.log"
Jul 07 15:45:00.087856 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:00.087769    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-67fdfd6fd7-qq84k_0123178f-908f-41c3-9c90-7e041f345754/maas-api/0.log"
Jul 07 15:45:00.480454 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:00.480373    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79565bf89-7v2kc_36a58b23-fe35-4bb7-91d5-7a181791954f/manager/0.log"
Jul 07 15:45:00.613419 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:00.613393    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-9844g_33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f/server/0.log"
Jul 07 15:45:00.768056 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:00.767949    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-x5vpc_548b6708-0881-443a-80ac-ae1bde1ff258/manager/0.log"
Jul 07 15:45:01.037308 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:01.037273    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r_147699b4-cf44-43c8-8209-023dbc7f4530/manager/0.log"
Jul 07 15:45:01.045985 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:01.045959    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r_147699b4-cf44-43c8-8209-023dbc7f4530/copy-manifests/0.log"
Jul 07 15:45:01.309428 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:01.309346    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-zqndj_13d257de-bdf5-4799-8216-e4df06b277c0/postgres/0.log"
Jul 07 15:45:02.884055 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:02.884019    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-twsng_6ba1eec0-5477-44eb-9bb6-2a3a6c1fad0d/manager/0.log"
Jul 07 15:45:03.008579 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:03.008551    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4d6r4_2c7c8521-5d2a-46d6-b8a4-8d94d8fdd9d0/manager/0.log"
Jul 07 15:45:03.256919 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:03.256798    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4fmb7_2f993ec0-3651-42ef-8053-22badee4c172/registry-server/0.log"
Jul 07 15:45:03.388097 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:03.388053    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hn5f4_9fee9d09-aa4c-4210-8b31-b4088c9176d2/manager/0.log"
Jul 07 15:45:04.046567 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:04.046539    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bzw8p_e4525301-c30d-4c4d-b43f-97885a571e67/istio-proxy/0.log"
Jul 07 15:45:04.419026 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:04.418924    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f474c7cd5-wdbv2_16fe234c-0991-46e3-b902-796dfb8269ce/kube-auth-proxy/0.log"
Jul 07 15:45:04.541147 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:04.541119    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dh9t5_8f31700c-efe1-45d3-86cf-2e57eae0ea2c/istio-proxy/1.log"
Jul 07 15:45:04.663540 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:04.663512    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pkzkp_96e74d29-e4c7-4212-94ea-9842908c29d2/payload-pre-processing/0.log"
Jul 07 15:45:05.287986 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:05.287959    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-c4sl8_c76a69ee-fdb8-4fef-9386-b42acf577ec5/main/0.log"
Jul 07 15:45:05.416540 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:05.416514    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-8ckd2_8d90b11b-7c32-4644-b877-9b4c7d236620/main/0.log"
Jul 07 15:45:05.661962 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:05.661879    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9qfjn_5b30b685-e5bf-4a87-b176-bcf9c12b8ad8/main/0.log"
Jul 07 15:45:05.786548 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:05.786516    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-r5kx2_b4c1ff21-92d3-4ac3-8a70-ace731e25e65/main/0.log"
Jul 07 15:45:05.906184 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:05.906155    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-m78t2_539f6463-05cf-4308-a3ff-14c0aae30687/main/0.log"
Jul 07 15:45:13.124856 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:13.124827    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bklgh_9f6b1040-2676-427e-ad0e-9a086722f3f5/global-pull-secret-syncer/0.log"
Jul 07 15:45:13.330642 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:13.330610    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xb4ff_69c65439-2c4a-4d89-be0e-1a1f786f2657/konnectivity-agent/0.log"
Jul 07 15:45:13.399242 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:13.399144    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-187.ec2.internal_e1991cb1cdb7a97f906f31ef43205300/haproxy/0.log"
Jul 07 15:45:18.065621 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:18.065590    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-twsng_6ba1eec0-5477-44eb-9bb6-2a3a6c1fad0d/manager/0.log"
Jul 07 15:45:18.091016 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:18.090990    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4d6r4_2c7c8521-5d2a-46d6-b8a4-8d94d8fdd9d0/manager/0.log"
Jul 07 15:45:18.163414 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:18.163377    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4fmb7_2f993ec0-3651-42ef-8053-22badee4c172/registry-server/0.log"
Jul 07 15:45:18.260448 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:18.260416    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hn5f4_9fee9d09-aa4c-4210-8b31-b4088c9176d2/manager/0.log"
Jul 07 15:45:20.406956 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:20.406925    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7krp_e46bf1ba-9df2-49b9-aaa4-59d0a945c916/node-exporter/0.log"
Jul 07 15:45:20.428188 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:20.428164    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7krp_e46bf1ba-9df2-49b9-aaa4-59d0a945c916/kube-rbac-proxy/0.log"
Jul 07 15:45:20.449803 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:20.449780    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7krp_e46bf1ba-9df2-49b9-aaa4-59d0a945c916/init-textfile/0.log"
Jul 07 15:45:22.536533 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:22.536497    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-zp7ss_0e6fd9d6-e904-446a-b031-06ebe9ac9ace/networking-console-plugin/0.log"
Jul 07 15:45:23.994757 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:23.994721    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"]
Jul 07 15:45:23.995179 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:23.995140    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb559cba-e71b-43a9-b008-d72868a99bcb" containerName="main"
Jul 07 15:45:23.995179 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:23.995156    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb559cba-e71b-43a9-b008-d72868a99bcb" containerName="main"
Jul 07 15:45:23.995268 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:23.995190    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31810d32-4d64-40d8-8f8a-cfee456581ae" containerName="maas-api"
Jul 07 15:45:23.995268 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:23.995196    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="31810d32-4d64-40d8-8f8a-cfee456581ae" containerName="maas-api"
Jul 07 15:45:23.995336 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:23.995272    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb559cba-e71b-43a9-b008-d72868a99bcb" containerName="main"
Jul 07 15:45:23.995336 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:23.995281    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="31810d32-4d64-40d8-8f8a-cfee456581ae" containerName="maas-api"
Jul 07 15:45:23.998359 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:23.998339    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.000458 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.000439    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d8xvs\"/\"kube-root-ca.crt\""
Jul 07 15:45:24.000574 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.000506    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d8xvs\"/\"openshift-service-ca.crt\""
Jul 07 15:45:24.001413 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.001398    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d8xvs\"/\"default-dockercfg-lz587\""
Jul 07 15:45:24.010483 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.010461    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"]
Jul 07 15:45:24.069404 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.069365    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx6gw\" (UniqueName: \"kubernetes.io/projected/7cb28962-db49-4931-abf8-31f74cdb0487-kube-api-access-cx6gw\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.069593 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.069482    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7cb28962-db49-4931-abf8-31f74cdb0487-lib-modules\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.069593 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.069518    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7cb28962-db49-4931-abf8-31f74cdb0487-proc\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.069593 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.069562    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cb28962-db49-4931-abf8-31f74cdb0487-sys\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.069593 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.069590    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7cb28962-db49-4931-abf8-31f74cdb0487-podres\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.170398 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.170355    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx6gw\" (UniqueName: \"kubernetes.io/projected/7cb28962-db49-4931-abf8-31f74cdb0487-kube-api-access-cx6gw\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.170594 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.170462    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7cb28962-db49-4931-abf8-31f74cdb0487-lib-modules\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.170594 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.170499    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7cb28962-db49-4931-abf8-31f74cdb0487-proc\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.170594 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.170557    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cb28962-db49-4931-abf8-31f74cdb0487-sys\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.170594 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.170588    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7cb28962-db49-4931-abf8-31f74cdb0487-podres\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.170763 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.170660    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7cb28962-db49-4931-abf8-31f74cdb0487-proc\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.170763 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.170674    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cb28962-db49-4931-abf8-31f74cdb0487-sys\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.170763 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.170661    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7cb28962-db49-4931-abf8-31f74cdb0487-lib-modules\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.170763 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.170713    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7cb28962-db49-4931-abf8-31f74cdb0487-podres\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.178086 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.178065    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx6gw\" (UniqueName: \"kubernetes.io/projected/7cb28962-db49-4931-abf8-31f74cdb0487-kube-api-access-cx6gw\") pod \"perf-node-gather-daemonset-6nshc\" (UID: \"7cb28962-db49-4931-abf8-31f74cdb0487\") " pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.308847 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.308814    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:24.447550 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:24.447523    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"]
Jul 07 15:45:24.449416 ip-10-0-132-187 kubenswrapper[2574]: W0707 15:45:24.449386    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7cb28962_db49_4931_abf8_31f74cdb0487.slice/crio-1710551e3b8f9053d7612500781c61d3a26e71fc90545ac321695dfafe293faf WatchSource:0}: Error finding container 1710551e3b8f9053d7612500781c61d3a26e71fc90545ac321695dfafe293faf: Status 404 returned error can't find the container with id 1710551e3b8f9053d7612500781c61d3a26e71fc90545ac321695dfafe293faf
Jul 07 15:45:25.429953 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:25.429910    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc" event={"ID":"7cb28962-db49-4931-abf8-31f74cdb0487","Type":"ContainerStarted","Data":"487fe5d61ea9b0751e06cf310449f7687aed22916858d49bdf627a86b18d0ee0"}
Jul 07 15:45:25.430407 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:25.429980    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc" event={"ID":"7cb28962-db49-4931-abf8-31f74cdb0487","Type":"ContainerStarted","Data":"1710551e3b8f9053d7612500781c61d3a26e71fc90545ac321695dfafe293faf"}
Jul 07 15:45:25.430407 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:25.430031    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:25.448374 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:25.448323    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc" podStartSLOduration=2.448308089 podStartE2EDuration="2.448308089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:45:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:45:25.44595003 +0000 UTC m=+2685.179836411" watchObservedRunningTime="2026-07-07 15:45:25.448308089 +0000 UTC m=+2685.182194505"
Jul 07 15:45:25.482341 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:25.482317    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kpdq6_96e3cedc-88dc-46fe-bf69-bfaea614cc7f/dns/0.log"
Jul 07 15:45:25.502925 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:25.502903    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kpdq6_96e3cedc-88dc-46fe-bf69-bfaea614cc7f/kube-rbac-proxy/0.log"
Jul 07 15:45:25.637293 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:25.637263    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p492t_f6030f52-8069-4c84-971f-a3733c9c2f7c/dns-node-resolver/0.log"
Jul 07 15:45:26.221410 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:26.221382    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qmvsb_b88af1ec-e8e2-4a62-a235-7062bdc5c9f9/node-ca/0.log"
Jul 07 15:45:27.163945 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:27.163918    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bzw8p_e4525301-c30d-4c4d-b43f-97885a571e67/istio-proxy/0.log"
Jul 07 15:45:27.412267 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:27.412238    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f474c7cd5-wdbv2_16fe234c-0991-46e3-b902-796dfb8269ce/kube-auth-proxy/0.log"
Jul 07 15:45:27.441142 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:27.441067    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dh9t5_8f31700c-efe1-45d3-86cf-2e57eae0ea2c/istio-proxy/0.log"
Jul 07 15:45:27.471318 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:27.471282    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dh9t5_8f31700c-efe1-45d3-86cf-2e57eae0ea2c/istio-proxy/1.log"
Jul 07 15:45:27.503412 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:27.503383    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pkzkp_96e74d29-e4c7-4212-94ea-9842908c29d2/payload-pre-processing/0.log"
Jul 07 15:45:28.289477 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:28.289445    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k2882_bf15a5e6-deb7-4a52-bf42-1570d1d87182/serve-healthcheck-canary/0.log"
Jul 07 15:45:28.898329 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:28.898295    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mkq7w_48766641-8e93-4e51-a781-2ea6edda9326/kube-rbac-proxy/0.log"
Jul 07 15:45:28.920716 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:28.920687    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mkq7w_48766641-8e93-4e51-a781-2ea6edda9326/exporter/0.log"
Jul 07 15:45:28.943341 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:28.943312    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mkq7w_48766641-8e93-4e51-a781-2ea6edda9326/extractor/0.log"
Jul 07 15:45:31.107480 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:31.107450    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nrp9q_5ee848ff-e538-4121-bcde-f0a77bc25a0f/manager/0.log"
Jul 07 15:45:31.246282 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:31.246251    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wwrpw_5fa8449e-d52f-4fa3-a953-7ec7bf5a9276/manager/0.log"
Jul 07 15:45:31.278801 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:31.278763    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-67fdfd6fd7-qq84k_0123178f-908f-41c3-9c90-7e041f345754/maas-api/0.log"
Jul 07 15:45:31.445256 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:31.445167    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d8xvs/perf-node-gather-daemonset-6nshc"
Jul 07 15:45:31.458450 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:31.458424    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79565bf89-7v2kc_36a58b23-fe35-4bb7-91d5-7a181791954f/manager/0.log"
Jul 07 15:45:31.479910 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:31.479889    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-9844g_33ce1f51-0a14-4ba5-95d7-dcaa2d3e6f0f/server/0.log"
Jul 07 15:45:31.543339 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:31.543309    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-x5vpc_548b6708-0881-443a-80ac-ae1bde1ff258/manager/0.log"
Jul 07 15:45:31.661127 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:31.661097    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r_147699b4-cf44-43c8-8209-023dbc7f4530/manager/0.log"
Jul 07 15:45:31.677485 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:31.677458    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78cfd9ffc9-q7b4r_147699b4-cf44-43c8-8209-023dbc7f4530/copy-manifests/0.log"
Jul 07 15:45:31.748325 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:31.748233    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-zqndj_13d257de-bdf5-4799-8216-e4df06b277c0/postgres/0.log"
Jul 07 15:45:34.081355 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:34.081325    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bzw8p_e4525301-c30d-4c4d-b43f-97885a571e67/istio-proxy/0.log"
Jul 07 15:45:34.300240 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:34.300213    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f474c7cd5-wdbv2_16fe234c-0991-46e3-b902-796dfb8269ce/kube-auth-proxy/0.log"
Jul 07 15:45:34.321935 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:34.321905    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dh9t5_8f31700c-efe1-45d3-86cf-2e57eae0ea2c/istio-proxy/0.log"
Jul 07 15:45:34.353559 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:34.353478    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dh9t5_8f31700c-efe1-45d3-86cf-2e57eae0ea2c/istio-proxy/1.log"
Jul 07 15:45:34.373534 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:34.373497    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pkzkp_96e74d29-e4c7-4212-94ea-9842908c29d2/payload-pre-processing/0.log"
Jul 07 15:45:35.744933 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:35.744903    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bzw8p_e4525301-c30d-4c4d-b43f-97885a571e67/istio-proxy/0.log"
Jul 07 15:45:35.987787 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:35.987707    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f474c7cd5-wdbv2_16fe234c-0991-46e3-b902-796dfb8269ce/kube-auth-proxy/0.log"
Jul 07 15:45:36.008209 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:36.008183    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dh9t5_8f31700c-efe1-45d3-86cf-2e57eae0ea2c/istio-proxy/0.log"
Jul 07 15:45:36.036888 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:36.036856    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dh9t5_8f31700c-efe1-45d3-86cf-2e57eae0ea2c/istio-proxy/1.log"
Jul 07 15:45:36.058817 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:36.058787    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pkzkp_96e74d29-e4c7-4212-94ea-9842908c29d2/payload-pre-processing/0.log"
Jul 07 15:45:40.200342 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:40.200266    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsfgp_7c83f81e-fce0-4c5f-af0b-5a6662c9347b/kube-multus-additional-cni-plugins/0.log"
Jul 07 15:45:40.222312 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:40.222282    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsfgp_7c83f81e-fce0-4c5f-af0b-5a6662c9347b/egress-router-binary-copy/0.log"
Jul 07 15:45:40.246596 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:40.246571    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsfgp_7c83f81e-fce0-4c5f-af0b-5a6662c9347b/cni-plugins/0.log"
Jul 07 15:45:40.266296 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:40.266271    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsfgp_7c83f81e-fce0-4c5f-af0b-5a6662c9347b/bond-cni-plugin/0.log"
Jul 07 15:45:40.285436 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:40.285415    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsfgp_7c83f81e-fce0-4c5f-af0b-5a6662c9347b/routeoverride-cni/0.log"
Jul 07 15:45:40.305494 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:40.305467    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsfgp_7c83f81e-fce0-4c5f-af0b-5a6662c9347b/whereabouts-cni-bincopy/0.log"
Jul 07 15:45:40.328681 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:40.328654    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsfgp_7c83f81e-fce0-4c5f-af0b-5a6662c9347b/whereabouts-cni/0.log"
Jul 07 15:45:40.439529 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:40.439495    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vxzph_5f734035-38a4-44f2-80ae-1b668f6b158f/kube-multus/0.log"
Jul 07 15:45:40.553187 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:40.553157    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sw26l_28f4b5b7-49c8-4d2a-8bb7-21bcce740d31/network-metrics-daemon/0.log"
Jul 07 15:45:40.571803 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:40.571777    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sw26l_28f4b5b7-49c8-4d2a-8bb7-21bcce740d31/kube-rbac-proxy/0.log"
Jul 07 15:45:40.907951 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:40.907795    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:45:40.931189 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:40.915205    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:45:41.393573 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:41.393545    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-controller/0.log"
Jul 07 15:45:41.412481 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:41.412453    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/0.log"
Jul 07 15:45:41.412651 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:41.412457    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/ovn-acl-logging/1.log"
Jul 07 15:45:41.434086 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:41.434062    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/kube-rbac-proxy-node/0.log"
Jul 07 15:45:41.456163 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:41.456126    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/kube-rbac-proxy-ovn-metrics/0.log"
Jul 07 15:45:41.473991 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:41.473962    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/northd/0.log"
Jul 07 15:45:41.494036 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:41.494000    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/nbdb/0.log"
Jul 07 15:45:41.515616 ip-10-0-132-187 kubenswrapper[2574]: I0707 15:45:41.515583    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9zdp_1ac0f577-17f7-4195-ab40-ac4dc7c0e8c3/sbdb/0.log"