Jul 02 20:32:56.747199 ip-10-0-132-48 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 20:32:57.187322 ip-10-0-132-48 kubenswrapper[2586]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 20:32:57.187322 ip-10-0-132-48 kubenswrapper[2586]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 20:32:57.187322 ip-10-0-132-48 kubenswrapper[2586]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 20:32:57.187322 ip-10-0-132-48 kubenswrapper[2586]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 20:32:57.187322 ip-10-0-132-48 kubenswrapper[2586]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 20:32:57.187322 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.161555    2586 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 20:32:57.187322 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.165998    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:57.187322 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166014    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:57.187322 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166017    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:57.187322 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166023    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:57.187322 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166027    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:57.187322 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166031    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:57.187322 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166034    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:57.187322 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166037    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166040    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166043    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166047    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166050    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166053    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166056    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166058    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166061    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166063    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166066    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166069    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166072    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166075    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166078    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166081    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166083    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166085    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166088    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166091    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:57.188520 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166093    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166096    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166098    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166101    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166104    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166106    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166109    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166113    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166115    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166118    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166120    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166123    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166126    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166131    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166135    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166138    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166141    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166143    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166146    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166148    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:57.189058 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166151    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166154    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166157    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166159    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166162    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166164    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166167    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166170    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166172    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166174    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166177    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166180    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166182    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166186    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166189    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166192    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166195    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166197    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166201    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166204    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:57.189630 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166206    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166209    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166212    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166215    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166217    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166220    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166223    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166226    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166228    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166231    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166234    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166236    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166239    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166243    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166246    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166248    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166251    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166254    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166256    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166259    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:57.190644 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166261    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166264    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166266    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166269    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166272    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166275    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166278    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166280    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166283    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166285    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166288    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.166290    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167022    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167030    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167035    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167037    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167040    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167043    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167045    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:57.191243 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167048    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167051    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167054    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167056    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167059    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167061    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167064    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167068    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167071    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167073    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167076    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167078    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167081    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167084    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167086    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167089    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167091    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167093    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167096    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:57.191777 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167099    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167103    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167106    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167109    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167112    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167117    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167119    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167122    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167126    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167128    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167131    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167135    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167138    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167141    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167144    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167147    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167150    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167153    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167156    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167158    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:57.193266 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167161    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167163    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167166    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167168    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167171    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167175    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167178    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167182    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167185    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167187    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167189    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167192    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167195    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167198    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167200    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167203    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167206    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167208    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167211    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:57.194137 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167214    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167216    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167220    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167223    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167225    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167228    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167231    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167233    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167236    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167239    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167242    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167245    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167248    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167251    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167254    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167256    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167259    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167261    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167264    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:57.195194 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167266    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167269    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167272    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167274    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167277    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167281    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167284    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167287    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167290    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167292    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167295    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167297    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167300    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167302    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167305    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167697    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167702    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167705    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167708    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:57.197091 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167712    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167716    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167719    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167723    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167725    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167728    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167730    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167733    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167737    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167739    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167742    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167745    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167748    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167750    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167753    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167756    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167758    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167761    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167763    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:57.197697 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167766    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167769    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167771    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167774    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167776    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167778    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167781    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167784    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167787    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167789    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167791    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167795    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167798    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167800    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167803    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167806    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167808    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167813    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167816    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167819    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:57.282376 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167822    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:57.258665 ip-10-0-132-48 systemd[1]: Started Kubernetes Kubelet.
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167825    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167827    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167830    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167833    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167837    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167840    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167847    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167850    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167852    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167855    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167857    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167860    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167862    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167865    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167868    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167870    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167874    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167891    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:57.283302 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167894    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167896    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167899    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167902    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167904    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167907    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167909    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167912    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167914    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167917    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167920    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167924    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167927    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167930    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167933    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167935    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167938    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167941    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167943    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167946    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:57.284855 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167949    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167966    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167969    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167972    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167974    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167977    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167981    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167984    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167986    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167989    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167991    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167994    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167997    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.167999    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168002    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168004    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168007    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168080    2586 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168088    2586 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168098    2586 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168104    2586 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 20:32:57.285728 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168111    2586 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168115    2586 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168119    2586 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168124    2586 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168128    2586 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168131    2586 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168135    2586 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168138    2586 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168141    2586 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168144    2586 flags.go:64] FLAG: --cgroup-root=""
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168147    2586 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168152    2586 flags.go:64] FLAG: --client-ca-file=""
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168155    2586 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168158    2586 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168162    2586 flags.go:64] FLAG: --cluster-domain=""
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168164    2586 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168168    2586 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168173    2586 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168176    2586 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168180    2586 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168183    2586 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168186    2586 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168189    2586 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168192    2586 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 20:32:57.286911 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168195    2586 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168197    2586 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168200    2586 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168204    2586 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168208    2586 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168211    2586 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168217    2586 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168220    2586 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168223    2586 flags.go:64] FLAG: --enable-server="true"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168226    2586 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168231    2586 flags.go:64] FLAG: --event-burst="100"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168234    2586 flags.go:64] FLAG: --event-qps="50"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168243    2586 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168246    2586 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168249    2586 flags.go:64] FLAG: --eviction-hard=""
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168253    2586 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168256    2586 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168259    2586 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168262    2586 flags.go:64] FLAG: --eviction-soft=""
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168267    2586 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168269    2586 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168272    2586 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168275    2586 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168278    2586 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168281    2586 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 20:32:57.288180 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168285    2586 flags.go:64] FLAG: --feature-gates=""
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168289    2586 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168292    2586 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168295    2586 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168298    2586 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168301    2586 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168304    2586 flags.go:64] FLAG: --help="false"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168307    2586 flags.go:64] FLAG: --hostname-override="ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168310    2586 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168313    2586 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168316    2586 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168319    2586 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168322    2586 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168325    2586 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168328    2586 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168331    2586 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168334    2586 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168336    2586 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168340    2586 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168342    2586 flags.go:64] FLAG: --kube-reserved=""
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168346    2586 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168348    2586 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168351    2586 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168354    2586 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 20:32:57.289477 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168357    2586 flags.go:64] FLAG: --lock-file=""
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168359    2586 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168364    2586 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168367    2586 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168372    2586 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168375    2586 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168378    2586 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168381    2586 flags.go:64] FLAG: --logging-format="text"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168385    2586 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168388    2586 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168391    2586 flags.go:64] FLAG: --manifest-url=""
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168394    2586 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168398    2586 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168401    2586 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168404    2586 flags.go:64] FLAG: --max-pods="110"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168407    2586 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168410    2586 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168413    2586 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168416    2586 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168419    2586 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168422    2586 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168424    2586 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168432    2586 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168435    2586 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168438    2586 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 20:32:57.290474 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168441    2586 flags.go:64] FLAG: --pod-cidr=""
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168444    2586 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168449    2586 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168452    2586 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168456    2586 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168459    2586 flags.go:64] FLAG: --port="10250"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168462    2586 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168465    2586 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bd38829a0fb0ea49"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168468    2586 flags.go:64] FLAG: --qos-reserved=""
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168470    2586 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168475    2586 flags.go:64] FLAG: --register-node="true"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168478    2586 flags.go:64] FLAG: --register-with-taints=""
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168482    2586 flags.go:64] FLAG: --registry-burst="10"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168484    2586 flags.go:64] FLAG: --registry-qps="5"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168487    2586 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168491    2586 flags.go:64] FLAG: --reserved-memory=""
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168495    2586 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168498    2586 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168501    2586 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168504    2586 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168506    2586 flags.go:64] FLAG: --runonce="false"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168509    2586 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168512    2586 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168516    2586 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168518    2586 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 20:32:57.291806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168521    2586 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168524    2586 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168527    2586 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168530    2586 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168533    2586 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168535    2586 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168538    2586 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168541    2586 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168544    2586 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168547    2586 flags.go:64] FLAG: --system-cgroups=""
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168550    2586 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168555    2586 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168558    2586 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168561    2586 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168564    2586 flags.go:64] FLAG: --tls-min-version=""
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168567    2586 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168570    2586 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168575    2586 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168578    2586 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168581    2586 flags.go:64] FLAG: --v="2"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168585    2586 flags.go:64] FLAG: --version="false"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168588    2586 flags.go:64] FLAG: --vmodule=""
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168598    2586 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.168601    2586 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 20:32:57.292794 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168716    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168719    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168723    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168726    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168729    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168732    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168734    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168737    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168739    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168742    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168745    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168747    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168750    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168753    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168755    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168758    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168760    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168763    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168766    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:57.293643 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168770    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168773    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168777    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168780    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168784    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168787    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168791    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168794    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168797    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168800    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168803    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168807    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168810    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168812    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168815    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168817    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168820    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168822    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168825    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168828    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:57.294483 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168831    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168833    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168836    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168839    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168841    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168844    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168846    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168848    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168851    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168853    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168855    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168858    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168860    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168863    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168865    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168869    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168872    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168874    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168892    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168895    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:57.295123 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168897    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168900    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168903    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168907    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168909    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168912    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168915    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168919    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168922    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168925    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168927    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168930    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168932    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168935    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168938    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168941    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168943    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168946    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168949    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168951    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:57.295745 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168953    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168956    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168958    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168961    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168964    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168966    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168969    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168971    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168974    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168977    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168981    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168983    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168986    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168989    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168991    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168996    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.168998    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.169001    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.169004    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:57.297262 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.169006    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.169947    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.180601    2586 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.180637    2586 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.181498    2586 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.181519    2586 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181659    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181669    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181673    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181679    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181682    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181688    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181694    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181697    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181700    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:57.297892 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181706    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181709    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181712    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181717    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181720    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181723    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181728    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181730    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181733    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181740    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181743    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181746    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181751    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181754    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181759    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181765    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181768    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181773    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181777    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181782    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:57.299578 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181787    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181793    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181795    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181798    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181801    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181805    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181809    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181811    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181814    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181819    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181822    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181824    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181829    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181832    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181837    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181842    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181846    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181848    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181853    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:57.300230 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181858    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181868    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181871    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181891    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181895    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181900    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181903    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181908    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181913    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181916    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181920    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181928    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181931    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181935    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181939    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181943    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181948    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181951    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181953    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181961    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:57.301484 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181964    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181967    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181971    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181976    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181981    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181984    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181987    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181991    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181994    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.181997    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182000    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182002    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182007    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182010    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182015    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182019    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182022    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182027    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182029    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182032    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:57.302096 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182037    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182040    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182042    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182047    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182054    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182057    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182062    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182065    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182068    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182073    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182076    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.182082    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182422    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182431    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182434    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:57.302742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182440    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182446    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182451    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182454    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182457    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182462    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182465    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182468    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182473    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182476    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182478    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182485    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182488    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182491    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182502    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182507    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182510    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182513    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182515    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182520    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:57.303350 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182523    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182527    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182532    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182535    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182537    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182542    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182548    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182553    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182557    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182561    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182566    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182569    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182572    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182577    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182580    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182583    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182587    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182590    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182599    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:57.304021 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182603    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182606    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182610    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182613    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182618    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182621    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182624    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182627    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182631    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182634    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182637    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182640    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182647    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182650    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182656    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182659    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182662    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182667    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182671    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:57.304914 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182675    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182681    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182683    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182686    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182691    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182697    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182702    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182704    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182707    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182710    2586 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182715    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182717    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182720    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182725    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182728    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182731    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182734    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182740    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182745    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182750    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:57.305516 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182753    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182755    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182760    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182763    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182765    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182768    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182773    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182777    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182780    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182785    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182790    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182795    2586 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182797    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182800    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182803    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182808    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182810    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:57.306316 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:57.182813    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:57.306993 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.182819    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 20:32:57.306993 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.183054    2586 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 20:32:57.306993 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.187427    2586 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 20:32:57.306993 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.188956    2586 server.go:1019] "Starting client certificate rotation"
Jul 02 20:32:57.306993 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.189065    2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 20:32:57.306993 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.189111    2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 20:32:57.306993 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.191094    2586 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 20:32:57.306993 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.192371    2586 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 20:32:57.306993 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.206628    2586 log.go:25] "Validated CRI v1 runtime API"
Jul 02 20:32:57.306993 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.217568    2586 log.go:25] "Validated CRI v1 image API"
Jul 02 20:32:57.306993 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.219144    2586 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 20:32:57.306993 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.222427    2586 fs.go:135] Filesystem UUIDs: map[1b2629a5-2444-458a-a7e7-487f8d207e3b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c6dab36e-c95e-4bd4-ab5a-e86a928019dd:/dev/nvme0n1p3]
Jul 02 20:32:57.410640 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.222442    2586 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 20:32:57.427799 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.227581    2586 manager.go:216] Machine: {Timestamp:2026-07-02 20:32:57.226163126 +0000 UTC m=+0.349332163 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3120857 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2097532d1cf5d896749fd98ec32c55 SystemUUID:ec209753-2d1c-f5d8-9674-9fd98ec32c55 BootID:b5c255ea-2673-42cc-9770-04db62617122 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b2:a8:cf:26:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b2:a8:cf:26:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:8f:ee:c6:af:6c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 20:32:57.427799 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.227695    2586 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 20:32:57.427799 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.227772    2586 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 20:32:57.427799 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.228920    2586 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 20:32:57.427799 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.228942    2586 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-48.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 20:32:57.427799 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.229715    2586 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 20:32:57.427799 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.229725    2586 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 20:32:57.427799 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.229733    2586 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.230359    2586 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.231574    2586 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.234709    2586 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.234858    2586 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.235300    2586 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.235312    2586 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.235332    2586 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.235346    2586 kubelet.go:398] "Adding apiserver pod source"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.235359    2586 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.235703    2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.235720    2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.238889    2586 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.245281    2586 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.245307    2586 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.247004    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.247020    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.247027    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.247033    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.247043    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.247056    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.247066    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.247073    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.247080    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.247086    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.247107    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.247115    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.247681    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.247694    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.255394    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.255394    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.257799    2586 server.go:1268] "Started kubelet"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.257854    2586 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.257890    2586 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.257951    2586 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.259595    2586 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.259720    2586 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.260419    2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.267288    2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.267903    2586 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.268081    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-48.ec2.internal\" not found"
Jul 02 20:32:57.428825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.268697    2586 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.268701    2586 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.268718    2586 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.268810    2586 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.268816    2586 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.271906    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.271909    2586 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.272187    2586 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-48.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.271794    2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-48.ec2.internal.18be9339684fa861  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-48.ec2.internal,UID:ip-10-0-132-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-48.ec2.internal,},FirstTimestamp:2026-07-02 20:32:57.257764961 +0000 UTC m=+0.380933984,LastTimestamp:2026-07-02 20:32:57.257764961 +0000 UTC m=+0.380933984,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-48.ec2.internal,}"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.276334    2586 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.276422    2586 factory.go:55] Registering systemd factory
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.276434    2586 factory.go:223] Registration of the systemd container factory successfully
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.276640    2586 factory.go:153] Registering CRI-O factory
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.276652    2586 factory.go:223] Registration of the crio container factory successfully
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.276690    2586 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.276712    2586 factory.go:103] Registering Raw factory
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.276725    2586 manager.go:1196] Started watching for new ooms in manager
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.277215    2586 manager.go:349] Starting recovery of all containers
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.287776    2586 manager.go:354] Recovery completed
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.293613    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.302538    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.302658    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.302669    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.303290    2586 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.303302    2586 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.303302    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.303315    2586 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.303996    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.304021    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.304036    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.304613    2586 policy_none.go:49] "None policy: Start"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.304628    2586 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 20:32:57.430182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.304642    2586 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 20:32:57.431688 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.305661    2586 policy_none.go:47] "Start"
Jul 02 20:32:57.431688 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.318824    2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-48.ec2.internal.18be93396afc79d2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-48.ec2.internal,UID:ip-10-0-132-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-48.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-48.ec2.internal,},FirstTimestamp:2026-07-02 20:32:57.302645202 +0000 UTC m=+0.425814225,LastTimestamp:2026-07-02 20:32:57.302645202 +0000 UTC m=+0.425814225,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-48.ec2.internal,}"
Jul 02 20:32:57.431688 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.323234    2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-48.ec2.internal.18be93396afcc0ee  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-48.ec2.internal,UID:ip-10-0-132-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-48.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-48.ec2.internal,},FirstTimestamp:2026-07-02 20:32:57.302663406 +0000 UTC m=+0.425832430,LastTimestamp:2026-07-02 20:32:57.302663406 +0000 UTC m=+0.425832430,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-48.ec2.internal,}"
Jul 02 20:32:57.431688 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.333499    2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-48.ec2.internal.18be93396afce629  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-48.ec2.internal,UID:ip-10-0-132-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-48.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-48.ec2.internal,},FirstTimestamp:2026-07-02 20:32:57.302672937 +0000 UTC m=+0.425841962,LastTimestamp:2026-07-02 20:32:57.302672937 +0000 UTC m=+0.425841962,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-48.ec2.internal,}"
Jul 02 20:32:57.431688 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.337514    2586 manager.go:337] "Starting Device Plugin manager"
Jul 02 20:32:57.431688 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.337563    2586 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 20:32:57.431688 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.337575    2586 server.go:87] "Starting device plugin registration server"
Jul 02 20:32:57.431688 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.337695    2586 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-48.ec2.internal.18be93396afc79d2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-48.ec2.internal.18be93396afc79d2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-48.ec2.internal,UID:ip-10-0-132-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-48.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-48.ec2.internal,},FirstTimestamp:2026-07-02 20:32:57.302645202 +0000 UTC m=+0.425814225,LastTimestamp:2026-07-02 20:32:57.304006629 +0000 UTC m=+0.427175653,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-48.ec2.internal,}"
Jul 02 20:32:57.431688 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.337806    2586 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 20:32:57.431688 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.337817    2586 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 20:32:57.431688 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.338035    2586 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 20:32:57.431688 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.338129    2586 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 20:32:57.431688 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.338137    2586 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 20:32:57.432362 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.338750    2586 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 20:32:57.432362 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.338787    2586 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-48.ec2.internal\" not found"
Jul 02 20:32:57.432362 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.348775    2586 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-48.ec2.internal.18be93396afcc0ee\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-48.ec2.internal.18be93396afcc0ee  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-48.ec2.internal,UID:ip-10-0-132-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-48.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-48.ec2.internal,},FirstTimestamp:2026-07-02 20:32:57.302663406 +0000 UTC m=+0.425832430,LastTimestamp:2026-07-02 20:32:57.304027918 +0000 UTC m=+0.427196945,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-48.ec2.internal,}"
Jul 02 20:32:57.432362 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.357848    2586 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-48.ec2.internal.18be93396afce629\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-48.ec2.internal.18be93396afce629  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-48.ec2.internal,UID:ip-10-0-132-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-48.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-48.ec2.internal,},FirstTimestamp:2026-07-02 20:32:57.302672937 +0000 UTC m=+0.425841962,LastTimestamp:2026-07-02 20:32:57.304042458 +0000 UTC m=+0.427211482,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-48.ec2.internal,}"
Jul 02 20:32:57.432362 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.366685    2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2d6rc"
Jul 02 20:32:57.432362 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.367223    2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-48.ec2.internal.18be93396d39c2de  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-48.ec2.internal,UID:ip-10-0-132-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-132-48.ec2.internal,},FirstTimestamp:2026-07-02 20:32:57.34021603 +0000 UTC m=+0.463385049,LastTimestamp:2026-07-02 20:32:57.34021603 +0000 UTC m=+0.463385049,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-48.ec2.internal,}"
Jul 02 20:32:57.432362 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.375219    2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2d6rc"
Jul 02 20:32:57.559984 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.438852    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:57.559984 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.439723    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:57.559984 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.439750    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:57.559984 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.439761    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:57.559984 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.439788    2586 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.559984 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.461108    2586 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.559984 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.461128    2586 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-48.ec2.internal\": node \"ip-10-0-132-48.ec2.internal\" not found"
Jul 02 20:32:57.559984 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.485437    2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 20:32:57.559984 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.486725    2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 20:32:57.559984 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.486767    2586 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 20:32:57.559984 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.486789    2586 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 20:32:57.559984 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.486821    2586 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 20:32:57.559984 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.499392    2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:57.559984 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.503437    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-48.ec2.internal\" not found"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.587301    2586 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-48.ec2.internal"]
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.587377    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.588273    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.588298    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.588309    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.589790    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.589941    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.589972    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.590594    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.590619    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.590629    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.590594    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.590695    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.590708    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.592045    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.592068    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.597284    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.597312    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.597322    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.603907    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-48.ec2.internal\" not found"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.623547    2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-48.ec2.internal\" not found" node="ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.628233    2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-48.ec2.internal\" not found" node="ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.670574    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a78b67e7c9186cd3c1495e8dc72b2fcd-config\") pod \"kube-apiserver-proxy-ip-10-0-132-48.ec2.internal\" (UID: \"a78b67e7c9186cd3c1495e8dc72b2fcd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.670618    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c749c1a2e05240aa02b1a7b77acc92d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal\" (UID: \"6c749c1a2e05240aa02b1a7b77acc92d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.670639    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c749c1a2e05240aa02b1a7b77acc92d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal\" (UID: \"6c749c1a2e05240aa02b1a7b77acc92d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.722436 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.705470    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-48.ec2.internal\" not found"
Jul 02 20:32:57.881626 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.770745    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a78b67e7c9186cd3c1495e8dc72b2fcd-config\") pod \"kube-apiserver-proxy-ip-10-0-132-48.ec2.internal\" (UID: \"a78b67e7c9186cd3c1495e8dc72b2fcd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.881626 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.770787    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a78b67e7c9186cd3c1495e8dc72b2fcd-config\") pod \"kube-apiserver-proxy-ip-10-0-132-48.ec2.internal\" (UID: \"a78b67e7c9186cd3c1495e8dc72b2fcd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.881626 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.770846    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c749c1a2e05240aa02b1a7b77acc92d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal\" (UID: \"6c749c1a2e05240aa02b1a7b77acc92d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.881626 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.770869    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c749c1a2e05240aa02b1a7b77acc92d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal\" (UID: \"6c749c1a2e05240aa02b1a7b77acc92d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.881626 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.770917    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c749c1a2e05240aa02b1a7b77acc92d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal\" (UID: \"6c749c1a2e05240aa02b1a7b77acc92d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.881626 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.770934    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c749c1a2e05240aa02b1a7b77acc92d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal\" (UID: \"6c749c1a2e05240aa02b1a7b77acc92d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.881626 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.806592    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-48.ec2.internal\" not found"
Jul 02 20:32:57.995977 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:57.909112    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-48.ec2.internal\" not found"
Jul 02 20:32:57.995977 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.927612    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:57.995977 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:57.931838    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:58.120356 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.009796    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-48.ec2.internal\" not found"
Jul 02 20:32:58.120356 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.111105    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-48.ec2.internal\" not found"
Jul 02 20:32:58.239251 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.188497    2586 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 20:32:58.239251 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.188637    2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 20:32:58.239251 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.212530    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-48.ec2.internal\" not found"
Jul 02 20:32:58.239251 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.230587    2586 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:58.241168 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.241041    2586 apiserver.go:52] "Watching apiserver"
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.259017    2586 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.259688    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-59vx9","openshift-dns/node-resolver-c7fkk","openshift-image-registry/node-ca-f7n4v","openshift-multus/multus-additional-cni-plugins-2qtww","openshift-network-operator/iptables-alerter-shwsd","openshift-ovn-kubernetes/ovnkube-node-26dr8","kube-system/global-pull-secret-syncer-6qb52","kube-system/konnectivity-agent-v857j","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg","openshift-multus/multus-nn7kx","openshift-multus/network-metrics-daemon-5hjrx","openshift-network-diagnostics/network-check-target-qz9mm"]
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.261362    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.262369    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c7fkk"
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.263623    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f7n4v"
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.263952    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vdcx8\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.264836    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.265013    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.265023    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.265109    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p4hgv\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.265538    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.265782    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.265954    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-shwsd"
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.267900    2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.268169    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.268229    2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.268411    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.268519    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.268794    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.268637    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.268551    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.268674    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.268725    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vr9ml\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.268728    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.268797    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9bmsf\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.269403    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.269515    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-62987\""
Jul 02 20:32:58.333086 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.269708    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.269796    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.269806    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v857j"
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.269820    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.269827    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.270287    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.272927    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273328    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-var-lib-openvswitch\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273353    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-cni-bin\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273370    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-cni-netd\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273393    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qpcb\" (UniqueName: \"kubernetes.io/projected/123bcb87-a2a0-4790-88d0-a97fd0ae0436-kube-api-access-8qpcb\") pod \"node-ca-f7n4v\" (UID: \"123bcb87-a2a0-4790-88d0-a97fd0ae0436\") " pod="openshift-image-registry/node-ca-f7n4v"
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273416    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8702e6e-b6c8-46a3-b197-a711010573f7-dbus\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273432    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-log-socket\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273446    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/883874ea-845c-4cd9-9a88-c949e1371c58-iptables-alerter-script\") pod \"iptables-alerter-shwsd\" (UID: \"883874ea-845c-4cd9-9a88-c949e1371c58\") " pod="openshift-network-operator/iptables-alerter-shwsd"
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273465    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/19657f2b-e66e-43f9-b10a-e0fb44bc558a-konnectivity-ca\") pod \"konnectivity-agent-v857j\" (UID: \"19657f2b-e66e-43f9-b10a-e0fb44bc558a\") " pod="kube-system/konnectivity-agent-v857j"
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273506    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-var-lib-kubelet\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273534    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fed88cb9-e163-4770-8764-2787db3fbedd-etc-tuned\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.334269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273553    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-sysctl-conf\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.334965 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273574    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkjs6\" (UniqueName: \"kubernetes.io/projected/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-kube-api-access-bkjs6\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.334965 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273592    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6196c4a-539c-4a63-b16d-d509bc6d8885-hosts-file\") pod \"node-resolver-c7fkk\" (UID: \"a6196c4a-539c-4a63-b16d-d509bc6d8885\") " pod="openshift-dns/node-resolver-c7fkk"
Jul 02 20:32:58.334965 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273619    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/123bcb87-a2a0-4790-88d0-a97fd0ae0436-serviceca\") pod \"node-ca-f7n4v\" (UID: \"123bcb87-a2a0-4790-88d0-a97fd0ae0436\") " pod="openshift-image-registry/node-ca-f7n4v"
Jul 02 20:32:58.334965 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273656    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-kubernetes\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.334965 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273675    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-ovn-node-metrics-cert\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.334965 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273707    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-ovnkube-script-lib\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.334965 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273733    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-sysctl-d\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.334965 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273751    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8702e6e-b6c8-46a3-b197-a711010573f7-kubelet-config\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:32:58.334965 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273771    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzlhv\" (UniqueName: \"kubernetes.io/projected/fed88cb9-e163-4770-8764-2787db3fbedd-kube-api-access-gzlhv\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.334965 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273793    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-run-ovn\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.334965 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273816    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-ovnkube-config\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.334965 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273843    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e4af20e7-8ba1-4d68-9522-6330f7879b84-os-release\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.334965 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273868    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-run-openvswitch\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.334965 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273893    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4af20e7-8ba1-4d68-9522-6330f7879b84-system-cni-dir\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273932    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e4af20e7-8ba1-4d68-9522-6330f7879b84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273949    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e4af20e7-8ba1-4d68-9522-6330f7879b84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273993    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-systemd-units\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.273993    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274021    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-run-netns\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274046    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvz48\" (UniqueName: \"kubernetes.io/projected/883874ea-845c-4cd9-9a88-c949e1371c58-kube-api-access-jvz48\") pod \"iptables-alerter-shwsd\" (UID: \"883874ea-845c-4cd9-9a88-c949e1371c58\") " pod="openshift-network-operator/iptables-alerter-shwsd"
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274063    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274071    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-sysconfig\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274097    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274096    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-node-log\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274164    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e4af20e7-8ba1-4d68-9522-6330f7879b84-cnibin\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274195    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/883874ea-845c-4cd9-9a88-c949e1371c58-host-slash\") pod \"iptables-alerter-shwsd\" (UID: \"883874ea-845c-4cd9-9a88-c949e1371c58\") " pod="openshift-network-operator/iptables-alerter-shwsd"
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274217    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-sys\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274260    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-kubelet\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.335572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274291    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-etc-openvswitch\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.336201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274322    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/123bcb87-a2a0-4790-88d0-a97fd0ae0436-host\") pod \"node-ca-f7n4v\" (UID: \"123bcb87-a2a0-4790-88d0-a97fd0ae0436\") " pod="openshift-image-registry/node-ca-f7n4v"
Jul 02 20:32:58.336201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274350    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fed88cb9-e163-4770-8764-2787db3fbedd-tmp\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.336201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274395    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e4af20e7-8ba1-4d68-9522-6330f7879b84-cni-binary-copy\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.336201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274446    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-run-ovn-kubernetes\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.336201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274484    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.336201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274484    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-host\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.336201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274603    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:32:58.336201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274630    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-modprobe-d\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.336201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274656    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-run-systemd\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.336201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274681    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6196c4a-539c-4a63-b16d-d509bc6d8885-tmp-dir\") pod \"node-resolver-c7fkk\" (UID: \"a6196c4a-539c-4a63-b16d-d509bc6d8885\") " pod="openshift-dns/node-resolver-c7fkk"
Jul 02 20:32:58.336201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274705    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-systemd\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.336201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274730    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-run\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.336201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274758    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-lib-modules\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.336201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274802    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-slash\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274819    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrhkp\" (UniqueName: \"kubernetes.io/projected/a6196c4a-539c-4a63-b16d-d509bc6d8885-kube-api-access-xrhkp\") pod \"node-resolver-c7fkk\" (UID: \"a6196c4a-539c-4a63-b16d-d509bc6d8885\") " pod="openshift-dns/node-resolver-c7fkk"
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274862    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6z65\" (UniqueName: \"kubernetes.io/projected/e4af20e7-8ba1-4d68-9522-6330f7879b84-kube-api-access-p6z65\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274904    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274941    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-env-overrides\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274959    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/19657f2b-e66e-43f9-b10a-e0fb44bc558a-agent-certs\") pod \"konnectivity-agent-v857j\" (UID: \"19657f2b-e66e-43f9-b10a-e0fb44bc558a\") " pod="kube-system/konnectivity-agent-v857j"
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.274985    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e4af20e7-8ba1-4d68-9522-6330f7879b84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.275151    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.275164    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9chv4\""
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.275184    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.275206    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.275261    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.275308    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hvhs5\""
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.275634    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fqgqs\""
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.275978    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.276028    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.277372    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.277422    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.277873    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.277987    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 20:32:58.337217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.278014    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 20:32:58.338442 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.278100    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 20:32:58.338442 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.278148    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 20:32:58.338442 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.278192    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-htj24\""
Jul 02 20:32:58.338442 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.289019    2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 20:32:58.338442 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.297879    2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 20:32:58.338442 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.297936    2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-48.ec2.internal"
Jul 02 20:32:58.338442 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.298367    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal"]
Jul 02 20:32:58.338442 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.310727    2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 20:32:58.338442 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.310948    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-48.ec2.internal"]
Jul 02 20:32:58.338442 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.323405    2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dktpk"
Jul 02 20:32:58.338442 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.332846    2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dktpk"
Jul 02 20:32:58.369608 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.369582    2586 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 20:32:58.375252 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375233    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-sysctl-conf\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.375355 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375264    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkjs6\" (UniqueName: \"kubernetes.io/projected/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-kube-api-access-bkjs6\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.375355 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375293    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-etc-selinux\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.375355 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375319    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-os-release\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.375355 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375343    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-run-k8s-cni-cncf-io\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.375567 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375372    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6196c4a-539c-4a63-b16d-d509bc6d8885-hosts-file\") pod \"node-resolver-c7fkk\" (UID: \"a6196c4a-539c-4a63-b16d-d509bc6d8885\") " pod="openshift-dns/node-resolver-c7fkk"
Jul 02 20:32:58.375567 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375399    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/123bcb87-a2a0-4790-88d0-a97fd0ae0436-serviceca\") pod \"node-ca-f7n4v\" (UID: \"123bcb87-a2a0-4790-88d0-a97fd0ae0436\") " pod="openshift-image-registry/node-ca-f7n4v"
Jul 02 20:32:58.375567 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375405    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-sysctl-conf\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.375567 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375424    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-kubernetes\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.375567 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375467    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-ovn-node-metrics-cert\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.375567 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375474    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6196c4a-539c-4a63-b16d-d509bc6d8885-hosts-file\") pod \"node-resolver-c7fkk\" (UID: \"a6196c4a-539c-4a63-b16d-d509bc6d8885\") " pod="openshift-dns/node-resolver-c7fkk"
Jul 02 20:32:58.375567 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375504    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-ovnkube-script-lib\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.375567 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375528    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-kubernetes\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.375567 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375529    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-cnibin\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.376072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375571    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-sysctl-d\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.376072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375596    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8702e6e-b6c8-46a3-b197-a711010573f7-kubelet-config\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:32:58.376072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375619    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzlhv\" (UniqueName: \"kubernetes.io/projected/fed88cb9-e163-4770-8764-2787db3fbedd-kube-api-access-gzlhv\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.376072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375640    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-run-ovn\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.376072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375658    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8702e6e-b6c8-46a3-b197-a711010573f7-kubelet-config\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:32:58.376072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375664    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs\") pod \"network-metrics-daemon-5hjrx\" (UID: \"c6df2599-96ba-4a56-a663-dc78b5094ed0\") " pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:32:58.376072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375687    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-ovnkube-config\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.376072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375688    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-sysctl-d\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.376072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375711    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-multus-cni-dir\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.376072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375722    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-run-ovn\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.376072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375744    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-multus-conf-dir\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.376072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375772    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kxdh\" (UniqueName: \"kubernetes.io/projected/c6df2599-96ba-4a56-a663-dc78b5094ed0-kube-api-access-6kxdh\") pod \"network-metrics-daemon-5hjrx\" (UID: \"c6df2599-96ba-4a56-a663-dc78b5094ed0\") " pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:32:58.376072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375802    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e4af20e7-8ba1-4d68-9522-6330f7879b84-os-release\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.376072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375825    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-run-openvswitch\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.376547 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375847    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a437c06-1827-4b8e-b353-dca82a185abb-cni-binary-copy\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.376547 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375866    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e4af20e7-8ba1-4d68-9522-6330f7879b84-os-release\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.376547 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375870    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-var-lib-cni-multus\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.376547 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375899    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4af20e7-8ba1-4d68-9522-6330f7879b84-system-cni-dir\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.376547 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375910    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-run-openvswitch\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.376547 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375939    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e4af20e7-8ba1-4d68-9522-6330f7879b84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.376547 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375966    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e4af20e7-8ba1-4d68-9522-6330f7879b84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.376547 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375989    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-systemd-units\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.376547 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.375988    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4af20e7-8ba1-4d68-9522-6330f7879b84-system-cni-dir\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.376547 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376014    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-run-netns\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.376547 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376044    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.376547 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376066    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-run-netns\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.376547 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376088    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvz48\" (UniqueName: \"kubernetes.io/projected/883874ea-845c-4cd9-9a88-c949e1371c58-kube-api-access-jvz48\") pod \"iptables-alerter-shwsd\" (UID: \"883874ea-845c-4cd9-9a88-c949e1371c58\") " pod="openshift-network-operator/iptables-alerter-shwsd"
Jul 02 20:32:58.376547 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376111    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-sysconfig\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.376982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376133    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-node-log\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.376982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376155    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6sd5\" (UniqueName: \"kubernetes.io/projected/814560ef-4088-4294-8c95-4e0ccba914df-kube-api-access-c6sd5\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.376982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376178    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-var-lib-kubelet\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.376982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376202    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-hostroot\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.376982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376223    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4qwp\" (UniqueName: \"kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp\") pod \"network-check-target-qz9mm\" (UID: \"25c170de-779b-453c-ab0f-19c81c715a48\") " pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:32:58.376982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376248    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e4af20e7-8ba1-4d68-9522-6330f7879b84-cnibin\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.376982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376271    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/883874ea-845c-4cd9-9a88-c949e1371c58-host-slash\") pod \"iptables-alerter-shwsd\" (UID: \"883874ea-845c-4cd9-9a88-c949e1371c58\") " pod="openshift-network-operator/iptables-alerter-shwsd"
Jul 02 20:32:58.376982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376292    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-sys\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.376982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376314    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-kubelet\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.376982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376336    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-etc-openvswitch\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.376982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376358    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/123bcb87-a2a0-4790-88d0-a97fd0ae0436-host\") pod \"node-ca-f7n4v\" (UID: \"123bcb87-a2a0-4790-88d0-a97fd0ae0436\") " pod="openshift-image-registry/node-ca-f7n4v"
Jul 02 20:32:58.376982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376381    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fed88cb9-e163-4770-8764-2787db3fbedd-tmp\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.376982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376402    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e4af20e7-8ba1-4d68-9522-6330f7879b84-cni-binary-copy\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.376982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376425    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-run-ovn-kubernetes\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.377411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376465    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-device-dir\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.377411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376490    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-sys-fs\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.377411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376521    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-multus-socket-dir-parent\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.377411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376545    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2a437c06-1827-4b8e-b353-dca82a185abb-multus-daemon-config\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.377411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376572    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-host\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.377411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376596    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:32:58.377411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376630    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-modprobe-d\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.377411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376654    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-run-systemd\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.377411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376676    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-var-lib-cni-bin\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.377411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376698    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8cwq\" (UniqueName: \"kubernetes.io/projected/2a437c06-1827-4b8e-b353-dca82a185abb-kube-api-access-b8cwq\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.377411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376723    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6196c4a-539c-4a63-b16d-d509bc6d8885-tmp-dir\") pod \"node-resolver-c7fkk\" (UID: \"a6196c4a-539c-4a63-b16d-d509bc6d8885\") " pod="openshift-dns/node-resolver-c7fkk"
Jul 02 20:32:58.377411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376747    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-systemd\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.377411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376770    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-run\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.377411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376792    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-lib-modules\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.377825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376813    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-slash\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.377825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376836    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-socket-dir\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.377825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376861    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-registration-dir\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.377825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376886    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrhkp\" (UniqueName: \"kubernetes.io/projected/a6196c4a-539c-4a63-b16d-d509bc6d8885-kube-api-access-xrhkp\") pod \"node-resolver-c7fkk\" (UID: \"a6196c4a-539c-4a63-b16d-d509bc6d8885\") " pod="openshift-dns/node-resolver-c7fkk"
Jul 02 20:32:58.377825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376913    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6z65\" (UniqueName: \"kubernetes.io/projected/e4af20e7-8ba1-4d68-9522-6330f7879b84-kube-api-access-p6z65\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.377825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376938    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-run-multus-certs\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.377825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.376977    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.377825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377015    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-env-overrides\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.377825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377046    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/19657f2b-e66e-43f9-b10a-e0fb44bc558a-agent-certs\") pod \"konnectivity-agent-v857j\" (UID: \"19657f2b-e66e-43f9-b10a-e0fb44bc558a\") " pod="kube-system/konnectivity-agent-v857j"
Jul 02 20:32:58.377825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377069    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e4af20e7-8ba1-4d68-9522-6330f7879b84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.377825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377095    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-var-lib-openvswitch\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.377825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377127    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-cni-bin\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.377825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377152    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-system-cni-dir\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.377825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377177    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-cni-netd\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.378382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377201    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qpcb\" (UniqueName: \"kubernetes.io/projected/123bcb87-a2a0-4790-88d0-a97fd0ae0436-kube-api-access-8qpcb\") pod \"node-ca-f7n4v\" (UID: \"123bcb87-a2a0-4790-88d0-a97fd0ae0436\") " pod="openshift-image-registry/node-ca-f7n4v"
Jul 02 20:32:58.378382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377226    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8702e6e-b6c8-46a3-b197-a711010573f7-dbus\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:32:58.378382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377256    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-log-socket\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.378382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377280    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-etc-kubernetes\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.378382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377305    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/883874ea-845c-4cd9-9a88-c949e1371c58-iptables-alerter-script\") pod \"iptables-alerter-shwsd\" (UID: \"883874ea-845c-4cd9-9a88-c949e1371c58\") " pod="openshift-network-operator/iptables-alerter-shwsd"
Jul 02 20:32:58.378382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377335    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/19657f2b-e66e-43f9-b10a-e0fb44bc558a-konnectivity-ca\") pod \"konnectivity-agent-v857j\" (UID: \"19657f2b-e66e-43f9-b10a-e0fb44bc558a\") " pod="kube-system/konnectivity-agent-v857j"
Jul 02 20:32:58.378382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377362    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-var-lib-kubelet\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.378382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.377386    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fed88cb9-e163-4770-8764-2787db3fbedd-etc-tuned\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.378382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.378017    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-run-systemd\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.378382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.378077    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-systemd-units\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.378382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.378124    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-run-netns\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.378382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.378215    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/123bcb87-a2a0-4790-88d0-a97fd0ae0436-host\") pod \"node-ca-f7n4v\" (UID: \"123bcb87-a2a0-4790-88d0-a97fd0ae0436\") " pod="openshift-image-registry/node-ca-f7n4v"
Jul 02 20:32:58.378863 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.378578    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-etc-openvswitch\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.378863 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.378770    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-sysconfig\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.378863 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.378802    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-node-log\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.378863 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.378852    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e4af20e7-8ba1-4d68-9522-6330f7879b84-cnibin\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.379102 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.378989    2586 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 20:32:58.379102 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379086    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/883874ea-845c-4cd9-9a88-c949e1371c58-host-slash\") pod \"iptables-alerter-shwsd\" (UID: \"883874ea-845c-4cd9-9a88-c949e1371c58\") " pod="openshift-network-operator/iptables-alerter-shwsd"
Jul 02 20:32:58.379230 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379107    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-sys\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.379230 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379133    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-cni-netd\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.379230 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379159    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6196c4a-539c-4a63-b16d-d509bc6d8885-tmp-dir\") pod \"node-resolver-c7fkk\" (UID: \"a6196c4a-539c-4a63-b16d-d509bc6d8885\") " pod="openshift-dns/node-resolver-c7fkk"
Jul 02 20:32:58.379230 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379177    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-kubelet\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.379426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379230    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-log-socket\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.379426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379248    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-systemd\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.379426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379295    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-run\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.379426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379341    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-slash\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.379426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379372    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e4af20e7-8ba1-4d68-9522-6330f7879b84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.379426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379386    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-run-ovn-kubernetes\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.379426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379408    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8702e6e-b6c8-46a3-b197-a711010573f7-dbus\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:32:58.379737 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.379485    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:58.379737 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.379573    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret podName:f8702e6e-b6c8-46a3-b197-a711010573f7 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:58.879530766 +0000 UTC m=+2.002699802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret") pod "global-pull-secret-syncer-6qb52" (UID: "f8702e6e-b6c8-46a3-b197-a711010573f7") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:58.379860 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379745    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-cni-bin\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.379860 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379783    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-var-lib-openvswitch\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.379860 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379807    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-etc-modprobe-d\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.379860 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379855    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-host\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.380087 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.379985    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.380087 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.380064    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-var-lib-kubelet\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.381066 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.380448    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/123bcb87-a2a0-4790-88d0-a97fd0ae0436-serviceca\") pod \"node-ca-f7n4v\" (UID: \"123bcb87-a2a0-4790-88d0-a97fd0ae0436\") " pod="openshift-image-registry/node-ca-f7n4v"
Jul 02 20:32:58.381066 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.380561    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-ovnkube-config\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.381066 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.380698    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-ovnkube-script-lib\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.381066 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.380811    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e4af20e7-8ba1-4d68-9522-6330f7879b84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.381066 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.380914    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/883874ea-845c-4cd9-9a88-c949e1371c58-iptables-alerter-script\") pod \"iptables-alerter-shwsd\" (UID: \"883874ea-845c-4cd9-9a88-c949e1371c58\") " pod="openshift-network-operator/iptables-alerter-shwsd"
Jul 02 20:32:58.381066 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.381019    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fed88cb9-e163-4770-8764-2787db3fbedd-lib-modules\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.381589 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.381085    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e4af20e7-8ba1-4d68-9522-6330f7879b84-cni-binary-copy\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.381589 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.381117    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-env-overrides\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.381589 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.381196    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e4af20e7-8ba1-4d68-9522-6330f7879b84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.381589 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.381441    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/19657f2b-e66e-43f9-b10a-e0fb44bc558a-konnectivity-ca\") pod \"konnectivity-agent-v857j\" (UID: \"19657f2b-e66e-43f9-b10a-e0fb44bc558a\") " pod="kube-system/konnectivity-agent-v857j"
Jul 02 20:32:58.382175 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.382154    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fed88cb9-e163-4770-8764-2787db3fbedd-etc-tuned\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.382351 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.382332    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fed88cb9-e163-4770-8764-2787db3fbedd-tmp\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.383109 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.383086    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-ovn-node-metrics-cert\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.383651 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.383628    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/19657f2b-e66e-43f9-b10a-e0fb44bc558a-agent-certs\") pod \"konnectivity-agent-v857j\" (UID: \"19657f2b-e66e-43f9-b10a-e0fb44bc558a\") " pod="kube-system/konnectivity-agent-v857j"
Jul 02 20:32:58.384617 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.384601    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkjs6\" (UniqueName: \"kubernetes.io/projected/1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43-kube-api-access-bkjs6\") pod \"ovnkube-node-26dr8\" (UID: \"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43\") " pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.388022 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.388003    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzlhv\" (UniqueName: \"kubernetes.io/projected/fed88cb9-e163-4770-8764-2787db3fbedd-kube-api-access-gzlhv\") pod \"tuned-59vx9\" (UID: \"fed88cb9-e163-4770-8764-2787db3fbedd\") " pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.390494 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.390453    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 20:27:58 +0000 UTC" deadline="2027-11-28 05:42:46.69247579 +0000 UTC"
Jul 02 20:32:58.390606 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.390495    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12321h9m48.301985338s"
Jul 02 20:32:58.393525 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.393493    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvz48\" (UniqueName: \"kubernetes.io/projected/883874ea-845c-4cd9-9a88-c949e1371c58-kube-api-access-jvz48\") pod \"iptables-alerter-shwsd\" (UID: \"883874ea-845c-4cd9-9a88-c949e1371c58\") " pod="openshift-network-operator/iptables-alerter-shwsd"
Jul 02 20:32:58.393897 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.393871    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qpcb\" (UniqueName: \"kubernetes.io/projected/123bcb87-a2a0-4790-88d0-a97fd0ae0436-kube-api-access-8qpcb\") pod \"node-ca-f7n4v\" (UID: \"123bcb87-a2a0-4790-88d0-a97fd0ae0436\") " pod="openshift-image-registry/node-ca-f7n4v"
Jul 02 20:32:58.394007 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.393926    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrhkp\" (UniqueName: \"kubernetes.io/projected/a6196c4a-539c-4a63-b16d-d509bc6d8885-kube-api-access-xrhkp\") pod \"node-resolver-c7fkk\" (UID: \"a6196c4a-539c-4a63-b16d-d509bc6d8885\") " pod="openshift-dns/node-resolver-c7fkk"
Jul 02 20:32:58.394661 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.394640    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6z65\" (UniqueName: \"kubernetes.io/projected/e4af20e7-8ba1-4d68-9522-6330f7879b84-kube-api-access-p6z65\") pod \"multus-additional-cni-plugins-2qtww\" (UID: \"e4af20e7-8ba1-4d68-9522-6330f7879b84\") " pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.415814 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.415790    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f7n4v"
Jul 02 20:32:58.428532 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.428509    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2qtww"
Jul 02 20:32:58.440566 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.440548    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-shwsd"
Jul 02 20:32:58.466691 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.466672    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:32:58.473804 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.473787    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v857j"
Jul 02 20:32:58.477819 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.477795    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-etc-selinux\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.477819 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.477824    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-os-release\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.478010 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.477847    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-run-k8s-cni-cncf-io\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.478010 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.477925    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-run-k8s-cni-cncf-io\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.478141 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478118    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-etc-selinux\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.478225 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478196    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-os-release\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.478225 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478130    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-cnibin\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.478340 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478252    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs\") pod \"network-metrics-daemon-5hjrx\" (UID: \"c6df2599-96ba-4a56-a663-dc78b5094ed0\") " pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:32:58.478340 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478285    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-multus-cni-dir\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.478340 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478290    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-cnibin\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.478340 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478302    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-multus-conf-dir\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.478340 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478322    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kxdh\" (UniqueName: \"kubernetes.io/projected/c6df2599-96ba-4a56-a663-dc78b5094ed0-kube-api-access-6kxdh\") pod \"network-metrics-daemon-5hjrx\" (UID: \"c6df2599-96ba-4a56-a663-dc78b5094ed0\") " pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:32:58.478599 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478352    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a437c06-1827-4b8e-b353-dca82a185abb-cni-binary-copy\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.478599 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478376    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-multus-cni-dir\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.478599 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478378    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-var-lib-cni-multus\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.478599 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478388    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-multus-conf-dir\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.478599 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478427    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-var-lib-cni-multus\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.478599 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478452    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.478599 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478480    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-run-netns\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.478599 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.478491    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:58.478599 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478525    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6sd5\" (UniqueName: \"kubernetes.io/projected/814560ef-4088-4294-8c95-4e0ccba914df-kube-api-access-c6sd5\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.478599 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.478549    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs podName:c6df2599-96ba-4a56-a663-dc78b5094ed0 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:58.978526907 +0000 UTC m=+2.101695924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs") pod "network-metrics-daemon-5hjrx" (UID: "c6df2599-96ba-4a56-a663-dc78b5094ed0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:58.478599 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478581    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-var-lib-kubelet\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.479237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478612    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-hostroot\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.479237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478641    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4qwp\" (UniqueName: \"kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp\") pod \"network-check-target-qz9mm\" (UID: \"25c170de-779b-453c-ab0f-19c81c715a48\") " pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:32:58.479237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478698    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-device-dir\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.479237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478706    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-run-netns\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.479237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478725    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-sys-fs\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.479237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478773    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.479237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478908    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-multus-socket-dir-parent\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.479237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478947    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2a437c06-1827-4b8e-b353-dca82a185abb-multus-daemon-config\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.479237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478983    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-sys-fs\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.479237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.478993    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-var-lib-cni-bin\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.479237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479019    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8cwq\" (UniqueName: \"kubernetes.io/projected/2a437c06-1827-4b8e-b353-dca82a185abb-kube-api-access-b8cwq\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.479237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479049    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-socket-dir\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.479237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479073    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-registration-dir\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.479237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479082    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a437c06-1827-4b8e-b353-dca82a185abb-cni-binary-copy\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.480000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479120    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-run-multus-certs\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.480000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479134    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-multus-socket-dir-parent\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.480000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479172    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-system-cni-dir\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.480000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479181    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-var-lib-kubelet\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.480000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479201    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-var-lib-cni-bin\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.480000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479232    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-etc-kubernetes\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.480000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479237    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-system-cni-dir\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.480000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479253    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-device-dir\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.480000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479325    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-registration-dir\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.480000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479363    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-etc-kubernetes\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.480000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479543    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2a437c06-1827-4b8e-b353-dca82a185abb-multus-daemon-config\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.480000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479657    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/814560ef-4088-4294-8c95-4e0ccba914df-socket-dir\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.480000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479699    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-host-run-multus-certs\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.480000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.479746    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2a437c06-1827-4b8e-b353-dca82a185abb-hostroot\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.497837 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.497347    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:32:58.497837 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.497372    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:32:58.497837 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.497388    2586 projected.go:196] Error preparing data for projected volume kube-api-access-k4qwp for pod openshift-network-diagnostics/network-check-target-qz9mm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:58.497837 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.497451    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp podName:25c170de-779b-453c-ab0f-19c81c715a48 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:58.997431641 +0000 UTC m=+2.120600669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k4qwp" (UniqueName: "kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp") pod "network-check-target-qz9mm" (UID: "25c170de-779b-453c-ab0f-19c81c715a48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:58.497837 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.497623    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8cwq\" (UniqueName: \"kubernetes.io/projected/2a437c06-1827-4b8e-b353-dca82a185abb-kube-api-access-b8cwq\") pod \"multus-nn7kx\" (UID: \"2a437c06-1827-4b8e-b353-dca82a185abb\") " pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.498799 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.498228    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6sd5\" (UniqueName: \"kubernetes.io/projected/814560ef-4088-4294-8c95-4e0ccba914df-kube-api-access-c6sd5\") pod \"aws-ebs-csi-driver-node-slrrg\" (UID: \"814560ef-4088-4294-8c95-4e0ccba914df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.499424 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.499400    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kxdh\" (UniqueName: \"kubernetes.io/projected/c6df2599-96ba-4a56-a663-dc78b5094ed0-kube-api-access-6kxdh\") pod \"network-metrics-daemon-5hjrx\" (UID: \"c6df2599-96ba-4a56-a663-dc78b5094ed0\") " pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:32:58.535979 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:58.535951    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c749c1a2e05240aa02b1a7b77acc92d.slice/crio-13f201bb34f8b5bd5cd3bcd0f9f3ec7a247b309635cba9fe757a1884b410135b WatchSource:0}: Error finding container 13f201bb34f8b5bd5cd3bcd0f9f3ec7a247b309635cba9fe757a1884b410135b: Status 404 returned error can't find the container with id 13f201bb34f8b5bd5cd3bcd0f9f3ec7a247b309635cba9fe757a1884b410135b
Jul 02 20:32:58.536315 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:58.536297    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda78b67e7c9186cd3c1495e8dc72b2fcd.slice/crio-828ecd34dd6c759c84784d16a9144f261d52310018c2b4bd2fd46bf7e3dffb52 WatchSource:0}: Error finding container 828ecd34dd6c759c84784d16a9144f261d52310018c2b4bd2fd46bf7e3dffb52: Status 404 returned error can't find the container with id 828ecd34dd6c759c84784d16a9144f261d52310018c2b4bd2fd46bf7e3dffb52
Jul 02 20:32:58.540404 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.540390    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:32:58.597865 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.597817    2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:58.620371 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.620349    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-59vx9"
Jul 02 20:32:58.627763 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:58.627742    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfed88cb9_e163_4770_8764_2787db3fbedd.slice/crio-608d1050c55814f55dbab76be2e66d198ccb193953d7dbd9183c24f6b369eff9 WatchSource:0}: Error finding container 608d1050c55814f55dbab76be2e66d198ccb193953d7dbd9183c24f6b369eff9: Status 404 returned error can't find the container with id 608d1050c55814f55dbab76be2e66d198ccb193953d7dbd9183c24f6b369eff9
Jul 02 20:32:58.642681 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.642657    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c7fkk"
Jul 02 20:32:58.649932 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:58.649913    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6196c4a_539c_4a63_b16d_d509bc6d8885.slice/crio-5e8a5991b580eda81508998de3a642a8b61a48b05b04d6660267959f1a2d1c72 WatchSource:0}: Error finding container 5e8a5991b580eda81508998de3a642a8b61a48b05b04d6660267959f1a2d1c72: Status 404 returned error can't find the container with id 5e8a5991b580eda81508998de3a642a8b61a48b05b04d6660267959f1a2d1c72
Jul 02 20:32:58.694149 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.694122    2586 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:58.733544 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:58.733518    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod123bcb87_a2a0_4790_88d0_a97fd0ae0436.slice/crio-aa836ca4367f2a5b156c61f473da45b7ebc11947ba8af0ab017c6d59562928a7 WatchSource:0}: Error finding container aa836ca4367f2a5b156c61f473da45b7ebc11947ba8af0ab017c6d59562928a7: Status 404 returned error can't find the container with id aa836ca4367f2a5b156c61f473da45b7ebc11947ba8af0ab017c6d59562928a7
Jul 02 20:32:58.779963 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.779941    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg"
Jul 02 20:32:58.797880 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.797858    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nn7kx"
Jul 02 20:32:58.798678 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:58.798654    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19657f2b_e66e_43f9_b10a_e0fb44bc558a.slice/crio-4f86209f6b39b2a66d22b9ab82e57bf0ea0520e6ae427239d58696050c684478 WatchSource:0}: Error finding container 4f86209f6b39b2a66d22b9ab82e57bf0ea0520e6ae427239d58696050c684478: Status 404 returned error can't find the container with id 4f86209f6b39b2a66d22b9ab82e57bf0ea0520e6ae427239d58696050c684478
Jul 02 20:32:58.801950 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:58.801930    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814560ef_4088_4294_8c95_4e0ccba914df.slice/crio-54e3097c96158a0a77d2274ec3fe63c8c4b7c75b3ffe63be6d19f36cb1c90104 WatchSource:0}: Error finding container 54e3097c96158a0a77d2274ec3fe63c8c4b7c75b3ffe63be6d19f36cb1c90104: Status 404 returned error can't find the container with id 54e3097c96158a0a77d2274ec3fe63c8c4b7c75b3ffe63be6d19f36cb1c90104
Jul 02 20:32:58.810850 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:58.810826    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a437c06_1827_4b8e_b353_dca82a185abb.slice/crio-5dcef0a90905f1d905f115b488e0a023746703f3f95313ca1a206f60d7f1d93a WatchSource:0}: Error finding container 5dcef0a90905f1d905f115b488e0a023746703f3f95313ca1a206f60d7f1d93a: Status 404 returned error can't find the container with id 5dcef0a90905f1d905f115b488e0a023746703f3f95313ca1a206f60d7f1d93a
Jul 02 20:32:58.811605 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:58.811585    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4af20e7_8ba1_4d68_9522_6330f7879b84.slice/crio-eccdf659e86a04a7fb45313d10604002dd41976a74177dcbe48dab1aea0f9c2e WatchSource:0}: Error finding container eccdf659e86a04a7fb45313d10604002dd41976a74177dcbe48dab1aea0f9c2e: Status 404 returned error can't find the container with id eccdf659e86a04a7fb45313d10604002dd41976a74177dcbe48dab1aea0f9c2e
Jul 02 20:32:58.835995 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:58.835976    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a63c53e_a5d6_4b71_bc0c_10b1a4c44e43.slice/crio-1692b44a6bb16b1244184893e3ba965392e64569bee1b1794d653de836637aad WatchSource:0}: Error finding container 1692b44a6bb16b1244184893e3ba965392e64569bee1b1794d653de836637aad: Status 404 returned error can't find the container with id 1692b44a6bb16b1244184893e3ba965392e64569bee1b1794d653de836637aad
Jul 02 20:32:58.882396 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.882339    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:32:58.882465 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.882441    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:58.882549 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.882491    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret podName:f8702e6e-b6c8-46a3-b197-a711010573f7 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:59.882478599 +0000 UTC m=+3.005647612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret") pod "global-pull-secret-syncer-6qb52" (UID: "f8702e6e-b6c8-46a3-b197-a711010573f7") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:58.939118 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:32:58.939097    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod883874ea_845c_4cd9_9a88_c949e1371c58.slice/crio-050de3ad59d4f134ef33847f75938b6f30ab2e04478035240889ee06d384149b WatchSource:0}: Error finding container 050de3ad59d4f134ef33847f75938b6f30ab2e04478035240889ee06d384149b: Status 404 returned error can't find the container with id 050de3ad59d4f134ef33847f75938b6f30ab2e04478035240889ee06d384149b
Jul 02 20:32:58.983609 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:58.983585    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs\") pod \"network-metrics-daemon-5hjrx\" (UID: \"c6df2599-96ba-4a56-a663-dc78b5094ed0\") " pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:32:58.983702 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.983694    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:58.983749 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:58.983740    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs podName:c6df2599-96ba-4a56-a663-dc78b5094ed0 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:59.983725766 +0000 UTC m=+3.106894779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs") pod "network-metrics-daemon-5hjrx" (UID: "c6df2599-96ba-4a56-a663-dc78b5094ed0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:59.084139 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.084104    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4qwp\" (UniqueName: \"kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp\") pod \"network-check-target-qz9mm\" (UID: \"25c170de-779b-453c-ab0f-19c81c715a48\") " pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:32:59.084355 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:59.084313    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:32:59.084355 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:59.084341    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:32:59.084355 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:59.084355    2586 projected.go:196] Error preparing data for projected volume kube-api-access-k4qwp for pod openshift-network-diagnostics/network-check-target-qz9mm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:59.084519 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:59.084420    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp podName:25c170de-779b-453c-ab0f-19c81c715a48 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:00.084400281 +0000 UTC m=+3.207569297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4qwp" (UniqueName: "kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp") pod "network-check-target-qz9mm" (UID: "25c170de-779b-453c-ab0f-19c81c715a48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:59.215805 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.215731    2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:59.335291 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.334961    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 20:27:58 +0000 UTC" deadline="2028-02-13 22:37:25.769869928 +0000 UTC"
Jul 02 20:32:59.335291 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.335281    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14186h4m26.43459475s"
Jul 02 20:32:59.525968 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.525740    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8" event={"ID":"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43","Type":"ContainerStarted","Data":"1692b44a6bb16b1244184893e3ba965392e64569bee1b1794d653de836637aad"}
Jul 02 20:32:59.531208 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.531172    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2qtww" event={"ID":"e4af20e7-8ba1-4d68-9522-6330f7879b84","Type":"ContainerStarted","Data":"eccdf659e86a04a7fb45313d10604002dd41976a74177dcbe48dab1aea0f9c2e"}
Jul 02 20:32:59.534636 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.534517    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c7fkk" event={"ID":"a6196c4a-539c-4a63-b16d-d509bc6d8885","Type":"ContainerStarted","Data":"5e8a5991b580eda81508998de3a642a8b61a48b05b04d6660267959f1a2d1c72"}
Jul 02 20:32:59.546344 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.545949    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-59vx9" event={"ID":"fed88cb9-e163-4770-8764-2787db3fbedd","Type":"ContainerStarted","Data":"608d1050c55814f55dbab76be2e66d198ccb193953d7dbd9183c24f6b369eff9"}
Jul 02 20:32:59.566187 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.566157    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-48.ec2.internal" event={"ID":"a78b67e7c9186cd3c1495e8dc72b2fcd","Type":"ContainerStarted","Data":"828ecd34dd6c759c84784d16a9144f261d52310018c2b4bd2fd46bf7e3dffb52"}
Jul 02 20:32:59.573832 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.573799    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal" event={"ID":"6c749c1a2e05240aa02b1a7b77acc92d","Type":"ContainerStarted","Data":"13f201bb34f8b5bd5cd3bcd0f9f3ec7a247b309635cba9fe757a1884b410135b"}
Jul 02 20:32:59.586693 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.586627    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-shwsd" event={"ID":"883874ea-845c-4cd9-9a88-c949e1371c58","Type":"ContainerStarted","Data":"050de3ad59d4f134ef33847f75938b6f30ab2e04478035240889ee06d384149b"}
Jul 02 20:32:59.589206 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.589181    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nn7kx" event={"ID":"2a437c06-1827-4b8e-b353-dca82a185abb","Type":"ContainerStarted","Data":"5dcef0a90905f1d905f115b488e0a023746703f3f95313ca1a206f60d7f1d93a"}
Jul 02 20:32:59.593746 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.593719    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg" event={"ID":"814560ef-4088-4294-8c95-4e0ccba914df","Type":"ContainerStarted","Data":"54e3097c96158a0a77d2274ec3fe63c8c4b7c75b3ffe63be6d19f36cb1c90104"}
Jul 02 20:32:59.599709 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.599682    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v857j" event={"ID":"19657f2b-e66e-43f9-b10a-e0fb44bc558a","Type":"ContainerStarted","Data":"4f86209f6b39b2a66d22b9ab82e57bf0ea0520e6ae427239d58696050c684478"}
Jul 02 20:32:59.613524 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.613498    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f7n4v" event={"ID":"123bcb87-a2a0-4790-88d0-a97fd0ae0436","Type":"ContainerStarted","Data":"aa836ca4367f2a5b156c61f473da45b7ebc11947ba8af0ab017c6d59562928a7"}
Jul 02 20:32:59.889644 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.889544    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:32:59.889797 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:59.889739    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:59.889856 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:59.889800    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret podName:f8702e6e-b6c8-46a3-b197-a711010573f7 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:01.889781917 +0000 UTC m=+5.012950936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret") pod "global-pull-secret-syncer-6qb52" (UID: "f8702e6e-b6c8-46a3-b197-a711010573f7") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:59.990303 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:32:59.990240    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs\") pod \"network-metrics-daemon-5hjrx\" (UID: \"c6df2599-96ba-4a56-a663-dc78b5094ed0\") " pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:32:59.990483 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:59.990391    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:59.990483 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:32:59.990452    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs podName:c6df2599-96ba-4a56-a663-dc78b5094ed0 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:01.990431641 +0000 UTC m=+5.113600659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs") pod "network-metrics-daemon-5hjrx" (UID: "c6df2599-96ba-4a56-a663-dc78b5094ed0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:00.091410 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:00.091373    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4qwp\" (UniqueName: \"kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp\") pod \"network-check-target-qz9mm\" (UID: \"25c170de-779b-453c-ab0f-19c81c715a48\") " pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:00.091699 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:00.091580    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:33:00.091699 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:00.091647    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:33:00.091699 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:00.091661    2586 projected.go:196] Error preparing data for projected volume kube-api-access-k4qwp for pod openshift-network-diagnostics/network-check-target-qz9mm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:00.091898 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:00.091723    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp podName:25c170de-779b-453c-ab0f-19c81c715a48 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:02.091704327 +0000 UTC m=+5.214873344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4qwp" (UniqueName: "kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp") pod "network-check-target-qz9mm" (UID: "25c170de-779b-453c-ab0f-19c81c715a48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:00.335688 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:00.335547    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 20:27:58 +0000 UTC" deadline="2028-01-14 00:11:31.562254987 +0000 UTC"
Jul 02 20:33:00.335688 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:00.335593    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13443h38m31.226667195s"
Jul 02 20:33:00.487218 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:00.487179    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:00.487402 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:00.487338    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:00.487825 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:00.487776    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:00.487909 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:00.487872    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:00.488005 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:00.487952    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:00.489565 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:00.489516    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:01.907369 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:01.906583    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:01.907369 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:01.906740    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:33:01.907369 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:01.906884    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret podName:f8702e6e-b6c8-46a3-b197-a711010573f7 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:05.906864665 +0000 UTC m=+9.030033681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret") pod "global-pull-secret-syncer-6qb52" (UID: "f8702e6e-b6c8-46a3-b197-a711010573f7") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:33:02.007600 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:02.007558    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs\") pod \"network-metrics-daemon-5hjrx\" (UID: \"c6df2599-96ba-4a56-a663-dc78b5094ed0\") " pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:02.007848 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:02.007808    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:02.007923 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:02.007880    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs podName:c6df2599-96ba-4a56-a663-dc78b5094ed0 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:06.007861376 +0000 UTC m=+9.131030393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs") pod "network-metrics-daemon-5hjrx" (UID: "c6df2599-96ba-4a56-a663-dc78b5094ed0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:02.108991 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:02.108342    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4qwp\" (UniqueName: \"kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp\") pod \"network-check-target-qz9mm\" (UID: \"25c170de-779b-453c-ab0f-19c81c715a48\") " pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:02.108991 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:02.108504    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:33:02.108991 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:02.108528    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:33:02.108991 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:02.108542    2586 projected.go:196] Error preparing data for projected volume kube-api-access-k4qwp for pod openshift-network-diagnostics/network-check-target-qz9mm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:02.108991 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:02.108606    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp podName:25c170de-779b-453c-ab0f-19c81c715a48 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:06.108587555 +0000 UTC m=+9.231756594 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4qwp" (UniqueName: "kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp") pod "network-check-target-qz9mm" (UID: "25c170de-779b-453c-ab0f-19c81c715a48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:02.487808 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:02.487690    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:02.487808 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:02.487725    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:02.488080 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:02.487834    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:02.488080 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:02.487935    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:02.488080 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:02.487984    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:02.488080 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:02.488062    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:04.487942 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:04.487884    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:04.488382 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:04.488061    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:04.488382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:04.488116    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:04.488382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:04.488144    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:04.488382 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:04.488235    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:04.488382 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:04.488340    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:05.943871 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:05.943831    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:05.944348 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:05.944007    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:33:05.944348 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:05.944089    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret podName:f8702e6e-b6c8-46a3-b197-a711010573f7 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:13.944067897 +0000 UTC m=+17.067236918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret") pod "global-pull-secret-syncer-6qb52" (UID: "f8702e6e-b6c8-46a3-b197-a711010573f7") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:33:06.044272 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:06.044222    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs\") pod \"network-metrics-daemon-5hjrx\" (UID: \"c6df2599-96ba-4a56-a663-dc78b5094ed0\") " pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:06.044446 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:06.044371    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:06.044528 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:06.044446    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs podName:c6df2599-96ba-4a56-a663-dc78b5094ed0 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:14.044423997 +0000 UTC m=+17.167593034 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs") pod "network-metrics-daemon-5hjrx" (UID: "c6df2599-96ba-4a56-a663-dc78b5094ed0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:06.145508 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:06.144956    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4qwp\" (UniqueName: \"kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp\") pod \"network-check-target-qz9mm\" (UID: \"25c170de-779b-453c-ab0f-19c81c715a48\") " pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:06.145508 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:06.145098    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:33:06.145508 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:06.145119    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:33:06.145508 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:06.145131    2586 projected.go:196] Error preparing data for projected volume kube-api-access-k4qwp for pod openshift-network-diagnostics/network-check-target-qz9mm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:06.145508 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:06.145184    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp podName:25c170de-779b-453c-ab0f-19c81c715a48 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:14.145166392 +0000 UTC m=+17.268335426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4qwp" (UniqueName: "kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp") pod "network-check-target-qz9mm" (UID: "25c170de-779b-453c-ab0f-19c81c715a48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:06.487656 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:06.487575    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:06.487656 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:06.487611    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:06.487919 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:06.487704    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:06.487919 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:06.487795    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:06.487919 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:06.487850    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:06.488095 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:06.487966    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:08.487992 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:08.487728    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:08.488444 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:08.488101    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:08.488444 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:08.487776    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:08.488444 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:08.488191    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:08.488444 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:08.487736    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:08.488444 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:08.488280    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:10.487792 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:10.487760    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:10.488235 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:10.487800    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:10.488235 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:10.487869    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:10.488235 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:10.487915    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:10.488235 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:10.487992    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:10.488235 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:10.488090    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:12.487227 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:12.487186    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:12.487663 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:12.487186    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:12.487663 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:12.487317    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:12.487663 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:12.487186    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:12.487663 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:12.487403    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:12.487663 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:12.487478    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:14.006998 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:14.006964    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:14.007383 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:14.007132    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:33:14.007383 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:14.007210    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret podName:f8702e6e-b6c8-46a3-b197-a711010573f7 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:30.007188705 +0000 UTC m=+33.130357721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret") pod "global-pull-secret-syncer-6qb52" (UID: "f8702e6e-b6c8-46a3-b197-a711010573f7") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:33:14.108066 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:14.108027    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs\") pod \"network-metrics-daemon-5hjrx\" (UID: \"c6df2599-96ba-4a56-a663-dc78b5094ed0\") " pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:14.108231 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:14.108189    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:14.108296 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:14.108265    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs podName:c6df2599-96ba-4a56-a663-dc78b5094ed0 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:30.108243081 +0000 UTC m=+33.231412095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs") pod "network-metrics-daemon-5hjrx" (UID: "c6df2599-96ba-4a56-a663-dc78b5094ed0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:14.208736 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:14.208698    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4qwp\" (UniqueName: \"kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp\") pod \"network-check-target-qz9mm\" (UID: \"25c170de-779b-453c-ab0f-19c81c715a48\") " pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:14.208939 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:14.208871    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:33:14.208939 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:14.208912    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:33:14.208939 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:14.208926    2586 projected.go:196] Error preparing data for projected volume kube-api-access-k4qwp for pod openshift-network-diagnostics/network-check-target-qz9mm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:14.209074 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:14.208986    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp podName:25c170de-779b-453c-ab0f-19c81c715a48 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:30.208971485 +0000 UTC m=+33.332140495 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4qwp" (UniqueName: "kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp") pod "network-check-target-qz9mm" (UID: "25c170de-779b-453c-ab0f-19c81c715a48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:14.487371 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:14.487349    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:14.487470 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:14.487447    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:14.487506 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:14.487460    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:14.487506 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:14.487471    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:14.487570 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:14.487538    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:14.487617 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:14.487601    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:16.487389 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:16.487355    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:16.487781 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:16.487355    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:16.487781 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:16.487466    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:16.487781 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:16.487357    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:16.487781 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:16.487538    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:16.487781 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:16.487604    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:18.487598 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:18.487563    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:18.487598 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:18.487597    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:18.488107 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:18.487598    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:18.488107 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:18.487686    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:18.488107 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:18.487774    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:18.488107 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:18.487894    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:19.671771 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:19.671599    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 20:33:19.672462 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:19.672120    2586 generic.go:356] "Generic (PLEG): container finished" podID="1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43" containerID="6564ff2a4548f8eda4d299d39bf8d6f59da30c0977dc5bb3918d43cac38dace1" exitCode=1
Jul 02 20:33:19.672462 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:19.672186    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8" event={"ID":"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43","Type":"ContainerStarted","Data":"8c8d05caca596b1dcc7687d3089fc53bba04bcc804af50ae78057e32bb0db86e"}
Jul 02 20:33:19.672462 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:19.672252    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8" event={"ID":"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43","Type":"ContainerStarted","Data":"834841e3a2f4487ebaa3b6260fab8f9a95046799c87271bf4ddd96056b7f4980"}
Jul 02 20:33:19.672462 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:19.672292    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8" event={"ID":"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43","Type":"ContainerStarted","Data":"2fee21ce6f34479eed0232da37436b305775e3c0cd05a669c51580b322c02d8f"}
Jul 02 20:33:19.672462 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:19.672322    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8" event={"ID":"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43","Type":"ContainerStarted","Data":"8c254742b14292efdd1f1c62ddc94935b9aff9980b4987ed197a4f790b4eca0f"}
Jul 02 20:33:19.672462 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:19.672348    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8" event={"ID":"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43","Type":"ContainerDied","Data":"6564ff2a4548f8eda4d299d39bf8d6f59da30c0977dc5bb3918d43cac38dace1"}
Jul 02 20:33:19.672462 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:19.672377    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8" event={"ID":"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43","Type":"ContainerStarted","Data":"658d9b4c060f12307ccdedb7be1452f2be10e2d14f7c5ad49d9656e648da29bc"}
Jul 02 20:33:19.673575 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:19.673553    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-59vx9" event={"ID":"fed88cb9-e163-4770-8764-2787db3fbedd","Type":"ContainerStarted","Data":"2b04cf318735d690e8c3cd6e7f1a5596a2491e4f0785e4d4cf0622b82f68009a"}
Jul 02 20:33:19.674969 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:19.674934    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-48.ec2.internal" event={"ID":"a78b67e7c9186cd3c1495e8dc72b2fcd","Type":"ContainerStarted","Data":"c6c0b94554b38318f9e45838e1d685ce8649cb94c07c8fd6447d1213c60dc8cf"}
Jul 02 20:33:19.676338 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:19.676317    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nn7kx" event={"ID":"2a437c06-1827-4b8e-b353-dca82a185abb","Type":"ContainerStarted","Data":"07d2e004806757ed8f914e983610ff34041bdc8a896b7eb87f6e526552f3e427"}
Jul 02 20:33:19.692199 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:19.692158    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-59vx9" podStartSLOduration=1.487916539 podStartE2EDuration="21.69214648s" totalImagesPullingTime="20.204229941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:19.69214457 +0000 UTC m=+22.815313602" watchObservedRunningTime="2026-07-02 20:33:19.69214648 +0000 UTC m=+22.815315513"
Jul 02 20:33:19.706315 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:19.706283    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-48.ec2.internal" podStartSLOduration=21.70627114 podStartE2EDuration="21.70627114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:19.706174588 +0000 UTC m=+22.829343634" watchObservedRunningTime="2026-07-02 20:33:19.70627114 +0000 UTC m=+22.829440172"
Jul 02 20:33:19.725055 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:19.725018    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nn7kx" podStartSLOduration=1.472699834 podStartE2EDuration="21.725006845s" totalImagesPullingTime="20.252307011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:19.724776918 +0000 UTC m=+22.847945950" watchObservedRunningTime="2026-07-02 20:33:19.725006845 +0000 UTC m=+22.848175877"
Jul 02 20:33:20.488160 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.487937    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:20.488334 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.487938    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:20.488334 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:20.488191    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:20.488334 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.487938    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:20.488334 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:20.488248    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:20.488334 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:20.488311    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:20.680437 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.680405    2586 generic.go:356] "Generic (PLEG): container finished" podID="e4af20e7-8ba1-4d68-9522-6330f7879b84" containerID="4c7df04aa8b8166f79ee43b760efa48f38048f96398d889614ed56e69946d058" exitCode=0
Jul 02 20:33:20.681000 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.680481    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2qtww" event={"ID":"e4af20e7-8ba1-4d68-9522-6330f7879b84","Type":"ContainerDied","Data":"4c7df04aa8b8166f79ee43b760efa48f38048f96398d889614ed56e69946d058"}
Jul 02 20:33:20.682315 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.682286    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c7fkk" event={"ID":"a6196c4a-539c-4a63-b16d-d509bc6d8885","Type":"ContainerStarted","Data":"efd508084bd0da8123bf5a3f423901e7205578886c48fcbb6a3f7833adf7d33e"}
Jul 02 20:33:20.684160 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.684125    2586 generic.go:356] "Generic (PLEG): container finished" podID="6c749c1a2e05240aa02b1a7b77acc92d" containerID="ce7dfc35e8aa828c94cdf0841de280ea10200b66cc94eb6741580a21766a3c31" exitCode=0
Jul 02 20:33:20.684258 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.684209    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal" event={"ID":"6c749c1a2e05240aa02b1a7b77acc92d","Type":"ContainerDied","Data":"ce7dfc35e8aa828c94cdf0841de280ea10200b66cc94eb6741580a21766a3c31"}
Jul 02 20:33:20.692607 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.692579    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-shwsd" event={"ID":"883874ea-845c-4cd9-9a88-c949e1371c58","Type":"ContainerStarted","Data":"961509e9e92010eb2a48a0230becb0758d7e7077efe0296a31e820d920844de0"}
Jul 02 20:33:20.694181 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.694155    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg" event={"ID":"814560ef-4088-4294-8c95-4e0ccba914df","Type":"ContainerStarted","Data":"d6d4b73d7a77cae3ab2ed2cd2a04a7d1b25810fb63ea28e74da4287243f9739e"}
Jul 02 20:33:20.695582 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.695556    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v857j" event={"ID":"19657f2b-e66e-43f9-b10a-e0fb44bc558a","Type":"ContainerStarted","Data":"5944f7838e8442422540b2ff9f1403fd144afb2104857462c08aed487bca9d2b"}
Jul 02 20:33:20.696941 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.696918    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f7n4v" event={"ID":"123bcb87-a2a0-4790-88d0-a97fd0ae0436","Type":"ContainerStarted","Data":"26a737234fe2b7fb9c72a13833ccf0b9bdeffc9bed19e701ba6e284cbdca097a"}
Jul 02 20:33:20.718090 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.718047    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v857j" podStartSLOduration=2.699377129 podStartE2EDuration="22.718032008s" totalImagesPullingTime="20.018654879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:20.718010211 +0000 UTC m=+23.841179245" watchObservedRunningTime="2026-07-02 20:33:20.718032008 +0000 UTC m=+23.841201043"
Jul 02 20:33:20.734628 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.734587    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-shwsd" podStartSLOduration=2.843071522 podStartE2EDuration="22.734572381s" totalImagesPullingTime="19.891500859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:20.73407034 +0000 UTC m=+23.857239412" watchObservedRunningTime="2026-07-02 20:33:20.734572381 +0000 UTC m=+23.857741415"
Jul 02 20:33:20.773782 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.773749    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c7fkk" podStartSLOduration=2.604220272 podStartE2EDuration="22.773736612s" totalImagesPullingTime="20.16951634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:20.773371044 +0000 UTC m=+23.896540077" watchObservedRunningTime="2026-07-02 20:33:20.773736612 +0000 UTC m=+23.896905644"
Jul 02 20:33:20.807743 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:20.807695    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f7n4v" podStartSLOduration=2.731308609 podStartE2EDuration="22.807677543s" totalImagesPullingTime="20.076368934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:20.806832765 +0000 UTC m=+23.930001799" watchObservedRunningTime="2026-07-02 20:33:20.807677543 +0000 UTC m=+23.930846577"
Jul 02 20:33:21.294318 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:21.294297    2586 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 20:33:21.363727 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:21.363615    2586 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T20:33:21.294313869Z","UUID":"4f18f854-16db-4ab9-851b-608adf4a4194","Handler":null,"Name":"","Endpoint":""}
Jul 02 20:33:21.365164 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:21.365147    2586 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 20:33:21.365233 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:21.365180    2586 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 20:33:21.701542 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:21.701516    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal" event={"ID":"6c749c1a2e05240aa02b1a7b77acc92d","Type":"ContainerStarted","Data":"2a408369d18ea755db9266e4afc0019f9df696233782961f9c91ab53e3798cb7"}
Jul 02 20:33:21.705631 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:21.705602    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg" event={"ID":"814560ef-4088-4294-8c95-4e0ccba914df","Type":"ContainerStarted","Data":"bdd462a9f7297bff40572a46fa875016af313c00275fb4d241fc76da9a2aafb6"}
Jul 02 20:33:21.720126 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:21.720087    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-48.ec2.internal" podStartSLOduration=23.720069742 podStartE2EDuration="23.720069742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:21.719584284 +0000 UTC m=+24.842753331" watchObservedRunningTime="2026-07-02 20:33:21.720069742 +0000 UTC m=+24.843238776"
Jul 02 20:33:22.487471 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:22.487431    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:22.487605 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:22.487439    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:22.487605 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:22.487532    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:22.487712 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:22.487603    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:22.487712 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:22.487449    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:22.487712 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:22.487702    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:22.709943 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:22.709826    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg" event={"ID":"814560ef-4088-4294-8c95-4e0ccba914df","Type":"ContainerStarted","Data":"5a8c90b322034d1d469268d531ed4e5b7e71c36928227e661a2db2367ffd1f3d"}
Jul 02 20:33:22.713186 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:22.713165    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 20:33:22.713649 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:22.713626    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8" event={"ID":"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43","Type":"ContainerStarted","Data":"dccd97c1c5cf001205bc86147bae6752e3f6fa263626673a0983b61ab75c70f1"}
Jul 02 20:33:22.727041 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:22.726977    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slrrg" podStartSLOduration=2.672942509 podStartE2EDuration="24.726958874s" totalImagesPullingTime="22.054016365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:22.726134795 +0000 UTC m=+25.849303843" watchObservedRunningTime="2026-07-02 20:33:22.726958874 +0000 UTC m=+25.850127913"
Jul 02 20:33:24.110906 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:24.110660    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v857j"
Jul 02 20:33:24.111451 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:24.111262    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v857j"
Jul 02 20:33:24.487376 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:24.487292    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:24.487376 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:24.487313    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:24.487376 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:24.487315    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:24.487585 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:24.487417    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:24.487585 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:24.487456    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:24.487585 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:24.487548    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:24.720997 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:24.720968    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 20:33:24.721337 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:24.721306    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8" event={"ID":"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43","Type":"ContainerStarted","Data":"cd59caf932b8ee7015b10115e490fc822126187bcf3605036aaf4ab2b3933ed0"}
Jul 02 20:33:24.721507 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:24.721491    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v857j"
Jul 02 20:33:24.721971 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:24.721930    2586 scope.go:117] "RemoveContainer" containerID="6564ff2a4548f8eda4d299d39bf8d6f59da30c0977dc5bb3918d43cac38dace1"
Jul 02 20:33:24.721971 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:24.721960    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v857j"
Jul 02 20:33:25.729949 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:25.729923    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 20:33:25.730610 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:25.730380    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8" event={"ID":"1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43","Type":"ContainerStarted","Data":"29f9c64facc8469817859df2f9c48110dfa8768fbf92ae2da6e52a6d1bea4e0c"}
Jul 02 20:33:25.731332 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:25.731171    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:33:25.731332 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:25.731252    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:33:25.731332 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:25.731298    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:33:25.749188 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:25.749110    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:33:25.749853 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:25.749833    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:33:25.764691 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:25.764318    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8" podStartSLOduration=7.7224441 podStartE2EDuration="27.764298924s" totalImagesPullingTime="20.041854824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:25.762771044 +0000 UTC m=+28.885940097" watchObservedRunningTime="2026-07-02 20:33:25.764298924 +0000 UTC m=+28.887467958"
Jul 02 20:33:25.975354 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:25.975309    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qz9mm"]
Jul 02 20:33:25.975546 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:25.975439    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:25.975617 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:25.975539    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:25.976171 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:25.976148    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6qb52"]
Jul 02 20:33:25.976271 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:25.976235    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:25.976344 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:25.976327    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:25.977986 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:25.977957    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5hjrx"]
Jul 02 20:33:25.978063 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:25.978048    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:25.978148 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:25.978127    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:27.488303 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:27.488270    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:27.488708 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:27.488358    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:27.488708 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:27.488444    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:27.488708 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:27.488515    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:27.488708 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:27.488556    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:27.488708 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:27.488682    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:27.735503 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:27.735469    2586 generic.go:356] "Generic (PLEG): container finished" podID="e4af20e7-8ba1-4d68-9522-6330f7879b84" containerID="4beb6af3a39bad1bdaa8fca4d3f2e0e9513666d07bab22595f91caefbc3bfafd" exitCode=0
Jul 02 20:33:27.735708 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:27.735559    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2qtww" event={"ID":"e4af20e7-8ba1-4d68-9522-6330f7879b84","Type":"ContainerDied","Data":"4beb6af3a39bad1bdaa8fca4d3f2e0e9513666d07bab22595f91caefbc3bfafd"}
Jul 02 20:33:29.487955 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:29.487924    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:29.488383 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:29.487924    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:29.488383 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:29.488051    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:29.488383 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:29.487930    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:29.488383 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:29.488088    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:29.488383 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:29.488167    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:29.741598 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:29.741525    2586 generic.go:356] "Generic (PLEG): container finished" podID="e4af20e7-8ba1-4d68-9522-6330f7879b84" containerID="570dc71c86a04e3507148375268641330716447788f42c01799687fb57d4ce1f" exitCode=0
Jul 02 20:33:29.741598 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:29.741584    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2qtww" event={"ID":"e4af20e7-8ba1-4d68-9522-6330f7879b84","Type":"ContainerDied","Data":"570dc71c86a04e3507148375268641330716447788f42c01799687fb57d4ce1f"}
Jul 02 20:33:30.031701 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:30.031640    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:30.031826 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:30.031737    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:33:30.031826 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:30.031777    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret podName:f8702e6e-b6c8-46a3-b197-a711010573f7 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:02.031765057 +0000 UTC m=+65.154934068 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret") pod "global-pull-secret-syncer-6qb52" (UID: "f8702e6e-b6c8-46a3-b197-a711010573f7") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:33:30.132643 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:30.132622    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs\") pod \"network-metrics-daemon-5hjrx\" (UID: \"c6df2599-96ba-4a56-a663-dc78b5094ed0\") " pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:30.132761 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:30.132725    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:30.132799 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:30.132762    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs podName:c6df2599-96ba-4a56-a663-dc78b5094ed0 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:02.132751107 +0000 UTC m=+65.255920118 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs") pod "network-metrics-daemon-5hjrx" (UID: "c6df2599-96ba-4a56-a663-dc78b5094ed0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:30.233178 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:30.233151    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4qwp\" (UniqueName: \"kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp\") pod \"network-check-target-qz9mm\" (UID: \"25c170de-779b-453c-ab0f-19c81c715a48\") " pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:30.233292 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:30.233277    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:33:30.233331 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:30.233302    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:33:30.233331 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:30.233311    2586 projected.go:196] Error preparing data for projected volume kube-api-access-k4qwp for pod openshift-network-diagnostics/network-check-target-qz9mm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:30.233392 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:30.233362    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp podName:25c170de-779b-453c-ab0f-19c81c715a48 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:02.233349536 +0000 UTC m=+65.356518548 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4qwp" (UniqueName: "kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp") pod "network-check-target-qz9mm" (UID: "25c170de-779b-453c-ab0f-19c81c715a48") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:30.745890 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:30.745694    2586 generic.go:356] "Generic (PLEG): container finished" podID="e4af20e7-8ba1-4d68-9522-6330f7879b84" containerID="97c9ba34c7ff3cc47b0cf68a7c0ab34b95d4bee4052c44ec399c129c15e01483" exitCode=0
Jul 02 20:33:30.745890 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:30.745784    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2qtww" event={"ID":"e4af20e7-8ba1-4d68-9522-6330f7879b84","Type":"ContainerDied","Data":"97c9ba34c7ff3cc47b0cf68a7c0ab34b95d4bee4052c44ec399c129c15e01483"}
Jul 02 20:33:31.487463 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.487443    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:31.487530 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.487494    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:31.487530 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.487507    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:31.487595 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:31.487570    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qz9mm" podUID="25c170de-779b-453c-ab0f-19c81c715a48"
Jul 02 20:33:31.487679 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:31.487656    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hjrx" podUID="c6df2599-96ba-4a56-a663-dc78b5094ed0"
Jul 02 20:33:31.487743 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:31.487725    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6qb52" podUID="f8702e6e-b6c8-46a3-b197-a711010573f7"
Jul 02 20:33:31.608967 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.608947    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-48.ec2.internal" event="NodeReady"
Jul 02 20:33:31.609070 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.609054    2586 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 20:33:31.657054 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.656919    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sk5kl"]
Jul 02 20:33:31.659132 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.659099    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:31.659685 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.659660    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w5rwx"]
Jul 02 20:33:31.661491 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.661474    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w5rwx"
Jul 02 20:33:31.661744 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.661706    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 20:33:31.661744 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.661726    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fwtcq\""
Jul 02 20:33:31.661986 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.661970    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 20:33:31.664022 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.664006    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l286d\""
Jul 02 20:33:31.664220 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.664205    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 20:33:31.664807 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.664777    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 20:33:31.664807 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.664795    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 20:33:31.671842 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.671823    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sk5kl"]
Jul 02 20:33:31.675862 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.675823    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w5rwx"]
Jul 02 20:33:31.743411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.743329    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6a67d73-8d0e-4800-912c-70f15a77dd91-cert\") pod \"ingress-canary-w5rwx\" (UID: \"e6a67d73-8d0e-4800-912c-70f15a77dd91\") " pod="openshift-ingress-canary/ingress-canary-w5rwx"
Jul 02 20:33:31.743411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.743375    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx569\" (UniqueName: \"kubernetes.io/projected/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-kube-api-access-hx569\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:31.743411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.743405    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-config-volume\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:31.743649 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.743478    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-tmp-dir\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:31.743649 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.743520    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:31.743649 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.743538    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfvsh\" (UniqueName: \"kubernetes.io/projected/e6a67d73-8d0e-4800-912c-70f15a77dd91-kube-api-access-zfvsh\") pod \"ingress-canary-w5rwx\" (UID: \"e6a67d73-8d0e-4800-912c-70f15a77dd91\") " pod="openshift-ingress-canary/ingress-canary-w5rwx"
Jul 02 20:33:31.844461 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.844431    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx569\" (UniqueName: \"kubernetes.io/projected/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-kube-api-access-hx569\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:31.844931 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.844468    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-config-volume\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:31.844931 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.844487    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-tmp-dir\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:31.844931 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.844507    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:31.844931 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.844523    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfvsh\" (UniqueName: \"kubernetes.io/projected/e6a67d73-8d0e-4800-912c-70f15a77dd91-kube-api-access-zfvsh\") pod \"ingress-canary-w5rwx\" (UID: \"e6a67d73-8d0e-4800-912c-70f15a77dd91\") " pod="openshift-ingress-canary/ingress-canary-w5rwx"
Jul 02 20:33:31.844931 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.844639    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6a67d73-8d0e-4800-912c-70f15a77dd91-cert\") pod \"ingress-canary-w5rwx\" (UID: \"e6a67d73-8d0e-4800-912c-70f15a77dd91\") " pod="openshift-ingress-canary/ingress-canary-w5rwx"
Jul 02 20:33:31.844931 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:31.844645    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:31.844931 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:31.844715    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls podName:38989e8b-a4f6-4305-b6fb-aa79e43cb7e6 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:32.344692615 +0000 UTC m=+35.467861628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls") pod "dns-default-sk5kl" (UID: "38989e8b-a4f6-4305-b6fb-aa79e43cb7e6") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:31.844931 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.844866    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-tmp-dir\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:31.845320 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.845198    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-config-volume\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:31.849003 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.848981    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6a67d73-8d0e-4800-912c-70f15a77dd91-cert\") pod \"ingress-canary-w5rwx\" (UID: \"e6a67d73-8d0e-4800-912c-70f15a77dd91\") " pod="openshift-ingress-canary/ingress-canary-w5rwx"
Jul 02 20:33:31.852913 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.852867    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx569\" (UniqueName: \"kubernetes.io/projected/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-kube-api-access-hx569\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:31.853171 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.853152    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfvsh\" (UniqueName: \"kubernetes.io/projected/e6a67d73-8d0e-4800-912c-70f15a77dd91-kube-api-access-zfvsh\") pod \"ingress-canary-w5rwx\" (UID: \"e6a67d73-8d0e-4800-912c-70f15a77dd91\") " pod="openshift-ingress-canary/ingress-canary-w5rwx"
Jul 02 20:33:31.978417 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:31.978389    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w5rwx"
Jul 02 20:33:32.124745 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:32.124712    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w5rwx"]
Jul 02 20:33:32.129327 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:33:32.129300    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a67d73_8d0e_4800_912c_70f15a77dd91.slice/crio-46792dce5ace5a3b9c16e0992eef41b2dd71b61f23099971ab428e4a6262de9d WatchSource:0}: Error finding container 46792dce5ace5a3b9c16e0992eef41b2dd71b61f23099971ab428e4a6262de9d: Status 404 returned error can't find the container with id 46792dce5ace5a3b9c16e0992eef41b2dd71b61f23099971ab428e4a6262de9d
Jul 02 20:33:32.347525 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:32.347448    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:32.347684 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:32.347597    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:32.347684 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:32.347653    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls podName:38989e8b-a4f6-4305-b6fb-aa79e43cb7e6 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:33.347639459 +0000 UTC m=+36.470808470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls") pod "dns-default-sk5kl" (UID: "38989e8b-a4f6-4305-b6fb-aa79e43cb7e6") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:32.751789 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:32.751712    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w5rwx" event={"ID":"e6a67d73-8d0e-4800-912c-70f15a77dd91","Type":"ContainerStarted","Data":"46792dce5ace5a3b9c16e0992eef41b2dd71b61f23099971ab428e4a6262de9d"}
Jul 02 20:33:33.355381 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:33.355343    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:33.356159 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:33.355502    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:33.356159 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:33.355579    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls podName:38989e8b-a4f6-4305-b6fb-aa79e43cb7e6 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:35.355556982 +0000 UTC m=+38.478725997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls") pod "dns-default-sk5kl" (UID: "38989e8b-a4f6-4305-b6fb-aa79e43cb7e6") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:33.487305 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:33.487269    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:33:33.487470 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:33.487315    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:33:33.487544 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:33.487529    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:33:33.490264 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:33.490240    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 20:33:33.491426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:33.491050    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 20:33:33.491426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:33.491107    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2zr7q\""
Jul 02 20:33:33.491426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:33.491214    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 20:33:33.491426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:33.491276    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xbw6r\""
Jul 02 20:33:33.491426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:33.491282    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 20:33:35.371481 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:35.371274    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:35.371481 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:35.371436    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:35.371968 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:35.371562    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls podName:38989e8b-a4f6-4305-b6fb-aa79e43cb7e6 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:39.371545443 +0000 UTC m=+42.494714453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls") pod "dns-default-sk5kl" (UID: "38989e8b-a4f6-4305-b6fb-aa79e43cb7e6") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:36.763493 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:36.763460    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w5rwx" event={"ID":"e6a67d73-8d0e-4800-912c-70f15a77dd91","Type":"ContainerStarted","Data":"9bea086ec05cb38b27f4163b87b9f0e70cf14de56f9351b8b6ae82d94a8a2130"}
Jul 02 20:33:36.766450 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:36.766422    2586 generic.go:356] "Generic (PLEG): container finished" podID="e4af20e7-8ba1-4d68-9522-6330f7879b84" containerID="0d270e3ef87b159e9e106c6fb03137852f402da97b6a05f4c9fb32ff0356bd9c" exitCode=0
Jul 02 20:33:36.766541 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:36.766472    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2qtww" event={"ID":"e4af20e7-8ba1-4d68-9522-6330f7879b84","Type":"ContainerDied","Data":"0d270e3ef87b159e9e106c6fb03137852f402da97b6a05f4c9fb32ff0356bd9c"}
Jul 02 20:33:36.780246 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:36.780210    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w5rwx" podStartSLOduration=1.418947825 podStartE2EDuration="5.780196828s" totalImagesPullingTime="4.361249003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:36.778980188 +0000 UTC m=+39.902149221" watchObservedRunningTime="2026-07-02 20:33:36.780196828 +0000 UTC m=+39.903365861"
Jul 02 20:33:37.771504 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:37.771473    2586 generic.go:356] "Generic (PLEG): container finished" podID="e4af20e7-8ba1-4d68-9522-6330f7879b84" containerID="618a68f4e951e1bacb340d6950d610eb7480b9f121bb4aeec2e4e381c5d5cf51" exitCode=0
Jul 02 20:33:37.771916 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:37.771535    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2qtww" event={"ID":"e4af20e7-8ba1-4d68-9522-6330f7879b84","Type":"ContainerDied","Data":"618a68f4e951e1bacb340d6950d610eb7480b9f121bb4aeec2e4e381c5d5cf51"}
Jul 02 20:33:38.297931 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.297854    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"]
Jul 02 20:33:38.316870 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.316844    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"]
Jul 02 20:33:38.317028 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.316953    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:33:38.320144 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.320110    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 02 20:33:38.320287 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.320196    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 20:33:38.323109 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.323088    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 02 20:33:38.323298 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.323277    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nkwjf\""
Jul 02 20:33:38.323412 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.323394    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 20:33:38.493245 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.493211    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9f2773c5-c32d-454c-8d1c-80285145d19b-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:33:38.493245 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.493245    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8522w\" (UniqueName: \"kubernetes.io/projected/9f2773c5-c32d-454c-8d1c-80285145d19b-kube-api-access-8522w\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:33:38.493438 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.493307    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:33:38.594292 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.594236    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9f2773c5-c32d-454c-8d1c-80285145d19b-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:33:38.594292 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.594262    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8522w\" (UniqueName: \"kubernetes.io/projected/9f2773c5-c32d-454c-8d1c-80285145d19b-kube-api-access-8522w\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:33:38.594446 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.594304    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:33:38.594446 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:38.594385    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 20:33:38.594446 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:38.594436    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls podName:9f2773c5-c32d-454c-8d1c-80285145d19b nodeName:}" failed. No retries permitted until 2026-07-02 20:33:39.094420593 +0000 UTC m=+42.217589621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-n89fk" (UID: "9f2773c5-c32d-454c-8d1c-80285145d19b") : secret "cluster-monitoring-operator-tls" not found
Jul 02 20:33:38.595138 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.595114    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9f2773c5-c32d-454c-8d1c-80285145d19b-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:33:38.605572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.605550    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8522w\" (UniqueName: \"kubernetes.io/projected/9f2773c5-c32d-454c-8d1c-80285145d19b-kube-api-access-8522w\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:33:38.777345 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.777308    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2qtww" event={"ID":"e4af20e7-8ba1-4d68-9522-6330f7879b84","Type":"ContainerStarted","Data":"758642753d67bc45528707ad933b331b4af39f49d6a2224874d187895b636706"}
Jul 02 20:33:38.801220 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:38.801181    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2qtww" podStartSLOduration=7.16059627 podStartE2EDuration="40.801166351s" totalImagesPullingTime="33.640570081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:38.79945527 +0000 UTC m=+41.922624346" watchObservedRunningTime="2026-07-02 20:33:38.801166351 +0000 UTC m=+41.924335423"
Jul 02 20:33:39.097483 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:39.097459    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:33:39.097603 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:39.097549    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 20:33:39.097603 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:39.097603    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls podName:9f2773c5-c32d-454c-8d1c-80285145d19b nodeName:}" failed. No retries permitted until 2026-07-02 20:33:40.097590667 +0000 UTC m=+43.220759679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-n89fk" (UID: "9f2773c5-c32d-454c-8d1c-80285145d19b") : secret "cluster-monitoring-operator-tls" not found
Jul 02 20:33:39.399369 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:39.399301    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:39.399484 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:39.399456    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:39.399521 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:39.399516    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls podName:38989e8b-a4f6-4305-b6fb-aa79e43cb7e6 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:47.399501818 +0000 UTC m=+50.522670830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls") pod "dns-default-sk5kl" (UID: "38989e8b-a4f6-4305-b6fb-aa79e43cb7e6") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:40.103078 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:40.103043    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:33:40.103436 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:40.103191    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 20:33:40.103436 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:40.103248    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls podName:9f2773c5-c32d-454c-8d1c-80285145d19b nodeName:}" failed. No retries permitted until 2026-07-02 20:33:42.10323196 +0000 UTC m=+45.226400989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-n89fk" (UID: "9f2773c5-c32d-454c-8d1c-80285145d19b") : secret "cluster-monitoring-operator-tls" not found
Jul 02 20:33:42.119306 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.119266    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:33:42.119685 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:42.119434    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 20:33:42.119685 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:42.119509    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls podName:9f2773c5-c32d-454c-8d1c-80285145d19b nodeName:}" failed. No retries permitted until 2026-07-02 20:33:46.119493251 +0000 UTC m=+49.242662262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-n89fk" (UID: "9f2773c5-c32d-454c-8d1c-80285145d19b") : secret "cluster-monitoring-operator-tls" not found
Jul 02 20:33:42.345636 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.345609    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8vsgm"]
Jul 02 20:33:42.372242 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.372187    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:42.374632 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.374612    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8vsgm"]
Jul 02 20:33:42.375344 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.375319    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 20:33:42.375425 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.375389    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 20:33:42.375493 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.375466    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 20:33:42.376183 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.376164    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kzdc8\""
Jul 02 20:33:42.376242 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.376184    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 20:33:42.522347 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.522315    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1155da9c-315a-4420-9b3c-e50a246c4013-crio-socket\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:42.522347 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.522347    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1155da9c-315a-4420-9b3c-e50a246c4013-data-volume\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:42.522527 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.522391    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbd4q\" (UniqueName: \"kubernetes.io/projected/1155da9c-315a-4420-9b3c-e50a246c4013-kube-api-access-jbd4q\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:42.522527 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.522461    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:42.522527 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.522483    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:42.622736 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.622688    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbd4q\" (UniqueName: \"kubernetes.io/projected/1155da9c-315a-4420-9b3c-e50a246c4013-kube-api-access-jbd4q\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:42.622873 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.622746    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:42.622873 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.622769    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:42.622873 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.622790    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1155da9c-315a-4420-9b3c-e50a246c4013-crio-socket\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:42.622873 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.622804    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1155da9c-315a-4420-9b3c-e50a246c4013-data-volume\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:42.623069 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:42.622914    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:42.623069 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:42.622985    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls podName:1155da9c-315a-4420-9b3c-e50a246c4013 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:43.1229695 +0000 UTC m=+46.246138510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8vsgm" (UID: "1155da9c-315a-4420-9b3c-e50a246c4013") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:42.623069 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:42.622922    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:33:42.623069 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.623003    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1155da9c-315a-4420-9b3c-e50a246c4013-crio-socket\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:42.623200 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:42.623078    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm podName:1155da9c-315a-4420-9b3c-e50a246c4013 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:43.123059304 +0000 UTC m=+46.246228342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8vsgm" (UID: "1155da9c-315a-4420-9b3c-e50a246c4013") : configmap "kube-rbac-proxy" not found
Jul 02 20:33:42.623237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.623219    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1155da9c-315a-4420-9b3c-e50a246c4013-data-volume\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:42.631450 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:42.631434    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbd4q\" (UniqueName: \"kubernetes.io/projected/1155da9c-315a-4420-9b3c-e50a246c4013-kube-api-access-jbd4q\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:43.125648 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:43.125620    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:43.126026 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:43.125656    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:43.126026 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:43.125731    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:33:43.126026 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:43.125750    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:43.126026 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:43.125799    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls podName:1155da9c-315a-4420-9b3c-e50a246c4013 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:44.125785844 +0000 UTC m=+47.248954856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8vsgm" (UID: "1155da9c-315a-4420-9b3c-e50a246c4013") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:43.126026 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:43.125814    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm podName:1155da9c-315a-4420-9b3c-e50a246c4013 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:44.125806312 +0000 UTC m=+47.248975323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8vsgm" (UID: "1155da9c-315a-4420-9b3c-e50a246c4013") : configmap "kube-rbac-proxy" not found
Jul 02 20:33:44.108279 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:44.108255    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c7fkk_a6196c4a-539c-4a63-b16d-d509bc6d8885/dns-node-resolver/0.log"
Jul 02 20:33:44.134675 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:44.134654    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:44.134999 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:44.134689    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:44.134999 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:44.134761    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:33:44.134999 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:44.134781    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:44.134999 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:44.134819    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm podName:1155da9c-315a-4420-9b3c-e50a246c4013 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:46.134805805 +0000 UTC m=+49.257974816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8vsgm" (UID: "1155da9c-315a-4420-9b3c-e50a246c4013") : configmap "kube-rbac-proxy" not found
Jul 02 20:33:44.134999 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:44.134832    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls podName:1155da9c-315a-4420-9b3c-e50a246c4013 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:46.134826675 +0000 UTC m=+49.257995686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8vsgm" (UID: "1155da9c-315a-4420-9b3c-e50a246c4013") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:45.111026 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:45.111002    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f7n4v_123bcb87-a2a0-4790-88d0-a97fd0ae0436/node-ca/0.log"
Jul 02 20:33:46.108525 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.108500    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w5rwx_e6a67d73-8d0e-4800-912c-70f15a77dd91/serve-healthcheck-canary/0.log"
Jul 02 20:33:46.151532 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.151499    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:33:46.151664 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.151558    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:46.151664 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.151581    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:46.151664 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:46.151640    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 20:33:46.151767 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:46.151681    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:33:46.151767 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:46.151696    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls podName:9f2773c5-c32d-454c-8d1c-80285145d19b nodeName:}" failed. No retries permitted until 2026-07-02 20:33:54.151683561 +0000 UTC m=+57.274852572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-n89fk" (UID: "9f2773c5-c32d-454c-8d1c-80285145d19b") : secret "cluster-monitoring-operator-tls" not found
Jul 02 20:33:46.151767 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:46.151726    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm podName:1155da9c-315a-4420-9b3c-e50a246c4013 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:50.151714375 +0000 UTC m=+53.274883386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8vsgm" (UID: "1155da9c-315a-4420-9b3c-e50a246c4013") : configmap "kube-rbac-proxy" not found
Jul 02 20:33:46.151767 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:46.151687    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:46.151767 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:46.151764    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls podName:1155da9c-315a-4420-9b3c-e50a246c4013 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:50.151751014 +0000 UTC m=+53.274920026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8vsgm" (UID: "1155da9c-315a-4420-9b3c-e50a246c4013") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:46.289804 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.289764    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"]
Jul 02 20:33:46.337492 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.337464    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"]
Jul 02 20:33:46.337628 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.337550    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"
Jul 02 20:33:46.340261 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.340232    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6ztlz\""
Jul 02 20:33:46.340390 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.340277    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 02 20:33:46.341065 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.341048    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 02 20:33:46.341217 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.341049    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:33:46.455033 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.454960    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml82j\" (UniqueName: \"kubernetes.io/projected/98e44269-04ed-4912-b6df-8a37189fd908-kube-api-access-ml82j\") pod \"cluster-samples-operator-56fcf86bf-bqsvc\" (UID: \"98e44269-04ed-4912-b6df-8a37189fd908\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"
Jul 02 20:33:46.455197 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.455082    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bqsvc\" (UID: \"98e44269-04ed-4912-b6df-8a37189fd908\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"
Jul 02 20:33:46.556419 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.556385    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bqsvc\" (UID: \"98e44269-04ed-4912-b6df-8a37189fd908\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"
Jul 02 20:33:46.556543 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.556452    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml82j\" (UniqueName: \"kubernetes.io/projected/98e44269-04ed-4912-b6df-8a37189fd908-kube-api-access-ml82j\") pod \"cluster-samples-operator-56fcf86bf-bqsvc\" (UID: \"98e44269-04ed-4912-b6df-8a37189fd908\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"
Jul 02 20:33:46.556543 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:46.556534    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 20:33:46.556612 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:46.556591    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls podName:98e44269-04ed-4912-b6df-8a37189fd908 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:47.056576314 +0000 UTC m=+50.179745325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bqsvc" (UID: "98e44269-04ed-4912-b6df-8a37189fd908") : secret "samples-operator-tls" not found
Jul 02 20:33:46.568158 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:46.568137    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml82j\" (UniqueName: \"kubernetes.io/projected/98e44269-04ed-4912-b6df-8a37189fd908-kube-api-access-ml82j\") pod \"cluster-samples-operator-56fcf86bf-bqsvc\" (UID: \"98e44269-04ed-4912-b6df-8a37189fd908\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"
Jul 02 20:33:47.060640 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:47.060604    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bqsvc\" (UID: \"98e44269-04ed-4912-b6df-8a37189fd908\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"
Jul 02 20:33:47.060822 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:47.060766    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 20:33:47.060862 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:47.060830    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls podName:98e44269-04ed-4912-b6df-8a37189fd908 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:48.060814425 +0000 UTC m=+51.183983441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bqsvc" (UID: "98e44269-04ed-4912-b6df-8a37189fd908") : secret "samples-operator-tls" not found
Jul 02 20:33:47.318897 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:47.318803    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fwssc"]
Jul 02 20:33:47.330062 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:47.330041    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fwssc"
Jul 02 20:33:47.335767 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:47.335747    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 02 20:33:47.336769 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:47.336747    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:33:47.336895 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:47.336781    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-c6vdd\""
Jul 02 20:33:47.365261 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:47.365236    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fwssc"]
Jul 02 20:33:47.462916 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:47.462864    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfb7p\" (UniqueName: \"kubernetes.io/projected/b329bcd6-6bc1-4ef2-b4dd-c00089308cd6-kube-api-access-wfb7p\") pod \"volume-data-source-validator-5d456fdbcd-fwssc\" (UID: \"b329bcd6-6bc1-4ef2-b4dd-c00089308cd6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fwssc"
Jul 02 20:33:47.463098 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:47.462937    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:33:47.463098 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:47.463024    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:47.463098 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:47.463079    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls podName:38989e8b-a4f6-4305-b6fb-aa79e43cb7e6 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:03.463063949 +0000 UTC m=+66.586232961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls") pod "dns-default-sk5kl" (UID: "38989e8b-a4f6-4305-b6fb-aa79e43cb7e6") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:47.563774 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:47.563738    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfb7p\" (UniqueName: \"kubernetes.io/projected/b329bcd6-6bc1-4ef2-b4dd-c00089308cd6-kube-api-access-wfb7p\") pod \"volume-data-source-validator-5d456fdbcd-fwssc\" (UID: \"b329bcd6-6bc1-4ef2-b4dd-c00089308cd6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fwssc"
Jul 02 20:33:47.600711 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:47.600643    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfb7p\" (UniqueName: \"kubernetes.io/projected/b329bcd6-6bc1-4ef2-b4dd-c00089308cd6-kube-api-access-wfb7p\") pod \"volume-data-source-validator-5d456fdbcd-fwssc\" (UID: \"b329bcd6-6bc1-4ef2-b4dd-c00089308cd6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fwssc"
Jul 02 20:33:47.638356 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:47.638320    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fwssc"
Jul 02 20:33:47.784848 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:47.784812    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fwssc"]
Jul 02 20:33:47.788912 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:33:47.788872    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb329bcd6_6bc1_4ef2_b4dd_c00089308cd6.slice/crio-77c8610c762397e6a6296dfdcdae4c37d438cf2b8f5de5329805dddeda551164 WatchSource:0}: Error finding container 77c8610c762397e6a6296dfdcdae4c37d438cf2b8f5de5329805dddeda551164: Status 404 returned error can't find the container with id 77c8610c762397e6a6296dfdcdae4c37d438cf2b8f5de5329805dddeda551164
Jul 02 20:33:47.799280 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:47.799254    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fwssc" event={"ID":"b329bcd6-6bc1-4ef2-b4dd-c00089308cd6","Type":"ContainerStarted","Data":"77c8610c762397e6a6296dfdcdae4c37d438cf2b8f5de5329805dddeda551164"}
Jul 02 20:33:48.067894 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.067854    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bqsvc\" (UID: \"98e44269-04ed-4912-b6df-8a37189fd908\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"
Jul 02 20:33:48.068045 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:48.068015    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 20:33:48.068090 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:48.068079    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls podName:98e44269-04ed-4912-b6df-8a37189fd908 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:50.068062873 +0000 UTC m=+53.191231884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bqsvc" (UID: "98e44269-04ed-4912-b6df-8a37189fd908") : secret "samples-operator-tls" not found
Jul 02 20:33:48.323257 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.323184    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-rd826"]
Jul 02 20:33:48.339126 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.339101    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:48.351303 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.351284    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 02 20:33:48.354095 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.354077    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 02 20:33:48.356067 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.356040    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lqmb6\""
Jul 02 20:33:48.356067 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.356060    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:33:48.357847 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.357825    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 02 20:33:48.361280 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.361259    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 02 20:33:48.370099 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.370079    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-rd826"]
Jul 02 20:33:48.410201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.410175    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9"]
Jul 02 20:33:48.433159 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.433138    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9"
Jul 02 20:33:48.436134 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.436113    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9"]
Jul 02 20:33:48.436653 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.436641    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 02 20:33:48.437079 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.437062    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 02 20:33:48.437774 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.437758    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xbrtb\""
Jul 02 20:33:48.438399 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.438382    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:33:48.439131 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.439109    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 02 20:33:48.470707 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.470684    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e65e32d6-7424-4cc3-b3ae-597696d7a09b-serving-cert\") pod \"console-operator-68b757fb67-rd826\" (UID: \"e65e32d6-7424-4cc3-b3ae-597696d7a09b\") " pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:48.470845 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.470729    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e65e32d6-7424-4cc3-b3ae-597696d7a09b-trusted-ca\") pod \"console-operator-68b757fb67-rd826\" (UID: \"e65e32d6-7424-4cc3-b3ae-597696d7a09b\") " pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:48.470925 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.470840    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e65e32d6-7424-4cc3-b3ae-597696d7a09b-config\") pod \"console-operator-68b757fb67-rd826\" (UID: \"e65e32d6-7424-4cc3-b3ae-597696d7a09b\") " pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:48.470925 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.470872    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w84tl\" (UniqueName: \"kubernetes.io/projected/e65e32d6-7424-4cc3-b3ae-597696d7a09b-kube-api-access-w84tl\") pod \"console-operator-68b757fb67-rd826\" (UID: \"e65e32d6-7424-4cc3-b3ae-597696d7a09b\") " pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:48.571977 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.571950    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e65e32d6-7424-4cc3-b3ae-597696d7a09b-serving-cert\") pod \"console-operator-68b757fb67-rd826\" (UID: \"e65e32d6-7424-4cc3-b3ae-597696d7a09b\") " pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:48.572087 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.571991    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e65e32d6-7424-4cc3-b3ae-597696d7a09b-trusted-ca\") pod \"console-operator-68b757fb67-rd826\" (UID: \"e65e32d6-7424-4cc3-b3ae-597696d7a09b\") " pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:48.572087 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.572036    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0fdb2a89-4021-4e09-a096-a519e46d1d38-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-248n9\" (UID: \"0fdb2a89-4021-4e09-a096-a519e46d1d38\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9"
Jul 02 20:33:48.572087 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.572064    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e65e32d6-7424-4cc3-b3ae-597696d7a09b-config\") pod \"console-operator-68b757fb67-rd826\" (UID: \"e65e32d6-7424-4cc3-b3ae-597696d7a09b\") " pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:48.572087 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.572080    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w84tl\" (UniqueName: \"kubernetes.io/projected/e65e32d6-7424-4cc3-b3ae-597696d7a09b-kube-api-access-w84tl\") pod \"console-operator-68b757fb67-rd826\" (UID: \"e65e32d6-7424-4cc3-b3ae-597696d7a09b\") " pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:48.572235 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.572097    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0fdb2a89-4021-4e09-a096-a519e46d1d38-config\") pod \"service-ca-operator-5d46d9ffd4-248n9\" (UID: \"0fdb2a89-4021-4e09-a096-a519e46d1d38\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9"
Jul 02 20:33:48.572235 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.572115    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dbdh\" (UniqueName: \"kubernetes.io/projected/0fdb2a89-4021-4e09-a096-a519e46d1d38-kube-api-access-4dbdh\") pod \"service-ca-operator-5d46d9ffd4-248n9\" (UID: \"0fdb2a89-4021-4e09-a096-a519e46d1d38\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9"
Jul 02 20:33:48.572727 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.572706    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e65e32d6-7424-4cc3-b3ae-597696d7a09b-config\") pod \"console-operator-68b757fb67-rd826\" (UID: \"e65e32d6-7424-4cc3-b3ae-597696d7a09b\") " pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:48.572845 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.572827    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e65e32d6-7424-4cc3-b3ae-597696d7a09b-trusted-ca\") pod \"console-operator-68b757fb67-rd826\" (UID: \"e65e32d6-7424-4cc3-b3ae-597696d7a09b\") " pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:48.574277 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.574233    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e65e32d6-7424-4cc3-b3ae-597696d7a09b-serving-cert\") pod \"console-operator-68b757fb67-rd826\" (UID: \"e65e32d6-7424-4cc3-b3ae-597696d7a09b\") " pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:48.583432 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.583409    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w84tl\" (UniqueName: \"kubernetes.io/projected/e65e32d6-7424-4cc3-b3ae-597696d7a09b-kube-api-access-w84tl\") pod \"console-operator-68b757fb67-rd826\" (UID: \"e65e32d6-7424-4cc3-b3ae-597696d7a09b\") " pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:48.647987 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.647955    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:48.672994 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.672966    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0fdb2a89-4021-4e09-a096-a519e46d1d38-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-248n9\" (UID: \"0fdb2a89-4021-4e09-a096-a519e46d1d38\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9"
Jul 02 20:33:48.673088 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.673032    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0fdb2a89-4021-4e09-a096-a519e46d1d38-config\") pod \"service-ca-operator-5d46d9ffd4-248n9\" (UID: \"0fdb2a89-4021-4e09-a096-a519e46d1d38\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9"
Jul 02 20:33:48.673088 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.673061    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dbdh\" (UniqueName: \"kubernetes.io/projected/0fdb2a89-4021-4e09-a096-a519e46d1d38-kube-api-access-4dbdh\") pod \"service-ca-operator-5d46d9ffd4-248n9\" (UID: \"0fdb2a89-4021-4e09-a096-a519e46d1d38\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9"
Jul 02 20:33:48.673728 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.673703    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0fdb2a89-4021-4e09-a096-a519e46d1d38-config\") pod \"service-ca-operator-5d46d9ffd4-248n9\" (UID: \"0fdb2a89-4021-4e09-a096-a519e46d1d38\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9"
Jul 02 20:33:48.675203 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.675180    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0fdb2a89-4021-4e09-a096-a519e46d1d38-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-248n9\" (UID: \"0fdb2a89-4021-4e09-a096-a519e46d1d38\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9"
Jul 02 20:33:48.685871 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.685848    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dbdh\" (UniqueName: \"kubernetes.io/projected/0fdb2a89-4021-4e09-a096-a519e46d1d38-kube-api-access-4dbdh\") pod \"service-ca-operator-5d46d9ffd4-248n9\" (UID: \"0fdb2a89-4021-4e09-a096-a519e46d1d38\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9"
Jul 02 20:33:48.742543 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.742501    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9"
Jul 02 20:33:48.805246 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.805216    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-rd826"]
Jul 02 20:33:48.809671 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:33:48.809624    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65e32d6_7424_4cc3_b3ae_597696d7a09b.slice/crio-cbbe668eec0a1c6f85081aba48b2d8078fb58a7200e83082a25d790d27b4e46c WatchSource:0}: Error finding container cbbe668eec0a1c6f85081aba48b2d8078fb58a7200e83082a25d790d27b4e46c: Status 404 returned error can't find the container with id cbbe668eec0a1c6f85081aba48b2d8078fb58a7200e83082a25d790d27b4e46c
Jul 02 20:33:48.913710 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:48.913678    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9"]
Jul 02 20:33:48.917017 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:33:48.916997    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fdb2a89_4021_4e09_a096_a519e46d1d38.slice/crio-899754e0b81d780e508693bd5920159492f4b593a720c071ee3f3dd3c35408c8 WatchSource:0}: Error finding container 899754e0b81d780e508693bd5920159492f4b593a720c071ee3f3dd3c35408c8: Status 404 returned error can't find the container with id 899754e0b81d780e508693bd5920159492f4b593a720c071ee3f3dd3c35408c8
Jul 02 20:33:49.806923 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:49.806849    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9" event={"ID":"0fdb2a89-4021-4e09-a096-a519e46d1d38","Type":"ContainerStarted","Data":"899754e0b81d780e508693bd5920159492f4b593a720c071ee3f3dd3c35408c8"}
Jul 02 20:33:49.808198 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:49.808159    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rd826" event={"ID":"e65e32d6-7424-4cc3-b3ae-597696d7a09b","Type":"ContainerStarted","Data":"cbbe668eec0a1c6f85081aba48b2d8078fb58a7200e83082a25d790d27b4e46c"}
Jul 02 20:33:50.084276 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:50.084246    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bqsvc\" (UID: \"98e44269-04ed-4912-b6df-8a37189fd908\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"
Jul 02 20:33:50.084425 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:50.084406    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 20:33:50.084529 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:50.084469    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls podName:98e44269-04ed-4912-b6df-8a37189fd908 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:54.084449074 +0000 UTC m=+57.207618096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bqsvc" (UID: "98e44269-04ed-4912-b6df-8a37189fd908") : secret "samples-operator-tls" not found
Jul 02 20:33:50.185225 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:50.185182    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:50.185423 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:50.185253    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:50.185423 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:50.185313    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:33:50.185423 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:50.185383    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:50.185423 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:50.185392    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm podName:1155da9c-315a-4420-9b3c-e50a246c4013 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:58.185371821 +0000 UTC m=+61.308540831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8vsgm" (UID: "1155da9c-315a-4420-9b3c-e50a246c4013") : configmap "kube-rbac-proxy" not found
Jul 02 20:33:50.185423 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:50.185424    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls podName:1155da9c-315a-4420-9b3c-e50a246c4013 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:58.185411867 +0000 UTC m=+61.308580879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8vsgm" (UID: "1155da9c-315a-4420-9b3c-e50a246c4013") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:50.812182 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:50.812148    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fwssc" event={"ID":"b329bcd6-6bc1-4ef2-b4dd-c00089308cd6","Type":"ContainerStarted","Data":"61c2674b42e5afa1c8859e653db84436f14951d786533af66b4f20ca281134ea"}
Jul 02 20:33:50.828487 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:50.828434    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fwssc" podStartSLOduration=1.630668709 podStartE2EDuration="3.828417683s" totalImagesPullingTime="2.197748974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:50.82820162 +0000 UTC m=+53.951370653" watchObservedRunningTime="2026-07-02 20:33:50.828417683 +0000 UTC m=+53.951586717"
Jul 02 20:33:52.819213 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:52.819173    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9" event={"ID":"0fdb2a89-4021-4e09-a096-a519e46d1d38","Type":"ContainerStarted","Data":"b972378e4b3983bd8da5429a684fae68af2f2dd723117ef59929242e99a73280"}
Jul 02 20:33:52.820737 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:52.820717    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/0.log"
Jul 02 20:33:52.820837 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:52.820750    2586 generic.go:356] "Generic (PLEG): container finished" podID="e65e32d6-7424-4cc3-b3ae-597696d7a09b" containerID="6cc9e14dfe23a9a00c96ffc4a62ff6934b973cad09f3a5c5721326e9e7c2069e" exitCode=255
Jul 02 20:33:52.820837 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:52.820792    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rd826" event={"ID":"e65e32d6-7424-4cc3-b3ae-597696d7a09b","Type":"ContainerDied","Data":"6cc9e14dfe23a9a00c96ffc4a62ff6934b973cad09f3a5c5721326e9e7c2069e"}
Jul 02 20:33:52.821045 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:52.821028    2586 scope.go:117] "RemoveContainer" containerID="6cc9e14dfe23a9a00c96ffc4a62ff6934b973cad09f3a5c5721326e9e7c2069e"
Jul 02 20:33:52.838919 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:52.838836    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9" podStartSLOduration=1.858583034 podStartE2EDuration="4.838818622s" totalImagesPullingTime="2.980235588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:52.838265015 +0000 UTC m=+55.961434075" watchObservedRunningTime="2026-07-02 20:33:52.838818622 +0000 UTC m=+55.961987656"
Jul 02 20:33:53.827274 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:53.827245    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 20:33:53.827641 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:53.827570    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/0.log"
Jul 02 20:33:53.827641 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:53.827602    2586 generic.go:356] "Generic (PLEG): container finished" podID="e65e32d6-7424-4cc3-b3ae-597696d7a09b" containerID="1a462e5d1aa960ab3c94f6ec476d9048e254d282fa6831ade2c1e0ee2ce02a2b" exitCode=255
Jul 02 20:33:53.827734 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:53.827683    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rd826" event={"ID":"e65e32d6-7424-4cc3-b3ae-597696d7a09b","Type":"ContainerDied","Data":"1a462e5d1aa960ab3c94f6ec476d9048e254d282fa6831ade2c1e0ee2ce02a2b"}
Jul 02 20:33:53.828591 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:53.828578    2586 scope.go:117] "RemoveContainer" containerID="6cc9e14dfe23a9a00c96ffc4a62ff6934b973cad09f3a5c5721326e9e7c2069e"
Jul 02 20:33:53.828669 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:53.828660    2586 scope.go:117] "RemoveContainer" containerID="1a462e5d1aa960ab3c94f6ec476d9048e254d282fa6831ade2c1e0ee2ce02a2b"
Jul 02 20:33:53.828841 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:53.828815    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-rd826_openshift-console-operator(e65e32d6-7424-4cc3-b3ae-597696d7a09b)\"" pod="openshift-console-operator/console-operator-68b757fb67-rd826" podUID="e65e32d6-7424-4cc3-b3ae-597696d7a09b"
Jul 02 20:33:54.114330 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:54.114233    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bqsvc\" (UID: \"98e44269-04ed-4912-b6df-8a37189fd908\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"
Jul 02 20:33:54.114478 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:54.114362    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 20:33:54.114478 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:54.114420    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls podName:98e44269-04ed-4912-b6df-8a37189fd908 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:02.114406007 +0000 UTC m=+65.237575018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bqsvc" (UID: "98e44269-04ed-4912-b6df-8a37189fd908") : secret "samples-operator-tls" not found
Jul 02 20:33:54.214828 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:54.214791    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:33:54.215088 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:54.214960    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 20:33:54.215088 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:54.215024    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls podName:9f2773c5-c32d-454c-8d1c-80285145d19b nodeName:}" failed. No retries permitted until 2026-07-02 20:34:10.215009102 +0000 UTC m=+73.338178114 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-n89fk" (UID: "9f2773c5-c32d-454c-8d1c-80285145d19b") : secret "cluster-monitoring-operator-tls" not found
Jul 02 20:33:54.831346 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:54.831316    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 20:33:54.831823 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:54.831600    2586 scope.go:117] "RemoveContainer" containerID="1a462e5d1aa960ab3c94f6ec476d9048e254d282fa6831ade2c1e0ee2ce02a2b"
Jul 02 20:33:54.831823 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:54.831765    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-rd826_openshift-console-operator(e65e32d6-7424-4cc3-b3ae-597696d7a09b)\"" pod="openshift-console-operator/console-operator-68b757fb67-rd826" podUID="e65e32d6-7424-4cc3-b3ae-597696d7a09b"
Jul 02 20:33:57.750835 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:57.750806    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-26dr8"
Jul 02 20:33:58.245161 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:58.245123    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:58.245161 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:58.245164    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:58.245364 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:58.245290    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:58.245364 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:58.245353    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls podName:1155da9c-315a-4420-9b3c-e50a246c4013 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:14.245338986 +0000 UTC m=+77.368507997 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8vsgm" (UID: "1155da9c-315a-4420-9b3c-e50a246c4013") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:58.245644 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:58.245624    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1155da9c-315a-4420-9b3c-e50a246c4013-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:33:58.648811 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:58.648780    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:58.648982 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:58.648830    2586 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:33:58.649149 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:33:58.649137    2586 scope.go:117] "RemoveContainer" containerID="1a462e5d1aa960ab3c94f6ec476d9048e254d282fa6831ade2c1e0ee2ce02a2b"
Jul 02 20:33:58.649283 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:33:58.649267    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-rd826_openshift-console-operator(e65e32d6-7424-4cc3-b3ae-597696d7a09b)\"" pod="openshift-console-operator/console-operator-68b757fb67-rd826" podUID="e65e32d6-7424-4cc3-b3ae-597696d7a09b"
Jul 02 20:34:02.076045 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.076002    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:34:02.078572 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.078553    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 20:34:02.088728 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.088699    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8702e6e-b6c8-46a3-b197-a711010573f7-original-pull-secret\") pod \"global-pull-secret-syncer-6qb52\" (UID: \"f8702e6e-b6c8-46a3-b197-a711010573f7\") " pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:34:02.177002 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.176960    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bqsvc\" (UID: \"98e44269-04ed-4912-b6df-8a37189fd908\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"
Jul 02 20:34:02.177002 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.177006    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs\") pod \"network-metrics-daemon-5hjrx\" (UID: \"c6df2599-96ba-4a56-a663-dc78b5094ed0\") " pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:34:02.179334 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.179314    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/98e44269-04ed-4912-b6df-8a37189fd908-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bqsvc\" (UID: \"98e44269-04ed-4912-b6df-8a37189fd908\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"
Jul 02 20:34:02.180032 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.180015    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 20:34:02.187773 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:34:02.187753    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 20:34:02.187855 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:34:02.187810    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs podName:c6df2599-96ba-4a56-a663-dc78b5094ed0 nodeName:}" failed. No retries permitted until 2026-07-02 20:35:06.187795357 +0000 UTC m=+129.310964369 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs") pod "network-metrics-daemon-5hjrx" (UID: "c6df2599-96ba-4a56-a663-dc78b5094ed0") : secret "metrics-daemon-secret" not found
Jul 02 20:34:02.248725 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.248699    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6ztlz\""
Jul 02 20:34:02.257089 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.257070    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"
Jul 02 20:34:02.277983 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.277517    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4qwp\" (UniqueName: \"kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp\") pod \"network-check-target-qz9mm\" (UID: \"25c170de-779b-453c-ab0f-19c81c715a48\") " pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:34:02.280312 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.280293    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 20:34:02.291508 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.291485    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 20:34:02.301898 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.301861    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4qwp\" (UniqueName: \"kubernetes.io/projected/25c170de-779b-453c-ab0f-19c81c715a48-kube-api-access-k4qwp\") pod \"network-check-target-qz9mm\" (UID: \"25c170de-779b-453c-ab0f-19c81c715a48\") " pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:34:02.310046 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.310021    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6qb52"
Jul 02 20:34:02.319065 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.319039    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2zr7q\""
Jul 02 20:34:02.327320 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.327260    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:34:02.390640 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.389719    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc"]
Jul 02 20:34:02.447108 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.447070    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6qb52"]
Jul 02 20:34:02.450042 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:34:02.450016    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8702e6e_b6c8_46a3_b197_a711010573f7.slice/crio-36a49979b26e04abae0644c903d0acdd798c29ac6ce2e5c98e262b065b45db49 WatchSource:0}: Error finding container 36a49979b26e04abae0644c903d0acdd798c29ac6ce2e5c98e262b065b45db49: Status 404 returned error can't find the container with id 36a49979b26e04abae0644c903d0acdd798c29ac6ce2e5c98e262b065b45db49
Jul 02 20:34:02.464925 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.464898    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qz9mm"]
Jul 02 20:34:02.467742 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:34:02.467720    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c170de_779b_453c_ab0f_19c81c715a48.slice/crio-db83a774c90ccc1c70c4c9c3924fce064adecbe97ac44ebb2414fad7cb6f52b7 WatchSource:0}: Error finding container db83a774c90ccc1c70c4c9c3924fce064adecbe97ac44ebb2414fad7cb6f52b7: Status 404 returned error can't find the container with id db83a774c90ccc1c70c4c9c3924fce064adecbe97ac44ebb2414fad7cb6f52b7
Jul 02 20:34:02.853322 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.853277    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6qb52" event={"ID":"f8702e6e-b6c8-46a3-b197-a711010573f7","Type":"ContainerStarted","Data":"36a49979b26e04abae0644c903d0acdd798c29ac6ce2e5c98e262b065b45db49"}
Jul 02 20:34:02.854541 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.854510    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc" event={"ID":"98e44269-04ed-4912-b6df-8a37189fd908","Type":"ContainerStarted","Data":"f81a02a32cf9ce4f24bdca605ca6af23259efecb972e5b1e9fd8b87580f5b7f9"}
Jul 02 20:34:02.855771 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:02.855750    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qz9mm" event={"ID":"25c170de-779b-453c-ab0f-19c81c715a48","Type":"ContainerStarted","Data":"db83a774c90ccc1c70c4c9c3924fce064adecbe97ac44ebb2414fad7cb6f52b7"}
Jul 02 20:34:03.487699 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:03.487657    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:34:03.492171 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:03.491753    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38989e8b-a4f6-4305-b6fb-aa79e43cb7e6-metrics-tls\") pod \"dns-default-sk5kl\" (UID: \"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6\") " pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:34:03.772770 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:03.772687    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fwtcq\""
Jul 02 20:34:03.781232 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:03.781204    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:34:03.947823 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:03.947787    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sk5kl"]
Jul 02 20:34:04.508521 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:34:04.508480    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38989e8b_a4f6_4305_b6fb_aa79e43cb7e6.slice/crio-4cf85ae2c1bbd845e4fa6c95c7ec700723d105200d0c0ba88bd849ad2deb6754 WatchSource:0}: Error finding container 4cf85ae2c1bbd845e4fa6c95c7ec700723d105200d0c0ba88bd849ad2deb6754: Status 404 returned error can't find the container with id 4cf85ae2c1bbd845e4fa6c95c7ec700723d105200d0c0ba88bd849ad2deb6754
Jul 02 20:34:04.865425 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:04.865343    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sk5kl" event={"ID":"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6","Type":"ContainerStarted","Data":"4cf85ae2c1bbd845e4fa6c95c7ec700723d105200d0c0ba88bd849ad2deb6754"}
Jul 02 20:34:07.876337 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:07.876299    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc" event={"ID":"98e44269-04ed-4912-b6df-8a37189fd908","Type":"ContainerStarted","Data":"e9b6bc01795ec960bb459d00b6d417986edc7403c60c23233c09a1fcba67e98c"}
Jul 02 20:34:07.876783 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:07.876360    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc" event={"ID":"98e44269-04ed-4912-b6df-8a37189fd908","Type":"ContainerStarted","Data":"63695b9a951686da9165667d728b0dab216a8700000866e22d140d07283f227c"}
Jul 02 20:34:07.878186 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:07.878148    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qz9mm" event={"ID":"25c170de-779b-453c-ab0f-19c81c715a48","Type":"ContainerStarted","Data":"f32a8308ba7b12e31806a4015e194355c8d8e8fc48e2663d4eee4911ef3a2a1e"}
Jul 02 20:34:07.878317 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:07.878230    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:34:07.879954 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:07.879916    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6qb52" event={"ID":"f8702e6e-b6c8-46a3-b197-a711010573f7","Type":"ContainerStarted","Data":"7b4d1e3b541ec48084b0869c83cc5ef9887736f0ef96c74a81ceb89b6186b314"}
Jul 02 20:34:07.914038 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:07.913946    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6qb52" podStartSLOduration=64.763781416 podStartE2EDuration="1m9.913925598s" totalImagesPullingTime="5.150144182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:07.912236837 +0000 UTC m=+71.035405897" watchObservedRunningTime="2026-07-02 20:34:07.913925598 +0000 UTC m=+71.037094633"
Jul 02 20:34:07.914770 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:07.914732    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bqsvc" podStartSLOduration=16.767933019 podStartE2EDuration="21.914718378s" totalImagesPullingTime="5.146785359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:07.895500473 +0000 UTC m=+71.018669507" watchObservedRunningTime="2026-07-02 20:34:07.914718378 +0000 UTC m=+71.037887412"
Jul 02 20:34:07.933098 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:07.933063    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qz9mm" podStartSLOduration=64.811233954 podStartE2EDuration="1m9.933052604s" totalImagesPullingTime="5.12181865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:07.931916307 +0000 UTC m=+71.055085364" watchObservedRunningTime="2026-07-02 20:34:07.933052604 +0000 UTC m=+71.056221615"
Jul 02 20:34:09.889253 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:09.889216    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sk5kl" event={"ID":"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6","Type":"ContainerStarted","Data":"496a6c462f410da93e0ff3a18ec34d4556694f6c331b1049d1b7b206230e7f7c"}
Jul 02 20:34:09.889733 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:09.889266    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sk5kl" event={"ID":"38989e8b-a4f6-4305-b6fb-aa79e43cb7e6","Type":"ContainerStarted","Data":"9a9506d42c6a3870fa599b512cfeb24c67772b9b1b7be793064c2b67540e3db4"}
Jul 02 20:34:09.889733 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:09.889344    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:34:09.911740 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:09.911694    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sk5kl" podStartSLOduration=34.528216998 podStartE2EDuration="38.911681197s" totalImagesPullingTime="4.383464199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:09.9114378 +0000 UTC m=+73.034606833" watchObservedRunningTime="2026-07-02 20:34:09.911681197 +0000 UTC m=+73.034850229"
Jul 02 20:34:10.243968 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:10.243861    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:34:10.246249 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:10.246224    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f2773c5-c32d-454c-8d1c-80285145d19b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n89fk\" (UID: \"9f2773c5-c32d-454c-8d1c-80285145d19b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:34:10.428467 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:10.428433    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nkwjf\""
Jul 02 20:34:10.436488 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:10.436462    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"
Jul 02 20:34:10.551998 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:10.551967    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk"]
Jul 02 20:34:10.555367 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:34:10.555337    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f2773c5_c32d_454c_8d1c_80285145d19b.slice/crio-e1aaf6881ef798b4dd6317832c478328447f260ef7445ad839bf4e90268af343 WatchSource:0}: Error finding container e1aaf6881ef798b4dd6317832c478328447f260ef7445ad839bf4e90268af343: Status 404 returned error can't find the container with id e1aaf6881ef798b4dd6317832c478328447f260ef7445ad839bf4e90268af343
Jul 02 20:34:10.894199 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:10.894168    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk" event={"ID":"9f2773c5-c32d-454c-8d1c-80285145d19b","Type":"ContainerStarted","Data":"e1aaf6881ef798b4dd6317832c478328447f260ef7445ad839bf4e90268af343"}
Jul 02 20:34:11.487938 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:11.487907    2586 scope.go:117] "RemoveContainer" containerID="1a462e5d1aa960ab3c94f6ec476d9048e254d282fa6831ade2c1e0ee2ce02a2b"
Jul 02 20:34:11.899430 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:11.899402    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 20:34:11.899834 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:11.899500    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rd826" event={"ID":"e65e32d6-7424-4cc3-b3ae-597696d7a09b","Type":"ContainerStarted","Data":"27c42e230bf6472c635e128c0820b5da91af6a4b3ce51942490a5592780f64ce"}
Jul 02 20:34:11.899834 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:11.899793    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:34:11.905651 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:11.905626    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-rd826"
Jul 02 20:34:11.919964 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:11.919915    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-rd826" podStartSLOduration=20.943082597 podStartE2EDuration="23.919895457s" totalImagesPullingTime="2.97681286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:11.918671596 +0000 UTC m=+75.041840627" watchObservedRunningTime="2026-07-02 20:34:11.919895457 +0000 UTC m=+75.043064481"
Jul 02 20:34:12.908472 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:12.908430    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk" event={"ID":"9f2773c5-c32d-454c-8d1c-80285145d19b","Type":"ContainerStarted","Data":"0bc17d0ffcbbcbd92fcfff5c9b9a0de7a0a8ceb9a8c91361d07f8cccd454074b"}
Jul 02 20:34:12.925966 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:12.925920    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n89fk" podStartSLOduration=32.757580664 podStartE2EDuration="34.92590509s" totalImagesPullingTime="2.168324426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:12.925270912 +0000 UTC m=+76.048439946" watchObservedRunningTime="2026-07-02 20:34:12.92590509 +0000 UTC m=+76.049074120"
Jul 02 20:34:14.275856 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:14.275824    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:34:14.278021 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:14.277998    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1155da9c-315a-4420-9b3c-e50a246c4013-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8vsgm\" (UID: \"1155da9c-315a-4420-9b3c-e50a246c4013\") " pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:34:14.484010 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:14.483983    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kzdc8\""
Jul 02 20:34:14.491516 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:14.491493    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8vsgm"
Jul 02 20:34:14.610749 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:14.610721    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8vsgm"]
Jul 02 20:34:14.613816 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:34:14.613792    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1155da9c_315a_4420_9b3c_e50a246c4013.slice/crio-062f83fe293cd25a270f79b94cbca726c61ab2ca3d26fedfbe43823e32d8232c WatchSource:0}: Error finding container 062f83fe293cd25a270f79b94cbca726c61ab2ca3d26fedfbe43823e32d8232c: Status 404 returned error can't find the container with id 062f83fe293cd25a270f79b94cbca726c61ab2ca3d26fedfbe43823e32d8232c
Jul 02 20:34:14.915281 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:14.915210    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8vsgm" event={"ID":"1155da9c-315a-4420-9b3c-e50a246c4013","Type":"ContainerStarted","Data":"062f83fe293cd25a270f79b94cbca726c61ab2ca3d26fedfbe43823e32d8232c"}
Jul 02 20:34:17.540615 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.540580    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh"]
Jul 02 20:34:17.546635 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.546612    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"]
Jul 02 20:34:17.546766 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.546751    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh"
Jul 02 20:34:17.551042 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.550900    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 20:34:17.551042 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.550911    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 20:34:17.551042 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.550904    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 02 20:34:17.551042 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.550985    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 20:34:17.551327 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.551269    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-t2nzl\""
Jul 02 20:34:17.559385 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.559362    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"
Jul 02 20:34:17.560800 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.560782    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh"]
Jul 02 20:34:17.562852 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.562836    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 02 20:34:17.576064 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.576045    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"]
Jul 02 20:34:17.601131 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.601098    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b4a913a-03c7-4650-b172-53ecbd258d6a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh\" (UID: \"3b4a913a-03c7-4650-b172-53ecbd258d6a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh"
Jul 02 20:34:17.601274 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.601193    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krtbq\" (UniqueName: \"kubernetes.io/projected/3b4a913a-03c7-4650-b172-53ecbd258d6a-kube-api-access-krtbq\") pod \"managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh\" (UID: \"3b4a913a-03c7-4650-b172-53ecbd258d6a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh"
Jul 02 20:34:17.684613 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.684579    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6654f959fc-lnwzj"]
Jul 02 20:34:17.688545 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.688523    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.691061 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.691038    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 20:34:17.691196 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.691089    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 20:34:17.691265 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.691218    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vjz5v\""
Jul 02 20:34:17.691372 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.691352    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 20:34:17.697707 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.697687    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 20:34:17.701767 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.701747    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fea507e-5444-47e1-b6a8-71a34f9059bd-tmp\") pod \"klusterlet-addon-workmgr-6cdbb94f58-bwvwj\" (UID: \"3fea507e-5444-47e1-b6a8-71a34f9059bd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"
Jul 02 20:34:17.701844 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.701794    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krtbq\" (UniqueName: \"kubernetes.io/projected/3b4a913a-03c7-4650-b172-53ecbd258d6a-kube-api-access-krtbq\") pod \"managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh\" (UID: \"3b4a913a-03c7-4650-b172-53ecbd258d6a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh"
Jul 02 20:34:17.701844 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.701828    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3fea507e-5444-47e1-b6a8-71a34f9059bd-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cdbb94f58-bwvwj\" (UID: \"3fea507e-5444-47e1-b6a8-71a34f9059bd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"
Jul 02 20:34:17.701987 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.701850    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn9cg\" (UniqueName: \"kubernetes.io/projected/3fea507e-5444-47e1-b6a8-71a34f9059bd-kube-api-access-zn9cg\") pod \"klusterlet-addon-workmgr-6cdbb94f58-bwvwj\" (UID: \"3fea507e-5444-47e1-b6a8-71a34f9059bd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"
Jul 02 20:34:17.702042 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.701979    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b4a913a-03c7-4650-b172-53ecbd258d6a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh\" (UID: \"3b4a913a-03c7-4650-b172-53ecbd258d6a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh"
Jul 02 20:34:17.703770 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.703751    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6654f959fc-lnwzj"]
Jul 02 20:34:17.705251 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.705231    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b4a913a-03c7-4650-b172-53ecbd258d6a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh\" (UID: \"3b4a913a-03c7-4650-b172-53ecbd258d6a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh"
Jul 02 20:34:17.726870 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.726846    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krtbq\" (UniqueName: \"kubernetes.io/projected/3b4a913a-03c7-4650-b172-53ecbd258d6a-kube-api-access-krtbq\") pod \"managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh\" (UID: \"3b4a913a-03c7-4650-b172-53ecbd258d6a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh"
Jul 02 20:34:17.803246 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.803165    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-ca-trust-extracted\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.803246 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.803199    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-installation-pull-secrets\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.803586 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.803262    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fea507e-5444-47e1-b6a8-71a34f9059bd-tmp\") pod \"klusterlet-addon-workmgr-6cdbb94f58-bwvwj\" (UID: \"3fea507e-5444-47e1-b6a8-71a34f9059bd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"
Jul 02 20:34:17.803586 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.803322    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-bound-sa-token\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.803586 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.803359    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-image-registry-private-configuration\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.803586 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.803416    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6gzx\" (UniqueName: \"kubernetes.io/projected/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-kube-api-access-v6gzx\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.803586 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.803443    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-registry-certificates\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.803586 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.803479    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3fea507e-5444-47e1-b6a8-71a34f9059bd-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cdbb94f58-bwvwj\" (UID: \"3fea507e-5444-47e1-b6a8-71a34f9059bd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"
Jul 02 20:34:17.803586 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.803505    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn9cg\" (UniqueName: \"kubernetes.io/projected/3fea507e-5444-47e1-b6a8-71a34f9059bd-kube-api-access-zn9cg\") pod \"klusterlet-addon-workmgr-6cdbb94f58-bwvwj\" (UID: \"3fea507e-5444-47e1-b6a8-71a34f9059bd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"
Jul 02 20:34:17.803586 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.803557    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-trusted-ca\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.803586 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.803585    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-registry-tls\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.803971 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.803622    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fea507e-5444-47e1-b6a8-71a34f9059bd-tmp\") pod \"klusterlet-addon-workmgr-6cdbb94f58-bwvwj\" (UID: \"3fea507e-5444-47e1-b6a8-71a34f9059bd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"
Jul 02 20:34:17.806390 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.806365    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3fea507e-5444-47e1-b6a8-71a34f9059bd-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cdbb94f58-bwvwj\" (UID: \"3fea507e-5444-47e1-b6a8-71a34f9059bd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"
Jul 02 20:34:17.814490 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.814465    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn9cg\" (UniqueName: \"kubernetes.io/projected/3fea507e-5444-47e1-b6a8-71a34f9059bd-kube-api-access-zn9cg\") pod \"klusterlet-addon-workmgr-6cdbb94f58-bwvwj\" (UID: \"3fea507e-5444-47e1-b6a8-71a34f9059bd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"
Jul 02 20:34:17.865838 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.865814    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh"
Jul 02 20:34:17.874191 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.874169    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"
Jul 02 20:34:17.904278 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.904245    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6gzx\" (UniqueName: \"kubernetes.io/projected/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-kube-api-access-v6gzx\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.904278 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.904273    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-registry-certificates\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.904453 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.904430    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-trusted-ca\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.904491 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.904467    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-registry-tls\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.904531 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.904522    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-ca-trust-extracted\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.904576 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.904550    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-installation-pull-secrets\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.904661 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.904579    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-bound-sa-token\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.904661 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.904598    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-image-registry-private-configuration\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.904934 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.904914    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-ca-trust-extracted\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.905016 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.904989    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-registry-certificates\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.905432 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.905411    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-trusted-ca\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.907134 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.906983    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-registry-tls\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.907134 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.907093    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-image-registry-private-configuration\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.907431 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.907410    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-installation-pull-secrets\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.912872 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.912850    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6gzx\" (UniqueName: \"kubernetes.io/projected/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-kube-api-access-v6gzx\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.913006 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.912954    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6cf31eff-b31d-4456-b86d-b5053d0b6b9a-bound-sa-token\") pod \"image-registry-6654f959fc-lnwzj\" (UID: \"6cf31eff-b31d-4456-b86d-b5053d0b6b9a\") " pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:17.999867 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:17.999834    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:18.386185 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:18.386153    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh"]
Jul 02 20:34:18.390083 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:34:18.390058    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b4a913a_03c7_4650_b172_53ecbd258d6a.slice/crio-98608bb00a0c2ae48e5b5fc3e849fe6eaab010939c70a8a279ed407cc847897d WatchSource:0}: Error finding container 98608bb00a0c2ae48e5b5fc3e849fe6eaab010939c70a8a279ed407cc847897d: Status 404 returned error can't find the container with id 98608bb00a0c2ae48e5b5fc3e849fe6eaab010939c70a8a279ed407cc847897d
Jul 02 20:34:18.606271 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:18.606242    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"]
Jul 02 20:34:18.608869 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:34:18.608827    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fea507e_5444_47e1_b6a8_71a34f9059bd.slice/crio-1ae11b8948577fc84e7f8f4bd877d9be540804aee2555d370cc9eb0f334740e0 WatchSource:0}: Error finding container 1ae11b8948577fc84e7f8f4bd877d9be540804aee2555d370cc9eb0f334740e0: Status 404 returned error can't find the container with id 1ae11b8948577fc84e7f8f4bd877d9be540804aee2555d370cc9eb0f334740e0
Jul 02 20:34:18.610254 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:18.610232    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6654f959fc-lnwzj"]
Jul 02 20:34:18.613364 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:34:18.613345    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf31eff_b31d_4456_b86d_b5053d0b6b9a.slice/crio-74bb492bc166f92ea19bb75c8534de9b2eb7f3609c899268a623bbe24b2828b2 WatchSource:0}: Error finding container 74bb492bc166f92ea19bb75c8534de9b2eb7f3609c899268a623bbe24b2828b2: Status 404 returned error can't find the container with id 74bb492bc166f92ea19bb75c8534de9b2eb7f3609c899268a623bbe24b2828b2
Jul 02 20:34:18.932382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:18.932296    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8vsgm" event={"ID":"1155da9c-315a-4420-9b3c-e50a246c4013","Type":"ContainerStarted","Data":"510a3900071c74ee3b68cbcca9a132e9e1bf86909da86d31d03a400953910a28"}
Jul 02 20:34:18.933722 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:18.933691    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6654f959fc-lnwzj" event={"ID":"6cf31eff-b31d-4456-b86d-b5053d0b6b9a","Type":"ContainerStarted","Data":"eea225c68813e51305cc35e2b701799d55e375b01498a3857c8c8fd91aa7d8f0"}
Jul 02 20:34:18.933854 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:18.933742    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6654f959fc-lnwzj" event={"ID":"6cf31eff-b31d-4456-b86d-b5053d0b6b9a","Type":"ContainerStarted","Data":"74bb492bc166f92ea19bb75c8534de9b2eb7f3609c899268a623bbe24b2828b2"}
Jul 02 20:34:18.933854 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:18.933810    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:18.934802 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:18.934780    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj" event={"ID":"3fea507e-5444-47e1-b6a8-71a34f9059bd","Type":"ContainerStarted","Data":"1ae11b8948577fc84e7f8f4bd877d9be540804aee2555d370cc9eb0f334740e0"}
Jul 02 20:34:18.935849 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:18.935824    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh" event={"ID":"3b4a913a-03c7-4650-b172-53ecbd258d6a","Type":"ContainerStarted","Data":"98608bb00a0c2ae48e5b5fc3e849fe6eaab010939c70a8a279ed407cc847897d"}
Jul 02 20:34:18.954261 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:18.954218    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6654f959fc-lnwzj" podStartSLOduration=1.954205344 podStartE2EDuration="1.954205344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:18.952503405 +0000 UTC m=+82.075672459" watchObservedRunningTime="2026-07-02 20:34:18.954205344 +0000 UTC m=+82.077374354"
Jul 02 20:34:19.897672 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:19.897639    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sk5kl"
Jul 02 20:34:19.945585 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:19.945549    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8vsgm" event={"ID":"1155da9c-315a-4420-9b3c-e50a246c4013","Type":"ContainerStarted","Data":"ea2e1091d84068a2370dcad82f72aef7695ed6d0c842aec11cce6ddd0566743e"}
Jul 02 20:34:23.964630 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:23.964590    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8vsgm" event={"ID":"1155da9c-315a-4420-9b3c-e50a246c4013","Type":"ContainerStarted","Data":"d5dc82b257564483e267cca72f229767b147cc3187caa27851db6ab5291021d5"}
Jul 02 20:34:23.966190 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:23.966164    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj" event={"ID":"3fea507e-5444-47e1-b6a8-71a34f9059bd","Type":"ContainerStarted","Data":"62bfb4576d4e6913738ca713d422e123c8e0fd8f1710e2af98044316b4592ecd"}
Jul 02 20:34:23.966333 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:23.966315    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"
Jul 02 20:34:23.967862 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:23.967836    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh" event={"ID":"3b4a913a-03c7-4650-b172-53ecbd258d6a","Type":"ContainerStarted","Data":"58b66b2762997e196eac72d8e802490a7e02e23a22226a4de1a14583eb10ccde"}
Jul 02 20:34:23.968307 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:23.968277    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj"
Jul 02 20:34:23.984399 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:23.984358    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8vsgm" podStartSLOduration=33.207543806 podStartE2EDuration="41.984346236s" totalImagesPullingTime="8.77680243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:33:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:23.984008885 +0000 UTC m=+87.107177957" watchObservedRunningTime="2026-07-02 20:34:23.984346236 +0000 UTC m=+87.107515307"
Jul 02 20:34:24.001561 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:24.001519    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cdbb94f58-bwvwj" podStartSLOduration=2.049049164 podStartE2EDuration="7.00150827s" totalImagesPullingTime="4.952459106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:24.000707782 +0000 UTC m=+87.123876878" watchObservedRunningTime="2026-07-02 20:34:24.00150827 +0000 UTC m=+87.124677302"
Jul 02 20:34:24.016766 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:24.016723    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-646ff7bdb6-tsbnh" podStartSLOduration=1.858748264 podStartE2EDuration="7.016712155s" totalImagesPullingTime="5.157963891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:24.016520773 +0000 UTC m=+87.139689803" watchObservedRunningTime="2026-07-02 20:34:24.016712155 +0000 UTC m=+87.139881187"
Jul 02 20:34:26.658411 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.658380    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vhrpd"]
Jul 02 20:34:26.661337 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.661310    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.666230 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.666210    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 20:34:26.666449 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.666424    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2rvrc\""
Jul 02 20:34:26.667016 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.666995    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 20:34:26.667121 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.667104    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 20:34:26.667742 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.667730    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 20:34:26.783637 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.783609    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-wtmp\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.783802 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.783654    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-tls\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.783802 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.783700    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ffgl\" (UniqueName: \"kubernetes.io/projected/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-kube-api-access-6ffgl\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.783802 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.783734    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-sys\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.783970 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.783820    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-accelerators-collector-config\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.783970 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.783856    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-metrics-client-ca\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.783970 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.783896    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-root\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.783970 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.783955    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-textfile\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.784148 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.783977    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.884598 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.884565    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ffgl\" (UniqueName: \"kubernetes.io/projected/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-kube-api-access-6ffgl\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.884598 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.884598    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-sys\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.884770 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.884618    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-accelerators-collector-config\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.884770 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.884636    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-metrics-client-ca\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.884770 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.884658    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-root\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.884770 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.884704    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-sys\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.884770 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.884717    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-textfile\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.884770 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.884763    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.885037 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.884801    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-wtmp\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.885037 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.884810    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-root\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.885037 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.884833    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-tls\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.885037 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:34:26.884969    2586 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 20:34:26.885037 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.884995    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-wtmp\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.885222 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:34:26.885043    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-tls podName:6b9a8ddd-ce0e-4980-ae34-8e6958f54df9 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:27.385022863 +0000 UTC m=+90.508191880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-tls") pod "node-exporter-vhrpd" (UID: "6b9a8ddd-ce0e-4980-ae34-8e6958f54df9") : secret "node-exporter-tls" not found
Jul 02 20:34:26.885222 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.885066    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-textfile\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.885292 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.885235    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-accelerators-collector-config\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.885364 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.885344    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-metrics-client-ca\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.887030 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.887013    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:26.893322 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:26.893303    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ffgl\" (UniqueName: \"kubernetes.io/projected/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-kube-api-access-6ffgl\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:27.389143 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:27.389105    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-tls\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:27.391523 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:27.391499    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b9a8ddd-ce0e-4980-ae34-8e6958f54df9-node-exporter-tls\") pod \"node-exporter-vhrpd\" (UID: \"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9\") " pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:27.569952 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:27.569911    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vhrpd"
Jul 02 20:34:27.579975 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:34:27.579956    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9a8ddd_ce0e_4980_ae34_8e6958f54df9.slice/crio-b98c9b8c71ced0ebd81efca804b5b3dbe0938a81e2f2915481c13e0c8b04d3a1 WatchSource:0}: Error finding container b98c9b8c71ced0ebd81efca804b5b3dbe0938a81e2f2915481c13e0c8b04d3a1: Status 404 returned error can't find the container with id b98c9b8c71ced0ebd81efca804b5b3dbe0938a81e2f2915481c13e0c8b04d3a1
Jul 02 20:34:27.984137 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:27.984098    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhrpd" event={"ID":"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9","Type":"ContainerStarted","Data":"b98c9b8c71ced0ebd81efca804b5b3dbe0938a81e2f2915481c13e0c8b04d3a1"}
Jul 02 20:34:28.989961 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:28.989860    2586 generic.go:356] "Generic (PLEG): container finished" podID="6b9a8ddd-ce0e-4980-ae34-8e6958f54df9" containerID="d94082415a165dd7c6139874a03a090b7f97091888961c48921982e3e1751365" exitCode=0
Jul 02 20:34:28.990394 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:28.989959    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhrpd" event={"ID":"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9","Type":"ContainerDied","Data":"d94082415a165dd7c6139874a03a090b7f97091888961c48921982e3e1751365"}
Jul 02 20:34:29.665631 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.665596    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"]
Jul 02 20:34:29.667999 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.667981    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.670937 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.670915    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 02 20:34:29.670937 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.670922    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 02 20:34:29.670937 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.670955    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 02 20:34:29.671191 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.670922    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 02 20:34:29.671191 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.670958    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 02 20:34:29.671191 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.670922    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-64fmiq237alm5\""
Jul 02 20:34:29.671324 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.671309    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5b8ts\""
Jul 02 20:34:29.681060 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.681040    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"]
Jul 02 20:34:29.807205 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.807171    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrl6d\" (UniqueName: \"kubernetes.io/projected/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-kube-api-access-zrl6d\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.807205 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.807207    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.807405 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.807238    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.807405 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.807319    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.807405 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.807361    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-tls\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.807514 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.807433    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.807514 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.807462    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-metrics-client-ca\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.807514 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.807501    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-grpc-tls\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.908260 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.908228    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-tls\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.908412 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.908266    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.908412 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.908285    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-metrics-client-ca\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.908412 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.908307    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-grpc-tls\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.908523 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.908477    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrl6d\" (UniqueName: \"kubernetes.io/projected/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-kube-api-access-zrl6d\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.908569 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.908523    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.908606 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.908575    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.908645 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.908609    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.909158 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.909133    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-metrics-client-ca\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.911381 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.911351    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-tls\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.911476 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.911411    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-grpc-tls\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.911513 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.911496    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.911555 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.911516    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.911555 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.911495    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.911783 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.911768    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.916848 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.916805    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrl6d\" (UniqueName: \"kubernetes.io/projected/ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb-kube-api-access-zrl6d\") pod \"thanos-querier-79cfb5dd6f-jhbgs\" (UID: \"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb\") " pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.977904 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.977866    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:29.996919 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.996893    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhrpd" event={"ID":"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9","Type":"ContainerStarted","Data":"284bc39e65aee453e83f1119a2d9e3e87eb8dbcd362f6a5009863b8983003b68"}
Jul 02 20:34:29.997200 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:29.996966    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhrpd" event={"ID":"6b9a8ddd-ce0e-4980-ae34-8e6958f54df9","Type":"ContainerStarted","Data":"96ec0cd3aef1fd15a6e5d936c644577ea2e5ef258b85bec544a3e0ab8ffc3f9f"}
Jul 02 20:34:30.015517 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:30.015420    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vhrpd" podStartSLOduration=2.907249351 podStartE2EDuration="4.015402195s" totalImagesPullingTime="1.043412125s" totalInitContainerRuntime="64.740719ms" isStatefulPod=true podCreationTimestamp="2026-07-02 20:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:30.014177045 +0000 UTC m=+93.137346099" watchObservedRunningTime="2026-07-02 20:34:30.015402195 +0000 UTC m=+93.138571230"
Jul 02 20:34:30.103098 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:30.103070    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"]
Jul 02 20:34:31.002771 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:31.002736    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs" event={"ID":"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb","Type":"ContainerStarted","Data":"fb6d56af228899dbc1bd1fbf4ee8dbc52c7892659a6989a1720efe01c39e2034"}
Jul 02 20:34:31.410041 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:31.410007    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc"]
Jul 02 20:34:31.412095 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:31.412079    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc"
Jul 02 20:34:31.415154 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:31.415134    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-47b57\""
Jul 02 20:34:31.415298 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:31.415282    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 02 20:34:31.427188 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:31.427165    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc"]
Jul 02 20:34:31.520731 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:31.520700    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqmqk\" (UniqueName: \"kubernetes.io/projected/3a90942a-da08-4b75-8182-ec30f563224c-kube-api-access-hqmqk\") pod \"monitoring-plugin-d5dcff7cf-qqwxc\" (UID: \"3a90942a-da08-4b75-8182-ec30f563224c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc"
Jul 02 20:34:31.520942 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:31.520792    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a90942a-da08-4b75-8182-ec30f563224c-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-qqwxc\" (UID: \"3a90942a-da08-4b75-8182-ec30f563224c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc"
Jul 02 20:34:31.621571 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:31.621536    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqmqk\" (UniqueName: \"kubernetes.io/projected/3a90942a-da08-4b75-8182-ec30f563224c-kube-api-access-hqmqk\") pod \"monitoring-plugin-d5dcff7cf-qqwxc\" (UID: \"3a90942a-da08-4b75-8182-ec30f563224c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc"
Jul 02 20:34:31.621755 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:31.621621    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a90942a-da08-4b75-8182-ec30f563224c-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-qqwxc\" (UID: \"3a90942a-da08-4b75-8182-ec30f563224c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc"
Jul 02 20:34:31.621814 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:34:31.621755    2586 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 02 20:34:31.621855 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:34:31.621824    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a90942a-da08-4b75-8182-ec30f563224c-monitoring-plugin-cert podName:3a90942a-da08-4b75-8182-ec30f563224c nodeName:}" failed. No retries permitted until 2026-07-02 20:34:32.121807288 +0000 UTC m=+95.244976303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/3a90942a-da08-4b75-8182-ec30f563224c-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-qqwxc" (UID: "3a90942a-da08-4b75-8182-ec30f563224c") : secret "monitoring-plugin-cert" not found
Jul 02 20:34:31.630761 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:31.630732    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqmqk\" (UniqueName: \"kubernetes.io/projected/3a90942a-da08-4b75-8182-ec30f563224c-kube-api-access-hqmqk\") pod \"monitoring-plugin-d5dcff7cf-qqwxc\" (UID: \"3a90942a-da08-4b75-8182-ec30f563224c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc"
Jul 02 20:34:32.126814 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.126778    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a90942a-da08-4b75-8182-ec30f563224c-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-qqwxc\" (UID: \"3a90942a-da08-4b75-8182-ec30f563224c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc"
Jul 02 20:34:32.129435 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.129400    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a90942a-da08-4b75-8182-ec30f563224c-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-qqwxc\" (UID: \"3a90942a-da08-4b75-8182-ec30f563224c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc"
Jul 02 20:34:32.320588 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.320550    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc"
Jul 02 20:34:32.464176 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.464090    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc"]
Jul 02 20:34:32.466786 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:34:32.466757    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a90942a_da08_4b75_8182_ec30f563224c.slice/crio-cabe4466f07f13e1c913c953e7b5fdd70486c20acc4613397c7f3899c68a580b WatchSource:0}: Error finding container cabe4466f07f13e1c913c953e7b5fdd70486c20acc4613397c7f3899c68a580b: Status 404 returned error can't find the container with id cabe4466f07f13e1c913c953e7b5fdd70486c20acc4613397c7f3899c68a580b
Jul 02 20:34:32.813126 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.813091    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 20:34:32.816305 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.816287    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.821775 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.819942    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 20:34:32.821775 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.820403    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-q4gj6\""
Jul 02 20:34:32.821775 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.820789    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 20:34:32.822160 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.822120    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 20:34:32.822522 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.822497    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 20:34:32.822610 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.822580    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 20:34:32.822610 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.822505    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 20:34:32.822610 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.822601    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 20:34:32.822765 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.822609    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 20:34:32.822765 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.822691    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 20:34:32.823035 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.823019    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 20:34:32.823144 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.823030    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 20:34:32.823202 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.823170    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 20:34:32.823248 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.823060    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 20:34:32.823315 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.823064    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-77prbhup6tt86\""
Jul 02 20:34:32.823431 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.823060    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 20:34:32.824561 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.824545    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 20:34:32.832935 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.832915    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 20:34:32.933967 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.933934    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2013d773-b962-43ac-ad0a-2c379640c5fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.933967 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.933967    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934215 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.933985    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934215 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934012    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934215 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934114    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctsnp\" (UniqueName: \"kubernetes.io/projected/2013d773-b962-43ac-ad0a-2c379640c5fa-kube-api-access-ctsnp\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934215 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934154    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2013d773-b962-43ac-ad0a-2c379640c5fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934215 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934182    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934215 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934213    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934248    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934277    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-config\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934293    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934307    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934324    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934346    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934364    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934400    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934436 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934424    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934717 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934446    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934717 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934478    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:32.934717 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:32.934497    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.010894 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.010855    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc" event={"ID":"3a90942a-da08-4b75-8182-ec30f563224c","Type":"ContainerStarted","Data":"cabe4466f07f13e1c913c953e7b5fdd70486c20acc4613397c7f3899c68a580b"}
Jul 02 20:34:33.014933 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.014901    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs" event={"ID":"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb","Type":"ContainerStarted","Data":"bdbe55c25c7a295c2183758fdfada71af239c4bed0aeac1c7f8cebb95bdfef79"}
Jul 02 20:34:33.015048 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.014984    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs" event={"ID":"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb","Type":"ContainerStarted","Data":"bd6342e522ecb7b83407dc91478b92b7236a8fe5b46a8eae2929ff5020362838"}
Jul 02 20:34:33.015048 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.015022    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs" event={"ID":"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb","Type":"ContainerStarted","Data":"2fa3f921c1807753c2e90aa6f3168d9ddb234e6ca887fa633d9077ca45c33414"}
Jul 02 20:34:33.035605 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.035575    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2013d773-b962-43ac-ad0a-2c379640c5fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.035605 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.035606    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.035777 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.035632    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.035777 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.035667    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.035777 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.035700    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-config\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.035777 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.035723    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.035777 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.035746    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.035777 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.035774    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.036088 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.035811    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.036088 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.035842    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.036088 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.035875    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.036088 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.035922    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.036088 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.035948    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.036088 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.035991    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.036088 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.036031    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.036088 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.036068    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2013d773-b962-43ac-ad0a-2c379640c5fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.036088 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.036092    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.036517 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.036123    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.036517 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.036155    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.036517 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.036224    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctsnp\" (UniqueName: \"kubernetes.io/projected/2013d773-b962-43ac-ad0a-2c379640c5fa-kube-api-access-ctsnp\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.036517 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.036381    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.039283 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.037552    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.039283 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.037570    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.039283 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.037919    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.039283 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.038243    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.039283 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.038391    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.039283 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.039243    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.039634 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.039341    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2013d773-b962-43ac-ad0a-2c379640c5fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.039937 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.039914    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.040120 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.040087    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.040669 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.040595    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-config\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.041538 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.041518    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2013d773-b962-43ac-ad0a-2c379640c5fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.041790 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.041760    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.042226 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.042185    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.042226 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.042209    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.042226 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.042216    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.042633 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.042611    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.042740 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.042723    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.042863 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.042839    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.044770 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.044749    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctsnp\" (UniqueName: \"kubernetes.io/projected/2013d773-b962-43ac-ad0a-2c379640c5fa-kube-api-access-ctsnp\") pod \"prometheus-k8s-0\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.130087 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.129961    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:33.300385 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:33.300259    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 20:34:33.304527 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:34:33.304498    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2013d773_b962_43ac_ad0a_2c379640c5fa.slice/crio-30b13d3ff1874d048ec40cae48a90c0d077dc06ae561f47ab0fe31b01c06a035 WatchSource:0}: Error finding container 30b13d3ff1874d048ec40cae48a90c0d077dc06ae561f47ab0fe31b01c06a035: Status 404 returned error can't find the container with id 30b13d3ff1874d048ec40cae48a90c0d077dc06ae561f47ab0fe31b01c06a035
Jul 02 20:34:34.024762 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:34.024722    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs" event={"ID":"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb","Type":"ContainerStarted","Data":"f80ab1f566e73833ed2428fcbbb4e1c752e2d1e7a0210e8ed221fa8eafe9df09"}
Jul 02 20:34:34.024928 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:34.024795    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs" event={"ID":"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb","Type":"ContainerStarted","Data":"ca3a199b81d87df2e676938273a17b2e945edbf472eba77d5a674614178b8ba1"}
Jul 02 20:34:34.025810 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:34.025789    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerStarted","Data":"30b13d3ff1874d048ec40cae48a90c0d077dc06ae561f47ab0fe31b01c06a035"}
Jul 02 20:34:34.027579 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:34.027555    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc" event={"ID":"3a90942a-da08-4b75-8182-ec30f563224c","Type":"ContainerStarted","Data":"8c8706f4a1a26b49b012a48166b6c78907bfe5129e086abe90c6d7e7b2770fd1"}
Jul 02 20:34:34.027773 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:34.027755    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc"
Jul 02 20:34:34.032832 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:34.032812    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc"
Jul 02 20:34:34.044167 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:34.044125    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qqwxc" podStartSLOduration=1.655182489 podStartE2EDuration="3.044110064s" totalImagesPullingTime="1.388927575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:34.04348777 +0000 UTC m=+97.166656827" watchObservedRunningTime="2026-07-02 20:34:34.044110064 +0000 UTC m=+97.167279097"
Jul 02 20:34:35.033986 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:35.033950    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs" event={"ID":"ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb","Type":"ContainerStarted","Data":"41938fb543929d1195637c0bb48c664fffbed596699c6ebc3a2151a7394c5fa1"}
Jul 02 20:34:35.034458 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:35.034100    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:35.035444 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:35.035423    2586 generic.go:356] "Generic (PLEG): container finished" podID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerID="a178f5e68d204a3dcdc9b75fccb5a2b73f91b909c671ed3f1ee55df3365dcdcf" exitCode=0
Jul 02 20:34:35.035525 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:35.035501    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerDied","Data":"a178f5e68d204a3dcdc9b75fccb5a2b73f91b909c671ed3f1ee55df3365dcdcf"}
Jul 02 20:34:35.061741 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:35.061698    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs" podStartSLOduration=2.511477276 podStartE2EDuration="6.061684737s" totalImagesPullingTime="3.550207461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:35.060611106 +0000 UTC m=+98.183780151" watchObservedRunningTime="2026-07-02 20:34:35.061684737 +0000 UTC m=+98.184853770"
Jul 02 20:34:38.886260 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:38.886237    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qz9mm"
Jul 02 20:34:39.060051 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:39.060010    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerStarted","Data":"b1fdaf305046846c35d70fa631adde3ce6cfab78710d8d66741de1564d5ba92f"}
Jul 02 20:34:39.950040 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:39.950014    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6654f959fc-lnwzj"
Jul 02 20:34:40.068209 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:40.068175    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerStarted","Data":"62e87c1c1b2b042144d900cf26bd388eac1157856ed357a462991b24d8e6baab"}
Jul 02 20:34:40.068378 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:40.068238    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerStarted","Data":"0019d61549d9f35725de0aeeda451486f3ee7a4bbc143989d4ef888725e09ced"}
Jul 02 20:34:40.068378 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:40.068271    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerStarted","Data":"6202dc5103f95cc8117532b10c76ba18a62fdcf3b2484ab12b0b0b79d3a20929"}
Jul 02 20:34:40.068378 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:40.068296    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerStarted","Data":"6cac841434ce4008d94bdb8201f65b7d4692fdfb2ac1dd8698a8987985b24a2d"}
Jul 02 20:34:40.068378 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:40.068319    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerStarted","Data":"e62190733e53b2a4f7872d07375d08fbb7c22346c31ae738d927b7dff3fd601a"}
Jul 02 20:34:40.107470 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:40.106582    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9409588920000003 podStartE2EDuration="8.106561302s" totalImagesPullingTime="5.146908057s" totalInitContainerRuntime="18.694353ms" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:40.103344794 +0000 UTC m=+103.226513826" watchObservedRunningTime="2026-07-02 20:34:40.106561302 +0000 UTC m=+103.229730337"
Jul 02 20:34:41.047123 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:41.047096    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-79cfb5dd6f-jhbgs"
Jul 02 20:34:43.130223 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:43.130194    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:34:58.133775 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:58.133749    2586 generic.go:356] "Generic (PLEG): container finished" podID="0fdb2a89-4021-4e09-a096-a519e46d1d38" containerID="b972378e4b3983bd8da5429a684fae68af2f2dd723117ef59929242e99a73280" exitCode=0
Jul 02 20:34:58.134248 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:58.133801    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9" event={"ID":"0fdb2a89-4021-4e09-a096-a519e46d1d38","Type":"ContainerDied","Data":"b972378e4b3983bd8da5429a684fae68af2f2dd723117ef59929242e99a73280"}
Jul 02 20:34:58.134248 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:58.134098    2586 scope.go:117] "RemoveContainer" containerID="b972378e4b3983bd8da5429a684fae68af2f2dd723117ef59929242e99a73280"
Jul 02 20:34:59.139396 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:34:59.139366    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-248n9" event={"ID":"0fdb2a89-4021-4e09-a096-a519e46d1d38","Type":"ContainerStarted","Data":"fa93b63d1abd3f9148d980352af482d22dafec865b3d01a832a113a0c69d88db"}
Jul 02 20:35:06.214391 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:06.214356    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs\") pod \"network-metrics-daemon-5hjrx\" (UID: \"c6df2599-96ba-4a56-a663-dc78b5094ed0\") " pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:35:06.216587 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:06.216565    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6df2599-96ba-4a56-a663-dc78b5094ed0-metrics-certs\") pod \"network-metrics-daemon-5hjrx\" (UID: \"c6df2599-96ba-4a56-a663-dc78b5094ed0\") " pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:35:06.503899 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:06.503809    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xbw6r\""
Jul 02 20:35:06.511732 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:06.511715    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hjrx"
Jul 02 20:35:06.636550 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:06.636523    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5hjrx"]
Jul 02 20:35:06.639585 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:35:06.639553    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6df2599_96ba_4a56_a663_dc78b5094ed0.slice/crio-28bef5366073f0e9b1420f1f36b5e600bce9119ec096a686d5b2f232d26b8446 WatchSource:0}: Error finding container 28bef5366073f0e9b1420f1f36b5e600bce9119ec096a686d5b2f232d26b8446: Status 404 returned error can't find the container with id 28bef5366073f0e9b1420f1f36b5e600bce9119ec096a686d5b2f232d26b8446
Jul 02 20:35:07.169936 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:07.169901    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5hjrx" event={"ID":"c6df2599-96ba-4a56-a663-dc78b5094ed0","Type":"ContainerStarted","Data":"28bef5366073f0e9b1420f1f36b5e600bce9119ec096a686d5b2f232d26b8446"}
Jul 02 20:35:08.175329 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:08.175253    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5hjrx" event={"ID":"c6df2599-96ba-4a56-a663-dc78b5094ed0","Type":"ContainerStarted","Data":"8f3af698f6c2b113b6917f1dedc275128f61b9273bfa84ee0161f2fbba22e27f"}
Jul 02 20:35:08.175329 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:08.175308    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5hjrx" event={"ID":"c6df2599-96ba-4a56-a663-dc78b5094ed0","Type":"ContainerStarted","Data":"85ba17a8e8370cb2b9d5cfc0f60a4a3ac08478f3b6cc5a44025b3f34219b1a52"}
Jul 02 20:35:08.194831 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:08.194784    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5hjrx" podStartSLOduration=128.983512269 podStartE2EDuration="2m10.194771018s" totalImagesPullingTime="1.211258749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:35:08.193705837 +0000 UTC m=+131.316874866" watchObservedRunningTime="2026-07-02 20:35:08.194771018 +0000 UTC m=+131.317940050"
Jul 02 20:35:33.130615 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:33.130583    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:33.149294 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:33.149263    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:33.280595 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:33.280568    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:51.174029 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.173955    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 20:35:51.174503 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.174306    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="prometheus" containerID="cri-o://b1fdaf305046846c35d70fa631adde3ce6cfab78710d8d66741de1564d5ba92f" gracePeriod=600
Jul 02 20:35:51.174503 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.174358    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="kube-rbac-proxy" containerID="cri-o://0019d61549d9f35725de0aeeda451486f3ee7a4bbc143989d4ef888725e09ced" gracePeriod=600
Jul 02 20:35:51.174503 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.174413    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="kube-rbac-proxy-thanos" containerID="cri-o://62e87c1c1b2b042144d900cf26bd388eac1157856ed357a462991b24d8e6baab" gracePeriod=600
Jul 02 20:35:51.174503 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.174424    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="config-reloader" containerID="cri-o://e62190733e53b2a4f7872d07375d08fbb7c22346c31ae738d927b7dff3fd601a" gracePeriod=600
Jul 02 20:35:51.174503 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.174367    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="thanos-sidecar" containerID="cri-o://6cac841434ce4008d94bdb8201f65b7d4692fdfb2ac1dd8698a8987985b24a2d" gracePeriod=600
Jul 02 20:35:51.174503 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.174372    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="kube-rbac-proxy-web" containerID="cri-o://6202dc5103f95cc8117532b10c76ba18a62fdcf3b2484ab12b0b0b79d3a20929" gracePeriod=600
Jul 02 20:35:51.341371 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.341336    2586 generic.go:356] "Generic (PLEG): container finished" podID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerID="62e87c1c1b2b042144d900cf26bd388eac1157856ed357a462991b24d8e6baab" exitCode=0
Jul 02 20:35:51.341371 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.341370    2586 generic.go:356] "Generic (PLEG): container finished" podID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerID="0019d61549d9f35725de0aeeda451486f3ee7a4bbc143989d4ef888725e09ced" exitCode=0
Jul 02 20:35:51.341574 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.341381    2586 generic.go:356] "Generic (PLEG): container finished" podID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerID="6202dc5103f95cc8117532b10c76ba18a62fdcf3b2484ab12b0b0b79d3a20929" exitCode=0
Jul 02 20:35:51.341574 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.341390    2586 generic.go:356] "Generic (PLEG): container finished" podID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerID="6cac841434ce4008d94bdb8201f65b7d4692fdfb2ac1dd8698a8987985b24a2d" exitCode=0
Jul 02 20:35:51.341574 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.341397    2586 generic.go:356] "Generic (PLEG): container finished" podID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerID="e62190733e53b2a4f7872d07375d08fbb7c22346c31ae738d927b7dff3fd601a" exitCode=0
Jul 02 20:35:51.341574 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.341405    2586 generic.go:356] "Generic (PLEG): container finished" podID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerID="b1fdaf305046846c35d70fa631adde3ce6cfab78710d8d66741de1564d5ba92f" exitCode=0
Jul 02 20:35:51.341574 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.341398    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerDied","Data":"62e87c1c1b2b042144d900cf26bd388eac1157856ed357a462991b24d8e6baab"}
Jul 02 20:35:51.341574 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.341552    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerDied","Data":"0019d61549d9f35725de0aeeda451486f3ee7a4bbc143989d4ef888725e09ced"}
Jul 02 20:35:51.342002 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.341582    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerDied","Data":"6202dc5103f95cc8117532b10c76ba18a62fdcf3b2484ab12b0b0b79d3a20929"}
Jul 02 20:35:51.342002 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.341609    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerDied","Data":"6cac841434ce4008d94bdb8201f65b7d4692fdfb2ac1dd8698a8987985b24a2d"}
Jul 02 20:35:51.342002 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.341635    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerDied","Data":"e62190733e53b2a4f7872d07375d08fbb7c22346c31ae738d927b7dff3fd601a"}
Jul 02 20:35:51.342002 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.341658    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerDied","Data":"b1fdaf305046846c35d70fa631adde3ce6cfab78710d8d66741de1564d5ba92f"}
Jul 02 20:35:51.417516 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.417495    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:51.444115 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444062    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-metrics-client-certs\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444200 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444159    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctsnp\" (UniqueName: \"kubernetes.io/projected/2013d773-b962-43ac-ad0a-2c379640c5fa-kube-api-access-ctsnp\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444200 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444192    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-metrics-client-ca\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444301 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444220    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-1\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444301 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444260    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-thanos-prometheus-http-client-file\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444301 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444289    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-grpc-tls\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444447 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444314    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-tls\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444447 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444349    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-kubelet-serving-ca-bundle\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444447 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444384    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2013d773-b962-43ac-ad0a-2c379640c5fa-config-out\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444447 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444423    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444657 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444445    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-config\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444657 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444472    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-2\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444657 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444512    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2013d773-b962-43ac-ad0a-2c379640c5fa-tls-assets\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444657 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444537    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-kube-rbac-proxy\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444657 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444560    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-web-config\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444657 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444585    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-db\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444657 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444584    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:51.444657 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444622    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.444657 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444655    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-0\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.445109 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444708    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-trusted-ca-bundle\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.445109 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.444735    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-serving-certs-ca-bundle\") pod \"2013d773-b962-43ac-ad0a-2c379640c5fa\" (UID: \"2013d773-b962-43ac-ad0a-2c379640c5fa\") "
Jul 02 20:35:51.445109 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.445001    2586 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-metrics-client-ca\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.445109 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.445083    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:51.445319 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.445203    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:51.445378 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.445341    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:51.445378 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.445349    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:51.446896 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.446859    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:51.447024 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.447007    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:35:51.447094 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.447080    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:51.447549 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.447510    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:35:51.447797 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.447773    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2013d773-b962-43ac-ad0a-2c379640c5fa-kube-api-access-ctsnp" (OuterVolumeSpecName: "kube-api-access-ctsnp") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "kube-api-access-ctsnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:35:51.448426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.448235    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:51.448426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.448329    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:51.448426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.448339    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:51.448426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.448389    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:51.448426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.448403    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2013d773-b962-43ac-ad0a-2c379640c5fa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:35:51.448646 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.448478    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:51.449256 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.449235    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-config" (OuterVolumeSpecName: "config") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:51.449562 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.449543    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2013d773-b962-43ac-ad0a-2c379640c5fa-config-out" (OuterVolumeSpecName: "config-out") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:35:51.449674 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.449659    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:51.461549 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.461510    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-web-config" (OuterVolumeSpecName: "web-config") pod "2013d773-b962-43ac-ad0a-2c379640c5fa" (UID: "2013d773-b962-43ac-ad0a-2c379640c5fa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:35:51.546142 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546122    2586 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-kube-rbac-proxy\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546226 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546147    2586 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-web-config\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546226 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546160    2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-db\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546226 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546169    2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546226 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546178    2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546226 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546187    2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546226 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546196    2586 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546226 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546205    2586 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-metrics-client-certs\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546226 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546214    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctsnp\" (UniqueName: \"kubernetes.io/projected/2013d773-b962-43ac-ad0a-2c379640c5fa-kube-api-access-ctsnp\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546226 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546226    2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546482 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546239    2586 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546482 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546247    2586 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-grpc-tls\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546482 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546256    2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546482 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546264    2586 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546482 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546273    2586 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2013d773-b962-43ac-ad0a-2c379640c5fa-config-out\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546482 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546281    2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546482 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546289    2586 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2013d773-b962-43ac-ad0a-2c379640c5fa-config\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546482 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546297    2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2013d773-b962-43ac-ad0a-2c379640c5fa-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:51.546482 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:51.546311    2586 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2013d773-b962-43ac-ad0a-2c379640c5fa-tls-assets\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:35:52.348240 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.348209    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2013d773-b962-43ac-ad0a-2c379640c5fa","Type":"ContainerDied","Data":"30b13d3ff1874d048ec40cae48a90c0d077dc06ae561f47ab0fe31b01c06a035"}
Jul 02 20:35:52.348604 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.348277    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.348604 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.348309    2586 scope.go:117] "RemoveContainer" containerID="62e87c1c1b2b042144d900cf26bd388eac1157856ed357a462991b24d8e6baab"
Jul 02 20:35:52.356208 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.356193    2586 scope.go:117] "RemoveContainer" containerID="0019d61549d9f35725de0aeeda451486f3ee7a4bbc143989d4ef888725e09ced"
Jul 02 20:35:52.364936 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.364856    2586 scope.go:117] "RemoveContainer" containerID="6202dc5103f95cc8117532b10c76ba18a62fdcf3b2484ab12b0b0b79d3a20929"
Jul 02 20:35:52.372380 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.372350    2586 scope.go:117] "RemoveContainer" containerID="6cac841434ce4008d94bdb8201f65b7d4692fdfb2ac1dd8698a8987985b24a2d"
Jul 02 20:35:52.377442 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.377420    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 20:35:52.379235 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.379216    2586 scope.go:117] "RemoveContainer" containerID="e62190733e53b2a4f7872d07375d08fbb7c22346c31ae738d927b7dff3fd601a"
Jul 02 20:35:52.382081 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.382064    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 20:35:52.386081 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.386065    2586 scope.go:117] "RemoveContainer" containerID="b1fdaf305046846c35d70fa631adde3ce6cfab78710d8d66741de1564d5ba92f"
Jul 02 20:35:52.392757 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.392741    2586 scope.go:117] "RemoveContainer" containerID="a178f5e68d204a3dcdc9b75fccb5a2b73f91b909c671ed3f1ee55df3365dcdcf"
Jul 02 20:35:52.407537 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407518    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 20:35:52.407816 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407804    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="kube-rbac-proxy"
Jul 02 20:35:52.407862 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407818    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="kube-rbac-proxy"
Jul 02 20:35:52.407862 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407826    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="kube-rbac-proxy-thanos"
Jul 02 20:35:52.407862 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407832    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="kube-rbac-proxy-thanos"
Jul 02 20:35:52.407862 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407840    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="thanos-sidecar"
Jul 02 20:35:52.407862 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407845    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="thanos-sidecar"
Jul 02 20:35:52.407862 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407858    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="prometheus"
Jul 02 20:35:52.407862 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407863    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="prometheus"
Jul 02 20:35:52.408076 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407870    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="config-reloader"
Jul 02 20:35:52.408076 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407875    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="config-reloader"
Jul 02 20:35:52.408076 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407921    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="init-config-reloader"
Jul 02 20:35:52.408076 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407926    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="init-config-reloader"
Jul 02 20:35:52.408076 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407934    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="kube-rbac-proxy-web"
Jul 02 20:35:52.408076 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407940    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="kube-rbac-proxy-web"
Jul 02 20:35:52.408076 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407989    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="prometheus"
Jul 02 20:35:52.408076 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.407996    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="kube-rbac-proxy-thanos"
Jul 02 20:35:52.408076 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.408005    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="config-reloader"
Jul 02 20:35:52.408076 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.408010    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="kube-rbac-proxy-web"
Jul 02 20:35:52.408076 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.408015    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="kube-rbac-proxy"
Jul 02 20:35:52.408076 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.408021    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" containerName="thanos-sidecar"
Jul 02 20:35:52.411271 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.411256    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.413871 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.413851    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 20:35:52.414106 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.414085    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 20:35:52.414201 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.414147    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 20:35:52.414347 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.414301    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 20:35:52.414347 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.414309    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 20:35:52.414347 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.414324    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 20:35:52.414534 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.414350    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 20:35:52.414534 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.414450    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 20:35:52.414534 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.414462    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 20:35:52.414676 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.414605    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-77prbhup6tt86\""
Jul 02 20:35:52.414676 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.414650    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 20:35:52.414940 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.414923    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-q4gj6\""
Jul 02 20:35:52.414999 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.414938    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 20:35:52.414999 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.414931    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 20:35:52.415067 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.414965    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 20:35:52.417699 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.417678    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 20:35:52.419602 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.419583    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 20:35:52.426420 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.426403    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 20:35:52.452266 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452221    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452266 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452248    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452266 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452264    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452410 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452281    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452410 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452331    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452410 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452355    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452410 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452371    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452410 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452393    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452555 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452417    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj4z2\" (UniqueName: \"kubernetes.io/projected/0e83b7ab-fd47-4af0-bf31-4647edf9a138-kube-api-access-bj4z2\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452555 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452433    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452555 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452448    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452555 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452471    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452555 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452486    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452555 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452503    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e83b7ab-fd47-4af0-bf31-4647edf9a138-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452555 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452526    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452743 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452593    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452743 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452616    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-config\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452743 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452640    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452743 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452661    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.452743 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.452698    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e83b7ab-fd47-4af0-bf31-4647edf9a138-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.553956 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.553931    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554061 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.553963    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-config\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554061 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554004    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554061 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554044    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554218 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554114    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e83b7ab-fd47-4af0-bf31-4647edf9a138-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554218 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554142    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554218 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554169    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554218 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554191    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554405 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554219    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554405 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554275    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554405 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554301    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554405 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554322    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554405 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554375    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554652 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554445    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj4z2\" (UniqueName: \"kubernetes.io/projected/0e83b7ab-fd47-4af0-bf31-4647edf9a138-kube-api-access-bj4z2\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554652 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554481    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554652 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554508    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554652 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554534    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554652 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554559    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554652 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554614    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e83b7ab-fd47-4af0-bf31-4647edf9a138-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.554652 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554652    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.555036 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.554712    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.555614 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.555547    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.556812 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.556335    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.557210 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.557184    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.557321 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.557286    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e83b7ab-fd47-4af0-bf31-4647edf9a138-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.557680 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.557660    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.558072 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.558049    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.558232 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.558196    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-config\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.558324 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.558247    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.558494 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.558456    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.558577 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.558514    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e83b7ab-fd47-4af0-bf31-4647edf9a138-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.558648 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.558614    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.558737 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.558713    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e83b7ab-fd47-4af0-bf31-4647edf9a138-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.558802 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.558719    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.560637 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.560614    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.560784 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.560762    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.560920 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.560902    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.560991 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.560971    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.561080 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.561065    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e83b7ab-fd47-4af0-bf31-4647edf9a138-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.565980 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.565961    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj4z2\" (UniqueName: \"kubernetes.io/projected/0e83b7ab-fd47-4af0-bf31-4647edf9a138-kube-api-access-bj4z2\") pod \"prometheus-k8s-0\" (UID: \"0e83b7ab-fd47-4af0-bf31-4647edf9a138\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.720532 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.720473    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:35:52.853574 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:52.853547    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 20:35:52.856393 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:35:52.856370    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e83b7ab_fd47_4af0_bf31_4647edf9a138.slice/crio-a4777520328929b298c77345bea109ce8691b699df8cb99ad9fc22d4a75f5c09 WatchSource:0}: Error finding container a4777520328929b298c77345bea109ce8691b699df8cb99ad9fc22d4a75f5c09: Status 404 returned error can't find the container with id a4777520328929b298c77345bea109ce8691b699df8cb99ad9fc22d4a75f5c09
Jul 02 20:35:53.353647 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:53.353610    2586 generic.go:356] "Generic (PLEG): container finished" podID="0e83b7ab-fd47-4af0-bf31-4647edf9a138" containerID="3a57c9719937d629ed6f746fdd84a8d0c838b3624d969c7f701a69dd36a03b62" exitCode=0
Jul 02 20:35:53.354044 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:53.353650    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e83b7ab-fd47-4af0-bf31-4647edf9a138","Type":"ContainerDied","Data":"3a57c9719937d629ed6f746fdd84a8d0c838b3624d969c7f701a69dd36a03b62"}
Jul 02 20:35:53.354044 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:53.353731    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e83b7ab-fd47-4af0-bf31-4647edf9a138","Type":"ContainerStarted","Data":"a4777520328929b298c77345bea109ce8691b699df8cb99ad9fc22d4a75f5c09"}
Jul 02 20:35:53.492970 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:53.492938    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2013d773-b962-43ac-ad0a-2c379640c5fa" path="/var/lib/kubelet/pods/2013d773-b962-43ac-ad0a-2c379640c5fa/volumes"
Jul 02 20:35:54.362371 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:54.362336    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e83b7ab-fd47-4af0-bf31-4647edf9a138","Type":"ContainerStarted","Data":"6de36f409d58ed74f25a6b202dfd152bcd2e167a0a6725fc11dbff980213e4b2"}
Jul 02 20:35:54.362774 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:54.362450    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e83b7ab-fd47-4af0-bf31-4647edf9a138","Type":"ContainerStarted","Data":"79aecebb92693c8ae931db488674aee5907f52c1d764cc48ef312d56d9f8783a"}
Jul 02 20:35:54.362774 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:54.362503    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e83b7ab-fd47-4af0-bf31-4647edf9a138","Type":"ContainerStarted","Data":"e63563b97ea51d6f381d1a083f568e9e606e198425557b5d9860b39658cc2edc"}
Jul 02 20:35:54.362774 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:54.362549    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e83b7ab-fd47-4af0-bf31-4647edf9a138","Type":"ContainerStarted","Data":"02955bbeb75f3ee2b51a98c59da348ed3d6d093af736683a2bc8177e5ab2837d"}
Jul 02 20:35:54.362774 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:54.362589    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e83b7ab-fd47-4af0-bf31-4647edf9a138","Type":"ContainerStarted","Data":"7548ad753d1360a59b6e5dd13d5ea3c0338070d4922bd292e5d08135ebd09d14"}
Jul 02 20:35:54.362774 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:54.362630    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e83b7ab-fd47-4af0-bf31-4647edf9a138","Type":"ContainerStarted","Data":"0cad43c4ab814f8432376c16250ff30497343c62a19e98b281bae491a38e2831"}
Jul 02 20:35:54.392013 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:54.391972    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.373666442 podStartE2EDuration="2.391956816s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.290374ms" isStatefulPod=false podCreationTimestamp="2026-07-02 20:35:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:35:54.38953289 +0000 UTC m=+177.512701955" watchObservedRunningTime="2026-07-02 20:35:54.391956816 +0000 UTC m=+177.515125848"
Jul 02 20:35:57.720586 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:35:57.720557    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:36:52.720682 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:36:52.720640    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:36:52.735762 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:36:52.735741    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:36:53.605871 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:36:53.605839    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 20:37:38.042899 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.042844    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"]
Jul 02 20:37:38.045596 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.045576    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.054831 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.054798    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 20:37:38.054967 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.054799    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 20:37:38.054967 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.054799    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 20:37:38.054967 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.054804    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s2djl\""
Jul 02 20:37:38.058281 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.058264    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 20:37:38.094803 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.094783    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"]
Jul 02 20:37:38.168533 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.168506    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51feb983-0719-40c6-b60e-743d9ab76e08-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.168636 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.168537    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/51feb983-0719-40c6-b60e-743d9ab76e08-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.168636 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.168574    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n226w\" (UniqueName: \"kubernetes.io/projected/51feb983-0719-40c6-b60e-743d9ab76e08-kube-api-access-n226w\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.168717 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.168648    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51feb983-0719-40c6-b60e-743d9ab76e08-tmp\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.168717 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.168691    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/51feb983-0719-40c6-b60e-743d9ab76e08-manifests\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.269096 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.269069    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51feb983-0719-40c6-b60e-743d9ab76e08-tmp\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.269186 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.269103    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/51feb983-0719-40c6-b60e-743d9ab76e08-manifests\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.269186 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.269139    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51feb983-0719-40c6-b60e-743d9ab76e08-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.269186 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.269174    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/51feb983-0719-40c6-b60e-743d9ab76e08-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.269297 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.269236    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n226w\" (UniqueName: \"kubernetes.io/projected/51feb983-0719-40c6-b60e-743d9ab76e08-kube-api-access-n226w\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.269525 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.269502    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/51feb983-0719-40c6-b60e-743d9ab76e08-manifests\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.271539 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.271516    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51feb983-0719-40c6-b60e-743d9ab76e08-tmp\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.271663 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.271644    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51feb983-0719-40c6-b60e-743d9ab76e08-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.271836 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.271816    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/51feb983-0719-40c6-b60e-743d9ab76e08-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.287310 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.287284    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n226w\" (UniqueName: \"kubernetes.io/projected/51feb983-0719-40c6-b60e-743d9ab76e08-kube-api-access-n226w\") pod \"opendatahub-operator-controller-manager-68b94c7db-7xtrf\" (UID: \"51feb983-0719-40c6-b60e-743d9ab76e08\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.355303 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.355257    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:38.495244 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.495212    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"]
Jul 02 20:37:38.503175 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:37:38.503145    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51feb983_0719_40c6_b60e_743d9ab76e08.slice/crio-0ee8e17246d48bea82ee10fb2458861213263fb98bb51ee59a8862fa9e15dd6f WatchSource:0}: Error finding container 0ee8e17246d48bea82ee10fb2458861213263fb98bb51ee59a8862fa9e15dd6f: Status 404 returned error can't find the container with id 0ee8e17246d48bea82ee10fb2458861213263fb98bb51ee59a8862fa9e15dd6f
Jul 02 20:37:38.757195 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:38.757126    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf" event={"ID":"51feb983-0719-40c6-b60e-743d9ab76e08","Type":"ContainerStarted","Data":"0ee8e17246d48bea82ee10fb2458861213263fb98bb51ee59a8862fa9e15dd6f"}
Jul 02 20:37:41.772179 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:41.772121    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf" event={"ID":"51feb983-0719-40c6-b60e-743d9ab76e08","Type":"ContainerStarted","Data":"2490a458a6ac66b91c8fd648bbbd45977feb61461ac22c0d76a10c8b9bcf3308"}
Jul 02 20:37:42.777234 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:42.777200    2586 generic.go:356] "Generic (PLEG): container finished" podID="51feb983-0719-40c6-b60e-743d9ab76e08" containerID="2490a458a6ac66b91c8fd648bbbd45977feb61461ac22c0d76a10c8b9bcf3308" exitCode=0
Jul 02 20:37:42.777616 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:42.777290    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf" event={"ID":"51feb983-0719-40c6-b60e-743d9ab76e08","Type":"ContainerDied","Data":"2490a458a6ac66b91c8fd648bbbd45977feb61461ac22c0d76a10c8b9bcf3308"}
Jul 02 20:37:43.783232 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:43.783196    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf" event={"ID":"51feb983-0719-40c6-b60e-743d9ab76e08","Type":"ContainerStarted","Data":"bf2cef8d3bf6028a3612d0108b14632a6b500c93e3496d7adc63c0716b8a70cc"}
Jul 02 20:37:43.783592 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:43.783342    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:43.822319 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:43.822263    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf" podStartSLOduration=1.18356073 podStartE2EDuration="5.82224485s" totalImagesPullingTime="3.580124217s" totalInitContainerRuntime="1.058559903s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:37:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:37:43.820272469 +0000 UTC m=+286.943441503" watchObservedRunningTime="2026-07-02 20:37:43.82224485 +0000 UTC m=+286.945413880"
Jul 02 20:37:54.789740 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:54.789712    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-7xtrf"
Jul 02 20:37:57.297197 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:57.297166    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 20:37:57.297637 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:57.297399    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 20:37:57.300278 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:57.300258    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 20:37:57.300610 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:57.300589    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 20:37:57.306699 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:37:57.306681    2586 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 20:38:08.391899 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.391853    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"]
Jul 02 20:38:08.394061 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.394045    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:08.397944 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.397912    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 20:38:08.398143 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.398128    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 20:38:08.398915 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.398897    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 20:38:08.399024 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.398929    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 20:38:08.399094 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.399034    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:38:08.399283 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.399267    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gb8qw\""
Jul 02 20:38:08.415476 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.415444    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"]
Jul 02 20:38:08.505244 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.505215    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/43ee67cb-c6d2-4ff8-86b3-878e19caad6e-manager-config\") pod \"lws-controller-manager-787649fbc-wd64n\" (UID: \"43ee67cb-c6d2-4ff8-86b3-878e19caad6e\") " pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:08.505425 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.505263    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/43ee67cb-c6d2-4ff8-86b3-878e19caad6e-metrics-cert\") pod \"lws-controller-manager-787649fbc-wd64n\" (UID: \"43ee67cb-c6d2-4ff8-86b3-878e19caad6e\") " pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:08.505425 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.505284    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5mw7\" (UniqueName: \"kubernetes.io/projected/43ee67cb-c6d2-4ff8-86b3-878e19caad6e-kube-api-access-f5mw7\") pod \"lws-controller-manager-787649fbc-wd64n\" (UID: \"43ee67cb-c6d2-4ff8-86b3-878e19caad6e\") " pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:08.505425 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.505323    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43ee67cb-c6d2-4ff8-86b3-878e19caad6e-cert\") pod \"lws-controller-manager-787649fbc-wd64n\" (UID: \"43ee67cb-c6d2-4ff8-86b3-878e19caad6e\") " pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:08.606009 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.605981    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/43ee67cb-c6d2-4ff8-86b3-878e19caad6e-manager-config\") pod \"lws-controller-manager-787649fbc-wd64n\" (UID: \"43ee67cb-c6d2-4ff8-86b3-878e19caad6e\") " pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:08.606110 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.606021    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/43ee67cb-c6d2-4ff8-86b3-878e19caad6e-metrics-cert\") pod \"lws-controller-manager-787649fbc-wd64n\" (UID: \"43ee67cb-c6d2-4ff8-86b3-878e19caad6e\") " pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:08.606163 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.606145    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5mw7\" (UniqueName: \"kubernetes.io/projected/43ee67cb-c6d2-4ff8-86b3-878e19caad6e-kube-api-access-f5mw7\") pod \"lws-controller-manager-787649fbc-wd64n\" (UID: \"43ee67cb-c6d2-4ff8-86b3-878e19caad6e\") " pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:08.606209 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.606179    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43ee67cb-c6d2-4ff8-86b3-878e19caad6e-cert\") pod \"lws-controller-manager-787649fbc-wd64n\" (UID: \"43ee67cb-c6d2-4ff8-86b3-878e19caad6e\") " pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:08.606691 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.606671    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/43ee67cb-c6d2-4ff8-86b3-878e19caad6e-manager-config\") pod \"lws-controller-manager-787649fbc-wd64n\" (UID: \"43ee67cb-c6d2-4ff8-86b3-878e19caad6e\") " pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:08.608333 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.608312    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/43ee67cb-c6d2-4ff8-86b3-878e19caad6e-metrics-cert\") pod \"lws-controller-manager-787649fbc-wd64n\" (UID: \"43ee67cb-c6d2-4ff8-86b3-878e19caad6e\") " pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:08.608537 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.608519    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43ee67cb-c6d2-4ff8-86b3-878e19caad6e-cert\") pod \"lws-controller-manager-787649fbc-wd64n\" (UID: \"43ee67cb-c6d2-4ff8-86b3-878e19caad6e\") " pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:08.616315 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.616295    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5mw7\" (UniqueName: \"kubernetes.io/projected/43ee67cb-c6d2-4ff8-86b3-878e19caad6e-kube-api-access-f5mw7\") pod \"lws-controller-manager-787649fbc-wd64n\" (UID: \"43ee67cb-c6d2-4ff8-86b3-878e19caad6e\") " pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:08.703147 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.703104    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:08.846483 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.846453    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"]
Jul 02 20:38:08.849215 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:38:08.849188    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43ee67cb_c6d2_4ff8_86b3_878e19caad6e.slice/crio-55312eff383cc1cc7ea28deca7f8dfdb72e4fde0340c9351e21af101502f9767 WatchSource:0}: Error finding container 55312eff383cc1cc7ea28deca7f8dfdb72e4fde0340c9351e21af101502f9767: Status 404 returned error can't find the container with id 55312eff383cc1cc7ea28deca7f8dfdb72e4fde0340c9351e21af101502f9767
Jul 02 20:38:08.851027 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.851006    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:38:08.884633 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:08.884605    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n" event={"ID":"43ee67cb-c6d2-4ff8-86b3-878e19caad6e","Type":"ContainerStarted","Data":"55312eff383cc1cc7ea28deca7f8dfdb72e4fde0340c9351e21af101502f9767"}
Jul 02 20:38:11.272626 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.272594    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-22pv8"]
Jul 02 20:38:11.275126 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.275104    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-22pv8"
Jul 02 20:38:11.279216 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.279181    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 02 20:38:11.279967 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.279845    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vlwqd\""
Jul 02 20:38:11.308218 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.308196    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-22pv8"]
Jul 02 20:38:11.324729 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.324694    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnrdr\" (UniqueName: \"kubernetes.io/projected/4be2f398-248d-420e-9892-eddf4f21de0b-kube-api-access-rnrdr\") pod \"kserve-controller-manager-d6f4b65b8-22pv8\" (UID: \"4be2f398-248d-420e-9892-eddf4f21de0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-22pv8"
Jul 02 20:38:11.324729 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.324739    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4be2f398-248d-420e-9892-eddf4f21de0b-cert\") pod \"kserve-controller-manager-d6f4b65b8-22pv8\" (UID: \"4be2f398-248d-420e-9892-eddf4f21de0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-22pv8"
Jul 02 20:38:11.352117 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.352093    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt"]
Jul 02 20:38:11.355824 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.355803    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt"
Jul 02 20:38:11.361396 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.361373    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-j9fpb\""
Jul 02 20:38:11.361554 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.361434    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 02 20:38:11.415288 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.415251    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt"]
Jul 02 20:38:11.426022 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.425996    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wtbr\" (UniqueName: \"kubernetes.io/projected/463a6385-9165-43cc-ab3a-144e9ccc67ed-kube-api-access-4wtbr\") pod \"llmisvc-controller-manager-777c6bd7d5-wbwnt\" (UID: \"463a6385-9165-43cc-ab3a-144e9ccc67ed\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt"
Jul 02 20:38:11.426131 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.426037    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4be2f398-248d-420e-9892-eddf4f21de0b-cert\") pod \"kserve-controller-manager-d6f4b65b8-22pv8\" (UID: \"4be2f398-248d-420e-9892-eddf4f21de0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-22pv8"
Jul 02 20:38:11.426197 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.426142    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/463a6385-9165-43cc-ab3a-144e9ccc67ed-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wbwnt\" (UID: \"463a6385-9165-43cc-ab3a-144e9ccc67ed\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt"
Jul 02 20:38:11.426197 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.426165    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnrdr\" (UniqueName: \"kubernetes.io/projected/4be2f398-248d-420e-9892-eddf4f21de0b-kube-api-access-rnrdr\") pod \"kserve-controller-manager-d6f4b65b8-22pv8\" (UID: \"4be2f398-248d-420e-9892-eddf4f21de0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-22pv8"
Jul 02 20:38:11.428589 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.428567    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4be2f398-248d-420e-9892-eddf4f21de0b-cert\") pod \"kserve-controller-manager-d6f4b65b8-22pv8\" (UID: \"4be2f398-248d-420e-9892-eddf4f21de0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-22pv8"
Jul 02 20:38:11.459366 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.459341    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnrdr\" (UniqueName: \"kubernetes.io/projected/4be2f398-248d-420e-9892-eddf4f21de0b-kube-api-access-rnrdr\") pod \"kserve-controller-manager-d6f4b65b8-22pv8\" (UID: \"4be2f398-248d-420e-9892-eddf4f21de0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-22pv8"
Jul 02 20:38:11.526609 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.526526    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/463a6385-9165-43cc-ab3a-144e9ccc67ed-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wbwnt\" (UID: \"463a6385-9165-43cc-ab3a-144e9ccc67ed\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt"
Jul 02 20:38:11.526726 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:38:11.526679    2586 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 02 20:38:11.526726 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.526713    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wtbr\" (UniqueName: \"kubernetes.io/projected/463a6385-9165-43cc-ab3a-144e9ccc67ed-kube-api-access-4wtbr\") pod \"llmisvc-controller-manager-777c6bd7d5-wbwnt\" (UID: \"463a6385-9165-43cc-ab3a-144e9ccc67ed\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt"
Jul 02 20:38:11.526848 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:38:11.526754    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/463a6385-9165-43cc-ab3a-144e9ccc67ed-cert podName:463a6385-9165-43cc-ab3a-144e9ccc67ed nodeName:}" failed. No retries permitted until 2026-07-02 20:38:12.026733451 +0000 UTC m=+315.149902465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/463a6385-9165-43cc-ab3a-144e9ccc67ed-cert") pod "llmisvc-controller-manager-777c6bd7d5-wbwnt" (UID: "463a6385-9165-43cc-ab3a-144e9ccc67ed") : secret "llmisvc-webhook-server-cert" not found
Jul 02 20:38:11.555443 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.555412    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wtbr\" (UniqueName: \"kubernetes.io/projected/463a6385-9165-43cc-ab3a-144e9ccc67ed-kube-api-access-4wtbr\") pod \"llmisvc-controller-manager-777c6bd7d5-wbwnt\" (UID: \"463a6385-9165-43cc-ab3a-144e9ccc67ed\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt"
Jul 02 20:38:11.593155 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:11.593132    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-22pv8"
Jul 02 20:38:12.030662 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:12.030629    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/463a6385-9165-43cc-ab3a-144e9ccc67ed-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wbwnt\" (UID: \"463a6385-9165-43cc-ab3a-144e9ccc67ed\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt"
Jul 02 20:38:12.033264 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:12.033237    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/463a6385-9165-43cc-ab3a-144e9ccc67ed-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wbwnt\" (UID: \"463a6385-9165-43cc-ab3a-144e9ccc67ed\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt"
Jul 02 20:38:12.268234 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:12.268197    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt"
Jul 02 20:38:12.447299 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:12.447269    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt"]
Jul 02 20:38:12.451979 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:38:12.451951    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod463a6385_9165_43cc_ab3a_144e9ccc67ed.slice/crio-93e36e88140e4a2b8391fdd2a486d6d7e575323adbc8854086a142be569595fa WatchSource:0}: Error finding container 93e36e88140e4a2b8391fdd2a486d6d7e575323adbc8854086a142be569595fa: Status 404 returned error can't find the container with id 93e36e88140e4a2b8391fdd2a486d6d7e575323adbc8854086a142be569595fa
Jul 02 20:38:12.475708 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:12.475675    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-22pv8"]
Jul 02 20:38:12.478785 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:38:12.478762    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be2f398_248d_420e_9892_eddf4f21de0b.slice/crio-91952777c321c371cb38eb20c95f067937cf287e4a10d07b2e890b0de92b2f19 WatchSource:0}: Error finding container 91952777c321c371cb38eb20c95f067937cf287e4a10d07b2e890b0de92b2f19: Status 404 returned error can't find the container with id 91952777c321c371cb38eb20c95f067937cf287e4a10d07b2e890b0de92b2f19
Jul 02 20:38:12.903705 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:12.903671    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt" event={"ID":"463a6385-9165-43cc-ab3a-144e9ccc67ed","Type":"ContainerStarted","Data":"93e36e88140e4a2b8391fdd2a486d6d7e575323adbc8854086a142be569595fa"}
Jul 02 20:38:12.904821 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:12.904795    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-22pv8" event={"ID":"4be2f398-248d-420e-9892-eddf4f21de0b","Type":"ContainerStarted","Data":"91952777c321c371cb38eb20c95f067937cf287e4a10d07b2e890b0de92b2f19"}
Jul 02 20:38:12.906269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:12.906249    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n" event={"ID":"43ee67cb-c6d2-4ff8-86b3-878e19caad6e","Type":"ContainerStarted","Data":"a0867e6f1a9fcd052927487aa5e82f9e3bf986e25de907a7576b0f69f6ea0101"}
Jul 02 20:38:12.906363 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:12.906309    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:12.938314 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:12.938272    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n" podStartSLOduration=1.458089331 podStartE2EDuration="4.938257574s" totalImagesPullingTime="3.480168243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:12.937472528 +0000 UTC m=+316.060641565" watchObservedRunningTime="2026-07-02 20:38:12.938257574 +0000 UTC m=+316.061426607"
Jul 02 20:38:15.922024 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:15.921987    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-22pv8" event={"ID":"4be2f398-248d-420e-9892-eddf4f21de0b","Type":"ContainerStarted","Data":"26fc6d91235ca4d0f8eeb3023c0c7a7e02c196c94c4c486bafd2e2c5144f87de"}
Jul 02 20:38:15.922396 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:15.922165    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-22pv8"
Jul 02 20:38:15.975246 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:15.975202    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-22pv8" podStartSLOduration=2.4351784739999998 podStartE2EDuration="4.975185658s" totalImagesPullingTime="2.540007184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:15.97219826 +0000 UTC m=+319.095367295" watchObservedRunningTime="2026-07-02 20:38:15.975185658 +0000 UTC m=+319.098354691"
Jul 02 20:38:16.928256 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:16.928214    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt" event={"ID":"463a6385-9165-43cc-ab3a-144e9ccc67ed","Type":"ContainerStarted","Data":"a871f9b1a02126ae110921904da13d46047e13332146db9a36a9b8d1b6be87b5"}
Jul 02 20:38:16.928703 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:16.928321    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt"
Jul 02 20:38:16.955921 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:16.955856    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt" podStartSLOduration=2.590858519 podStartE2EDuration="5.955840478s" totalImagesPullingTime="3.364981959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:16.955327823 +0000 UTC m=+320.078496877" watchObservedRunningTime="2026-07-02 20:38:16.955840478 +0000 UTC m=+320.079009514"
Jul 02 20:38:23.914258 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:23.914228    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-787649fbc-wd64n"
Jul 02 20:38:46.933704 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:46.933673    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-22pv8"
Jul 02 20:38:47.935669 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:38:47.935639    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wbwnt"
Jul 02 20:40:01.360262 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:01.360223    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7hkw"]
Jul 02 20:40:01.363723 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:01.363693    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7hkw"
Jul 02 20:40:01.370193 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:01.370134    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 20:40:01.371125 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:01.371101    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xcvxk\""
Jul 02 20:40:01.371615 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:01.371134    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 20:40:01.380932 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:01.380900    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7hkw"]
Jul 02 20:40:01.462342 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:01.462291    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbw4n\" (UniqueName: \"kubernetes.io/projected/b90a44b7-562c-4131-83b5-fd7e4cadef79-kube-api-access-sbw4n\") pod \"limitador-operator-controller-manager-859d7b78bd-r7hkw\" (UID: \"b90a44b7-562c-4131-83b5-fd7e4cadef79\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7hkw"
Jul 02 20:40:01.563424 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:01.563377    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbw4n\" (UniqueName: \"kubernetes.io/projected/b90a44b7-562c-4131-83b5-fd7e4cadef79-kube-api-access-sbw4n\") pod \"limitador-operator-controller-manager-859d7b78bd-r7hkw\" (UID: \"b90a44b7-562c-4131-83b5-fd7e4cadef79\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7hkw"
Jul 02 20:40:01.580281 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:01.580237    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbw4n\" (UniqueName: \"kubernetes.io/projected/b90a44b7-562c-4131-83b5-fd7e4cadef79-kube-api-access-sbw4n\") pod \"limitador-operator-controller-manager-859d7b78bd-r7hkw\" (UID: \"b90a44b7-562c-4131-83b5-fd7e4cadef79\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7hkw"
Jul 02 20:40:01.675473 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:01.675379    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7hkw"
Jul 02 20:40:01.832029 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:01.831990    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7hkw"]
Jul 02 20:40:01.840317 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:40:01.840280    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb90a44b7_562c_4131_83b5_fd7e4cadef79.slice/crio-9015173da0c0829bd07f2cb6c2e53f82fdd31e701edb1bd7fd9cfbc8fc73f2aa WatchSource:0}: Error finding container 9015173da0c0829bd07f2cb6c2e53f82fdd31e701edb1bd7fd9cfbc8fc73f2aa: Status 404 returned error can't find the container with id 9015173da0c0829bd07f2cb6c2e53f82fdd31e701edb1bd7fd9cfbc8fc73f2aa
Jul 02 20:40:02.387516 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:02.387475    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7hkw" event={"ID":"b90a44b7-562c-4131-83b5-fd7e4cadef79","Type":"ContainerStarted","Data":"9015173da0c0829bd07f2cb6c2e53f82fdd31e701edb1bd7fd9cfbc8fc73f2aa"}
Jul 02 20:40:04.398708 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:04.398668    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7hkw" event={"ID":"b90a44b7-562c-4131-83b5-fd7e4cadef79","Type":"ContainerStarted","Data":"11e1d4422f168f24683dabe558c835a6a14270e83025550a158f38a9abe5cb7d"}
Jul 02 20:40:04.399153 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:04.398742    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7hkw"
Jul 02 20:40:04.435892 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:04.435820    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7hkw" podStartSLOduration=1.041923597 podStartE2EDuration="3.435800646s" totalImagesPullingTime="2.393877049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:04.435085912 +0000 UTC m=+427.558254965" watchObservedRunningTime="2026-07-02 20:40:04.435800646 +0000 UTC m=+427.558969679"
Jul 02 20:40:15.405151 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:15.405117    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7hkw"
Jul 02 20:40:47.113813 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:47.113775    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-lkmgx"]
Jul 02 20:40:47.120024 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:47.119995    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lkmgx"
Jul 02 20:40:47.124434 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:47.124406    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bldrs\""
Jul 02 20:40:47.152635 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:47.152605    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lkmgx"]
Jul 02 20:40:47.169401 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:47.169365    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxd45\" (UniqueName: \"kubernetes.io/projected/4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f-kube-api-access-dxd45\") pod \"authorino-75d556bd77-lkmgx\" (UID: \"4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f\") " pod="kuadrant-system/authorino-75d556bd77-lkmgx"
Jul 02 20:40:47.270816 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:47.270756    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxd45\" (UniqueName: \"kubernetes.io/projected/4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f-kube-api-access-dxd45\") pod \"authorino-75d556bd77-lkmgx\" (UID: \"4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f\") " pod="kuadrant-system/authorino-75d556bd77-lkmgx"
Jul 02 20:40:47.285559 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:47.285513    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxd45\" (UniqueName: \"kubernetes.io/projected/4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f-kube-api-access-dxd45\") pod \"authorino-75d556bd77-lkmgx\" (UID: \"4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f\") " pod="kuadrant-system/authorino-75d556bd77-lkmgx"
Jul 02 20:40:47.429421 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:47.429337    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lkmgx"
Jul 02 20:40:47.588662 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:47.588595    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lkmgx"]
Jul 02 20:40:47.592097 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:40:47.592058    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4545db1a_ba77_44ac_ac6f_2fcdba5e5f4f.slice/crio-8bf7bca532af52a0580704c8c36adf579b250224162432a1786474e2bcfeb7c1 WatchSource:0}: Error finding container 8bf7bca532af52a0580704c8c36adf579b250224162432a1786474e2bcfeb7c1: Status 404 returned error can't find the container with id 8bf7bca532af52a0580704c8c36adf579b250224162432a1786474e2bcfeb7c1
Jul 02 20:40:47.600791 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:47.600742    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lkmgx" event={"ID":"4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f","Type":"ContainerStarted","Data":"8bf7bca532af52a0580704c8c36adf579b250224162432a1786474e2bcfeb7c1"}
Jul 02 20:40:50.619413 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:50.619368    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lkmgx" event={"ID":"4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f","Type":"ContainerStarted","Data":"2132edc2be081ff72d32dbe8bb29d77589a52c4007ab7dddb5c9f55243871e5f"}
Jul 02 20:40:50.635141 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:40:50.635082    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-lkmgx" podStartSLOduration=0.699926104 podStartE2EDuration="3.635064151s" totalImagesPullingTime="2.935138047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:50.633599928 +0000 UTC m=+473.756768962" watchObservedRunningTime="2026-07-02 20:40:50.635064151 +0000 UTC m=+473.758233184"
Jul 02 20:41:07.591665 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:07.591623    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-clz8p"]
Jul 02 20:41:07.597194 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:07.597167    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-clz8p"
Jul 02 20:41:07.601509 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:07.601484    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 02 20:41:07.601906 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:07.601863    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 02 20:41:07.602219 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:07.602196    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-tcsct\""
Jul 02 20:41:07.602318 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:07.602203    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 02 20:41:07.605951 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:07.605874    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-clz8p"]
Jul 02 20:41:07.648471 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:07.648417    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4mch\" (UniqueName: \"kubernetes.io/projected/d9f3ac4b-67d3-499c-a96e-5d3baeba4a45-kube-api-access-x4mch\") pod \"postgres-69fb4594cf-clz8p\" (UID: \"d9f3ac4b-67d3-499c-a96e-5d3baeba4a45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-clz8p"
Jul 02 20:41:07.648660 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:07.648545    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d9f3ac4b-67d3-499c-a96e-5d3baeba4a45-data\") pod \"postgres-69fb4594cf-clz8p\" (UID: \"d9f3ac4b-67d3-499c-a96e-5d3baeba4a45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-clz8p"
Jul 02 20:41:07.749025 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:07.748986    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d9f3ac4b-67d3-499c-a96e-5d3baeba4a45-data\") pod \"postgres-69fb4594cf-clz8p\" (UID: \"d9f3ac4b-67d3-499c-a96e-5d3baeba4a45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-clz8p"
Jul 02 20:41:07.749230 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:07.749052    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4mch\" (UniqueName: \"kubernetes.io/projected/d9f3ac4b-67d3-499c-a96e-5d3baeba4a45-kube-api-access-x4mch\") pod \"postgres-69fb4594cf-clz8p\" (UID: \"d9f3ac4b-67d3-499c-a96e-5d3baeba4a45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-clz8p"
Jul 02 20:41:07.749412 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:07.749388    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d9f3ac4b-67d3-499c-a96e-5d3baeba4a45-data\") pod \"postgres-69fb4594cf-clz8p\" (UID: \"d9f3ac4b-67d3-499c-a96e-5d3baeba4a45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-clz8p"
Jul 02 20:41:07.760177 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:07.760149    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4mch\" (UniqueName: \"kubernetes.io/projected/d9f3ac4b-67d3-499c-a96e-5d3baeba4a45-kube-api-access-x4mch\") pod \"postgres-69fb4594cf-clz8p\" (UID: \"d9f3ac4b-67d3-499c-a96e-5d3baeba4a45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-clz8p"
Jul 02 20:41:07.908619 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:07.908525    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-clz8p"
Jul 02 20:41:08.065210 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:08.065163    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-clz8p"]
Jul 02 20:41:08.068264 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:41:08.068232    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f3ac4b_67d3_499c_a96e_5d3baeba4a45.slice/crio-8678c9feb6d1ea1e2656a2251564a1f46b60a35a71a3d03cfa38362642bee331 WatchSource:0}: Error finding container 8678c9feb6d1ea1e2656a2251564a1f46b60a35a71a3d03cfa38362642bee331: Status 404 returned error can't find the container with id 8678c9feb6d1ea1e2656a2251564a1f46b60a35a71a3d03cfa38362642bee331
Jul 02 20:41:08.706999 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:08.706957    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-clz8p" event={"ID":"d9f3ac4b-67d3-499c-a96e-5d3baeba4a45","Type":"ContainerStarted","Data":"8678c9feb6d1ea1e2656a2251564a1f46b60a35a71a3d03cfa38362642bee331"}
Jul 02 20:41:13.735862 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:13.735808    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-clz8p" event={"ID":"d9f3ac4b-67d3-499c-a96e-5d3baeba4a45","Type":"ContainerStarted","Data":"37f58d5ced94b2666211caad8752d1109882899d1799af17b80d0c4c0b9d9e3c"}
Jul 02 20:41:13.736284 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:13.736005    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-clz8p"
Jul 02 20:41:13.756906 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:13.756820    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-clz8p" podStartSLOduration=1.228780026 podStartE2EDuration="6.756792539s" totalImagesPullingTime="5.528012513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:41:13.753183079 +0000 UTC m=+496.876352112" watchObservedRunningTime="2026-07-02 20:41:13.756792539 +0000 UTC m=+496.879961573"
Jul 02 20:41:19.771687 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:19.771656    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-clz8p"
Jul 02 20:41:22.090998 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.090955    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lkmgx"]
Jul 02 20:41:22.091418 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.091190    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-lkmgx" podUID="4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f" containerName="authorino" containerID="cri-o://2132edc2be081ff72d32dbe8bb29d77589a52c4007ab7dddb5c9f55243871e5f" gracePeriod=30
Jul 02 20:41:22.339106 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.339077    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lkmgx"
Jul 02 20:41:22.485410 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.485320    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxd45\" (UniqueName: \"kubernetes.io/projected/4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f-kube-api-access-dxd45\") pod \"4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f\" (UID: \"4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f\") "
Jul 02 20:41:22.487618 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.487579    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f-kube-api-access-dxd45" (OuterVolumeSpecName: "kube-api-access-dxd45") pod "4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f" (UID: "4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f"). InnerVolumeSpecName "kube-api-access-dxd45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:41:22.586199 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.586162    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxd45\" (UniqueName: \"kubernetes.io/projected/4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f-kube-api-access-dxd45\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:41:22.781537 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.781440    2586 generic.go:356] "Generic (PLEG): container finished" podID="4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f" containerID="2132edc2be081ff72d32dbe8bb29d77589a52c4007ab7dddb5c9f55243871e5f" exitCode=0
Jul 02 20:41:22.781537 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.781481    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lkmgx"
Jul 02 20:41:22.781753 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.781531    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lkmgx" event={"ID":"4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f","Type":"ContainerDied","Data":"2132edc2be081ff72d32dbe8bb29d77589a52c4007ab7dddb5c9f55243871e5f"}
Jul 02 20:41:22.781753 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.781575    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lkmgx" event={"ID":"4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f","Type":"ContainerDied","Data":"8bf7bca532af52a0580704c8c36adf579b250224162432a1786474e2bcfeb7c1"}
Jul 02 20:41:22.781753 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.781594    2586 scope.go:117] "RemoveContainer" containerID="2132edc2be081ff72d32dbe8bb29d77589a52c4007ab7dddb5c9f55243871e5f"
Jul 02 20:41:22.790597 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.790576    2586 scope.go:117] "RemoveContainer" containerID="2132edc2be081ff72d32dbe8bb29d77589a52c4007ab7dddb5c9f55243871e5f"
Jul 02 20:41:22.790949 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:41:22.790927    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2132edc2be081ff72d32dbe8bb29d77589a52c4007ab7dddb5c9f55243871e5f\": container with ID starting with 2132edc2be081ff72d32dbe8bb29d77589a52c4007ab7dddb5c9f55243871e5f not found: ID does not exist" containerID="2132edc2be081ff72d32dbe8bb29d77589a52c4007ab7dddb5c9f55243871e5f"
Jul 02 20:41:22.791047 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.790958    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2132edc2be081ff72d32dbe8bb29d77589a52c4007ab7dddb5c9f55243871e5f"} err="failed to get container status \"2132edc2be081ff72d32dbe8bb29d77589a52c4007ab7dddb5c9f55243871e5f\": rpc error: code = NotFound desc = could not find container \"2132edc2be081ff72d32dbe8bb29d77589a52c4007ab7dddb5c9f55243871e5f\": container with ID starting with 2132edc2be081ff72d32dbe8bb29d77589a52c4007ab7dddb5c9f55243871e5f not found: ID does not exist"
Jul 02 20:41:22.805637 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.805602    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lkmgx"]
Jul 02 20:41:22.816187 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:22.816157    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lkmgx"]
Jul 02 20:41:23.492720 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:23.492684    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f" path="/var/lib/kubelet/pods/4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f/volumes"
Jul 02 20:41:26.556551 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.556518    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5954976746-sn66k"]
Jul 02 20:41:26.556951 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.556907    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f" containerName="authorino"
Jul 02 20:41:26.556951 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.556923    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f" containerName="authorino"
Jul 02 20:41:26.557044 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.556989    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4545db1a-ba77-44ac-ac6f-2fcdba5e5f4f" containerName="authorino"
Jul 02 20:41:26.561074 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.561052    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5954976746-sn66k"
Jul 02 20:41:26.563763 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.563741    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-42zhx\""
Jul 02 20:41:26.563850 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.563825    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 20:41:26.563850 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.563842    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 20:41:26.572647 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.572619    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5954976746-sn66k"]
Jul 02 20:41:26.718963 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.718922    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8069ae86-c50e-46c9-8965-8c01b50ce5d5-webhook-cert\") pod \"maas-controller-5954976746-sn66k\" (UID: \"8069ae86-c50e-46c9-8965-8c01b50ce5d5\") " pod="opendatahub/maas-controller-5954976746-sn66k"
Jul 02 20:41:26.719125 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.719038    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7csj2\" (UniqueName: \"kubernetes.io/projected/8069ae86-c50e-46c9-8965-8c01b50ce5d5-kube-api-access-7csj2\") pod \"maas-controller-5954976746-sn66k\" (UID: \"8069ae86-c50e-46c9-8965-8c01b50ce5d5\") " pod="opendatahub/maas-controller-5954976746-sn66k"
Jul 02 20:41:26.740298 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.740255    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dc556f97c-rmh4m"]
Jul 02 20:41:26.743588 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.743567    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc556f97c-rmh4m"
Jul 02 20:41:26.755038 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.755010    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dc556f97c-rmh4m"]
Jul 02 20:41:26.820415 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.820311    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7csj2\" (UniqueName: \"kubernetes.io/projected/8069ae86-c50e-46c9-8965-8c01b50ce5d5-kube-api-access-7csj2\") pod \"maas-controller-5954976746-sn66k\" (UID: \"8069ae86-c50e-46c9-8965-8c01b50ce5d5\") " pod="opendatahub/maas-controller-5954976746-sn66k"
Jul 02 20:41:26.820596 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.820418    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8069ae86-c50e-46c9-8965-8c01b50ce5d5-webhook-cert\") pod \"maas-controller-5954976746-sn66k\" (UID: \"8069ae86-c50e-46c9-8965-8c01b50ce5d5\") " pod="opendatahub/maas-controller-5954976746-sn66k"
Jul 02 20:41:26.820596 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:41:26.820583    2586 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 02 20:41:26.820718 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:41:26.820662    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8069ae86-c50e-46c9-8965-8c01b50ce5d5-webhook-cert podName:8069ae86-c50e-46c9-8965-8c01b50ce5d5 nodeName:}" failed. No retries permitted until 2026-07-02 20:41:27.32063773 +0000 UTC m=+510.443806760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/8069ae86-c50e-46c9-8965-8c01b50ce5d5-webhook-cert") pod "maas-controller-5954976746-sn66k" (UID: "8069ae86-c50e-46c9-8965-8c01b50ce5d5") : secret "maas-controller-webhook-cert" not found
Jul 02 20:41:26.832361 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.832332    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7csj2\" (UniqueName: \"kubernetes.io/projected/8069ae86-c50e-46c9-8965-8c01b50ce5d5-kube-api-access-7csj2\") pod \"maas-controller-5954976746-sn66k\" (UID: \"8069ae86-c50e-46c9-8965-8c01b50ce5d5\") " pod="opendatahub/maas-controller-5954976746-sn66k"
Jul 02 20:41:26.921610 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.921557    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad21b1dd-77b9-4d25-8c99-079842bab8b9-webhook-cert\") pod \"maas-controller-7dc556f97c-rmh4m\" (UID: \"ad21b1dd-77b9-4d25-8c99-079842bab8b9\") " pod="opendatahub/maas-controller-7dc556f97c-rmh4m"
Jul 02 20:41:26.921802 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:26.921629    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckgvs\" (UniqueName: \"kubernetes.io/projected/ad21b1dd-77b9-4d25-8c99-079842bab8b9-kube-api-access-ckgvs\") pod \"maas-controller-7dc556f97c-rmh4m\" (UID: \"ad21b1dd-77b9-4d25-8c99-079842bab8b9\") " pod="opendatahub/maas-controller-7dc556f97c-rmh4m"
Jul 02 20:41:27.022362 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:27.022316    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad21b1dd-77b9-4d25-8c99-079842bab8b9-webhook-cert\") pod \"maas-controller-7dc556f97c-rmh4m\" (UID: \"ad21b1dd-77b9-4d25-8c99-079842bab8b9\") " pod="opendatahub/maas-controller-7dc556f97c-rmh4m"
Jul 02 20:41:27.022529 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:27.022381    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckgvs\" (UniqueName: \"kubernetes.io/projected/ad21b1dd-77b9-4d25-8c99-079842bab8b9-kube-api-access-ckgvs\") pod \"maas-controller-7dc556f97c-rmh4m\" (UID: \"ad21b1dd-77b9-4d25-8c99-079842bab8b9\") " pod="opendatahub/maas-controller-7dc556f97c-rmh4m"
Jul 02 20:41:27.024860 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:27.024834    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad21b1dd-77b9-4d25-8c99-079842bab8b9-webhook-cert\") pod \"maas-controller-7dc556f97c-rmh4m\" (UID: \"ad21b1dd-77b9-4d25-8c99-079842bab8b9\") " pod="opendatahub/maas-controller-7dc556f97c-rmh4m"
Jul 02 20:41:27.031793 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:27.031761    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckgvs\" (UniqueName: \"kubernetes.io/projected/ad21b1dd-77b9-4d25-8c99-079842bab8b9-kube-api-access-ckgvs\") pod \"maas-controller-7dc556f97c-rmh4m\" (UID: \"ad21b1dd-77b9-4d25-8c99-079842bab8b9\") " pod="opendatahub/maas-controller-7dc556f97c-rmh4m"
Jul 02 20:41:27.055639 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:27.055601    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc556f97c-rmh4m"
Jul 02 20:41:27.195612 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:27.195586    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dc556f97c-rmh4m"]
Jul 02 20:41:27.198139 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:41:27.198110    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad21b1dd_77b9_4d25_8c99_079842bab8b9.slice/crio-995a2a5c9d47c6a6d01b187b4c8f478ab22d76f26affc0776c50bf564c458249 WatchSource:0}: Error finding container 995a2a5c9d47c6a6d01b187b4c8f478ab22d76f26affc0776c50bf564c458249: Status 404 returned error can't find the container with id 995a2a5c9d47c6a6d01b187b4c8f478ab22d76f26affc0776c50bf564c458249
Jul 02 20:41:27.325432 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:27.325387    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8069ae86-c50e-46c9-8965-8c01b50ce5d5-webhook-cert\") pod \"maas-controller-5954976746-sn66k\" (UID: \"8069ae86-c50e-46c9-8965-8c01b50ce5d5\") " pod="opendatahub/maas-controller-5954976746-sn66k"
Jul 02 20:41:27.327948 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:27.327922    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8069ae86-c50e-46c9-8965-8c01b50ce5d5-webhook-cert\") pod \"maas-controller-5954976746-sn66k\" (UID: \"8069ae86-c50e-46c9-8965-8c01b50ce5d5\") " pod="opendatahub/maas-controller-5954976746-sn66k"
Jul 02 20:41:27.472117 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:27.472028    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5954976746-sn66k"
Jul 02 20:41:27.622228 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:27.622199    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5954976746-sn66k"]
Jul 02 20:41:27.625059 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:41:27.625031    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8069ae86_c50e_46c9_8965_8c01b50ce5d5.slice/crio-67fdf5208499b7a3cc107b030d2b0e415f4beb0730ed96fc89e9459dd13336a0 WatchSource:0}: Error finding container 67fdf5208499b7a3cc107b030d2b0e415f4beb0730ed96fc89e9459dd13336a0: Status 404 returned error can't find the container with id 67fdf5208499b7a3cc107b030d2b0e415f4beb0730ed96fc89e9459dd13336a0
Jul 02 20:41:27.805663 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:27.805624    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc556f97c-rmh4m" event={"ID":"ad21b1dd-77b9-4d25-8c99-079842bab8b9","Type":"ContainerStarted","Data":"995a2a5c9d47c6a6d01b187b4c8f478ab22d76f26affc0776c50bf564c458249"}
Jul 02 20:41:27.806864 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:27.806824    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5954976746-sn66k" event={"ID":"8069ae86-c50e-46c9-8965-8c01b50ce5d5","Type":"ContainerStarted","Data":"67fdf5208499b7a3cc107b030d2b0e415f4beb0730ed96fc89e9459dd13336a0"}
Jul 02 20:41:30.825670 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:30.825614    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc556f97c-rmh4m" event={"ID":"ad21b1dd-77b9-4d25-8c99-079842bab8b9","Type":"ContainerStarted","Data":"a1cbed20b506cad34945beaa64ed8b9bf54ba5eb10642d8aa1233f5a7a3462b3"}
Jul 02 20:41:30.826197 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:30.825710    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dc556f97c-rmh4m"
Jul 02 20:41:30.827351 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:30.827314    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5954976746-sn66k" event={"ID":"8069ae86-c50e-46c9-8965-8c01b50ce5d5","Type":"ContainerStarted","Data":"9f169cc71db70547922ec014385ab16816de875a974054189f91e3e0c9bb99e0"}
Jul 02 20:41:30.827484 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:30.827382    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5954976746-sn66k"
Jul 02 20:41:30.846164 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:30.846109    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7dc556f97c-rmh4m" podStartSLOduration=2.028768305 podStartE2EDuration="4.846090713s" totalImagesPullingTime="2.817322408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:41:30.844958448 +0000 UTC m=+513.968127503" watchObservedRunningTime="2026-07-02 20:41:30.846090713 +0000 UTC m=+513.969259745"
Jul 02 20:41:30.863122 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:30.863068    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5954976746-sn66k" podStartSLOduration=2.45940513 podStartE2EDuration="4.863050975s" totalImagesPullingTime="2.403645845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:41:30.862131684 +0000 UTC m=+513.985300719" watchObservedRunningTime="2026-07-02 20:41:30.863050975 +0000 UTC m=+513.986220002"
Jul 02 20:41:41.837290 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:41.837255    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5954976746-sn66k"
Jul 02 20:41:41.837830 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:41.837332    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dc556f97c-rmh4m"
Jul 02 20:41:41.900747 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:41.900714    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5954976746-sn66k"]
Jul 02 20:41:41.900977 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:41.900947    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5954976746-sn66k" podUID="8069ae86-c50e-46c9-8965-8c01b50ce5d5" containerName="manager" containerID="cri-o://9f169cc71db70547922ec014385ab16816de875a974054189f91e3e0c9bb99e0" gracePeriod=30
Jul 02 20:41:42.160084 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.160050    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5954976746-sn66k"
Jul 02 20:41:42.263564 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.263527    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8069ae86-c50e-46c9-8965-8c01b50ce5d5-webhook-cert\") pod \"8069ae86-c50e-46c9-8965-8c01b50ce5d5\" (UID: \"8069ae86-c50e-46c9-8965-8c01b50ce5d5\") "
Jul 02 20:41:42.263756 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.263601    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7csj2\" (UniqueName: \"kubernetes.io/projected/8069ae86-c50e-46c9-8965-8c01b50ce5d5-kube-api-access-7csj2\") pod \"8069ae86-c50e-46c9-8965-8c01b50ce5d5\" (UID: \"8069ae86-c50e-46c9-8965-8c01b50ce5d5\") "
Jul 02 20:41:42.266023 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.265987    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8069ae86-c50e-46c9-8965-8c01b50ce5d5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8069ae86-c50e-46c9-8965-8c01b50ce5d5" (UID: "8069ae86-c50e-46c9-8965-8c01b50ce5d5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:41:42.266170 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.266040    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8069ae86-c50e-46c9-8965-8c01b50ce5d5-kube-api-access-7csj2" (OuterVolumeSpecName: "kube-api-access-7csj2") pod "8069ae86-c50e-46c9-8965-8c01b50ce5d5" (UID: "8069ae86-c50e-46c9-8965-8c01b50ce5d5"). InnerVolumeSpecName "kube-api-access-7csj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:41:42.364581 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.364543    2586 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8069ae86-c50e-46c9-8965-8c01b50ce5d5-webhook-cert\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:41:42.364581 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.364578    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7csj2\" (UniqueName: \"kubernetes.io/projected/8069ae86-c50e-46c9-8965-8c01b50ce5d5-kube-api-access-7csj2\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:41:42.888262 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.888228    2586 generic.go:356] "Generic (PLEG): container finished" podID="8069ae86-c50e-46c9-8965-8c01b50ce5d5" containerID="9f169cc71db70547922ec014385ab16816de875a974054189f91e3e0c9bb99e0" exitCode=0
Jul 02 20:41:42.888754 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.888272    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5954976746-sn66k"
Jul 02 20:41:42.888754 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.888311    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5954976746-sn66k" event={"ID":"8069ae86-c50e-46c9-8965-8c01b50ce5d5","Type":"ContainerDied","Data":"9f169cc71db70547922ec014385ab16816de875a974054189f91e3e0c9bb99e0"}
Jul 02 20:41:42.888754 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.888377    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5954976746-sn66k" event={"ID":"8069ae86-c50e-46c9-8965-8c01b50ce5d5","Type":"ContainerDied","Data":"67fdf5208499b7a3cc107b030d2b0e415f4beb0730ed96fc89e9459dd13336a0"}
Jul 02 20:41:42.888754 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.888413    2586 scope.go:117] "RemoveContainer" containerID="9f169cc71db70547922ec014385ab16816de875a974054189f91e3e0c9bb99e0"
Jul 02 20:41:42.897653 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.897633    2586 scope.go:117] "RemoveContainer" containerID="9f169cc71db70547922ec014385ab16816de875a974054189f91e3e0c9bb99e0"
Jul 02 20:41:42.898017 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:41:42.897998    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f169cc71db70547922ec014385ab16816de875a974054189f91e3e0c9bb99e0\": container with ID starting with 9f169cc71db70547922ec014385ab16816de875a974054189f91e3e0c9bb99e0 not found: ID does not exist" containerID="9f169cc71db70547922ec014385ab16816de875a974054189f91e3e0c9bb99e0"
Jul 02 20:41:42.898075 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.898028    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f169cc71db70547922ec014385ab16816de875a974054189f91e3e0c9bb99e0"} err="failed to get container status \"9f169cc71db70547922ec014385ab16816de875a974054189f91e3e0c9bb99e0\": rpc error: code = NotFound desc = could not find container \"9f169cc71db70547922ec014385ab16816de875a974054189f91e3e0c9bb99e0\": container with ID starting with 9f169cc71db70547922ec014385ab16816de875a974054189f91e3e0c9bb99e0 not found: ID does not exist"
Jul 02 20:41:42.912521 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.912487    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5954976746-sn66k"]
Jul 02 20:41:42.916537 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:42.916506    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5954976746-sn66k"]
Jul 02 20:41:43.493603 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:41:43.493557    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8069ae86-c50e-46c9-8965-8c01b50ce5d5" path="/var/lib/kubelet/pods/8069ae86-c50e-46c9-8965-8c01b50ce5d5/volumes"
Jul 02 20:42:02.260044 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.260003    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"]
Jul 02 20:42:02.260447 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.260429    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8069ae86-c50e-46c9-8965-8c01b50ce5d5" containerName="manager"
Jul 02 20:42:02.260491 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.260451    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8069ae86-c50e-46c9-8965-8c01b50ce5d5" containerName="manager"
Jul 02 20:42:02.260573 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.260543    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="8069ae86-c50e-46c9-8965-8c01b50ce5d5" containerName="manager"
Jul 02 20:42:02.265357 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.265330    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"
Jul 02 20:42:02.267905 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.267862    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 02 20:42:02.268121 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.267927    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lw57d\""
Jul 02 20:42:02.276029 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.275999    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"]
Jul 02 20:42:02.355574 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.355537    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba037b75-01e1-43f2-92df-e98ce93a06ab-maas-api-tls\") pod \"maas-api-9c4f78cc7-j5hjk\" (UID: \"ba037b75-01e1-43f2-92df-e98ce93a06ab\") " pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"
Jul 02 20:42:02.355761 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.355585    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5lcd\" (UniqueName: \"kubernetes.io/projected/ba037b75-01e1-43f2-92df-e98ce93a06ab-kube-api-access-m5lcd\") pod \"maas-api-9c4f78cc7-j5hjk\" (UID: \"ba037b75-01e1-43f2-92df-e98ce93a06ab\") " pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"
Jul 02 20:42:02.355761 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.355675    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba037b75-01e1-43f2-92df-e98ce93a06ab-openshift-service-ca\") pod \"maas-api-9c4f78cc7-j5hjk\" (UID: \"ba037b75-01e1-43f2-92df-e98ce93a06ab\") " pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"
Jul 02 20:42:02.456610 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.456563    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba037b75-01e1-43f2-92df-e98ce93a06ab-openshift-service-ca\") pod \"maas-api-9c4f78cc7-j5hjk\" (UID: \"ba037b75-01e1-43f2-92df-e98ce93a06ab\") " pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"
Jul 02 20:42:02.456799 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.456648    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba037b75-01e1-43f2-92df-e98ce93a06ab-maas-api-tls\") pod \"maas-api-9c4f78cc7-j5hjk\" (UID: \"ba037b75-01e1-43f2-92df-e98ce93a06ab\") " pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"
Jul 02 20:42:02.456799 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.456697    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5lcd\" (UniqueName: \"kubernetes.io/projected/ba037b75-01e1-43f2-92df-e98ce93a06ab-kube-api-access-m5lcd\") pod \"maas-api-9c4f78cc7-j5hjk\" (UID: \"ba037b75-01e1-43f2-92df-e98ce93a06ab\") " pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"
Jul 02 20:42:02.456799 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:42:02.456767    2586 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 02 20:42:02.456965 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:42:02.456852    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba037b75-01e1-43f2-92df-e98ce93a06ab-maas-api-tls podName:ba037b75-01e1-43f2-92df-e98ce93a06ab nodeName:}" failed. No retries permitted until 2026-07-02 20:42:02.956832422 +0000 UTC m=+546.080001436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ba037b75-01e1-43f2-92df-e98ce93a06ab-maas-api-tls") pod "maas-api-9c4f78cc7-j5hjk" (UID: "ba037b75-01e1-43f2-92df-e98ce93a06ab") : secret "maas-api-serving-cert" not found
Jul 02 20:42:02.457317 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.457290    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba037b75-01e1-43f2-92df-e98ce93a06ab-openshift-service-ca\") pod \"maas-api-9c4f78cc7-j5hjk\" (UID: \"ba037b75-01e1-43f2-92df-e98ce93a06ab\") " pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"
Jul 02 20:42:02.466527 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.466490    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5lcd\" (UniqueName: \"kubernetes.io/projected/ba037b75-01e1-43f2-92df-e98ce93a06ab-kube-api-access-m5lcd\") pod \"maas-api-9c4f78cc7-j5hjk\" (UID: \"ba037b75-01e1-43f2-92df-e98ce93a06ab\") " pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"
Jul 02 20:42:02.962056 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.962010    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba037b75-01e1-43f2-92df-e98ce93a06ab-maas-api-tls\") pod \"maas-api-9c4f78cc7-j5hjk\" (UID: \"ba037b75-01e1-43f2-92df-e98ce93a06ab\") " pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"
Jul 02 20:42:02.964778 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:02.964737    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba037b75-01e1-43f2-92df-e98ce93a06ab-maas-api-tls\") pod \"maas-api-9c4f78cc7-j5hjk\" (UID: \"ba037b75-01e1-43f2-92df-e98ce93a06ab\") " pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"
Jul 02 20:42:03.179165 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:03.179127    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"
Jul 02 20:42:03.329299 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:03.329269    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"]
Jul 02 20:42:03.332735 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:42:03.332703    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba037b75_01e1_43f2_92df_e98ce93a06ab.slice/crio-8242422a6d5ec7a915fb0e5bdd4cc604164c861d71f251ef263da1c5380ead03 WatchSource:0}: Error finding container 8242422a6d5ec7a915fb0e5bdd4cc604164c861d71f251ef263da1c5380ead03: Status 404 returned error can't find the container with id 8242422a6d5ec7a915fb0e5bdd4cc604164c861d71f251ef263da1c5380ead03
Jul 02 20:42:03.987711 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:03.987671    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk" event={"ID":"ba037b75-01e1-43f2-92df-e98ce93a06ab","Type":"ContainerStarted","Data":"8242422a6d5ec7a915fb0e5bdd4cc604164c861d71f251ef263da1c5380ead03"}
Jul 02 20:42:05.999061 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:05.999023    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk" event={"ID":"ba037b75-01e1-43f2-92df-e98ce93a06ab","Type":"ContainerStarted","Data":"7af369c1850cb830baf0b5c6d601e9216447d1677b647cbdfd49b703f1371f8c"}
Jul 02 20:42:05.999470 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:05.999085    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"
Jul 02 20:42:06.021652 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:06.021584    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk" podStartSLOduration=2.315136357 podStartE2EDuration="4.021563359s" totalImagesPullingTime="1.706427002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:42:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:42:06.019661507 +0000 UTC m=+549.142830540" watchObservedRunningTime="2026-07-02 20:42:06.021563359 +0000 UTC m=+549.144732392"
Jul 02 20:42:12.009188 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:12.009157    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-9c4f78cc7-j5hjk"
Jul 02 20:42:18.799422 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:18.799389    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"]
Jul 02 20:42:18.803345 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:18.803320    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:18.806106 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:18.806069    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 20:42:18.806269 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:18.806126    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 20:42:18.807005 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:18.806988    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 02 20:42:18.807079 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:18.807018    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zhml8\""
Jul 02 20:42:18.813760 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:18.813726    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"]
Jul 02 20:42:18.906761 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:18.906717    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16c82345-af6f-4487-bc57-98f82a03d701-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:18.906998 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:18.906781    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16c82345-af6f-4487-bc57-98f82a03d701-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:18.906998 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:18.906831    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16c82345-af6f-4487-bc57-98f82a03d701-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:18.906998 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:18.906906    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnn5g\" (UniqueName: \"kubernetes.io/projected/16c82345-af6f-4487-bc57-98f82a03d701-kube-api-access-xnn5g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:18.906998 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:18.906970    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16c82345-af6f-4487-bc57-98f82a03d701-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:18.906998 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:18.906991    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16c82345-af6f-4487-bc57-98f82a03d701-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:19.008152 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:19.008109    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16c82345-af6f-4487-bc57-98f82a03d701-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:19.008152 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:19.008152    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnn5g\" (UniqueName: \"kubernetes.io/projected/16c82345-af6f-4487-bc57-98f82a03d701-kube-api-access-xnn5g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:19.008408 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:19.008187    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16c82345-af6f-4487-bc57-98f82a03d701-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:19.008408 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:19.008208    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16c82345-af6f-4487-bc57-98f82a03d701-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:19.008408 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:19.008365    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16c82345-af6f-4487-bc57-98f82a03d701-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:19.008571 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:19.008424    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16c82345-af6f-4487-bc57-98f82a03d701-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:19.008630 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:19.008586    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16c82345-af6f-4487-bc57-98f82a03d701-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:19.008682 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:19.008639    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16c82345-af6f-4487-bc57-98f82a03d701-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:19.008731 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:19.008698    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16c82345-af6f-4487-bc57-98f82a03d701-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:19.010646 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:19.010617    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16c82345-af6f-4487-bc57-98f82a03d701-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:19.010939 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:19.010917    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16c82345-af6f-4487-bc57-98f82a03d701-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:19.017252 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:19.017223    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnn5g\" (UniqueName: \"kubernetes.io/projected/16c82345-af6f-4487-bc57-98f82a03d701-kube-api-access-xnn5g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z\" (UID: \"16c82345-af6f-4487-bc57-98f82a03d701\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:19.115023 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:19.114926    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:19.267540 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:19.267396    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"]
Jul 02 20:42:19.270392 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:42:19.270365    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c82345_af6f_4487_bc57_98f82a03d701.slice/crio-f46b239623c8c7229f930091f4171aa8e17ebf729b7a2ba2e6ba265ca56ea419 WatchSource:0}: Error finding container f46b239623c8c7229f930091f4171aa8e17ebf729b7a2ba2e6ba265ca56ea419: Status 404 returned error can't find the container with id f46b239623c8c7229f930091f4171aa8e17ebf729b7a2ba2e6ba265ca56ea419
Jul 02 20:42:20.073723 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:20.073679    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z" event={"ID":"16c82345-af6f-4487-bc57-98f82a03d701","Type":"ContainerStarted","Data":"f46b239623c8c7229f930091f4171aa8e17ebf729b7a2ba2e6ba265ca56ea419"}
Jul 02 20:42:21.080926 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:21.080870    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z" event={"ID":"16c82345-af6f-4487-bc57-98f82a03d701","Type":"ContainerStarted","Data":"669da53a3e5a5d6df58215b344b100b3c959c511417328f8c99ce3c2bb20e72f"}
Jul 02 20:42:21.098503 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:21.098439    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z" podStartSLOduration=1.949325153 podStartE2EDuration="3.098417838s" totalImagesPullingTime="1.149092685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:42:21.096950156 +0000 UTC m=+564.220119215" watchObservedRunningTime="2026-07-02 20:42:21.098417838 +0000 UTC m=+564.221586871"
Jul 02 20:42:29.115151 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:29.115109    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:29.115685 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:29.115219    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:29.130948 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:29.130917    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:30.135732 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:30.135696    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z"
Jul 02 20:42:48.390764 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.390722    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"]
Jul 02 20:42:48.397271 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.397237    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.399777 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.399749    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 02 20:42:48.404515 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.404487    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"]
Jul 02 20:42:48.467368 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.467333    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2251acc4-d970-44cf-89bd-8f35ea706a46-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.467368 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.467368    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2251acc4-d970-44cf-89bd-8f35ea706a46-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.467626 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.467443    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2251acc4-d970-44cf-89bd-8f35ea706a46-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.467626 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.467469    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf45t\" (UniqueName: \"kubernetes.io/projected/2251acc4-d970-44cf-89bd-8f35ea706a46-kube-api-access-mf45t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.467626 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.467514    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2251acc4-d970-44cf-89bd-8f35ea706a46-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.467626 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.467543    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2251acc4-d970-44cf-89bd-8f35ea706a46-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.568498 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.568449    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2251acc4-d970-44cf-89bd-8f35ea706a46-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.568767 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.568546    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2251acc4-d970-44cf-89bd-8f35ea706a46-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.568767 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.568572    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2251acc4-d970-44cf-89bd-8f35ea706a46-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.568767 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.568642    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2251acc4-d970-44cf-89bd-8f35ea706a46-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.568767 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.568670    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf45t\" (UniqueName: \"kubernetes.io/projected/2251acc4-d970-44cf-89bd-8f35ea706a46-kube-api-access-mf45t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.568767 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.568708    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2251acc4-d970-44cf-89bd-8f35ea706a46-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.569085 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.568981    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2251acc4-d970-44cf-89bd-8f35ea706a46-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.569085 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.569032    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2251acc4-d970-44cf-89bd-8f35ea706a46-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.569179 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.569101    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2251acc4-d970-44cf-89bd-8f35ea706a46-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.571038 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.571012    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2251acc4-d970-44cf-89bd-8f35ea706a46-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.571240 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.571220    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2251acc4-d970-44cf-89bd-8f35ea706a46-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.577299 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.577269    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf45t\" (UniqueName: \"kubernetes.io/projected/2251acc4-d970-44cf-89bd-8f35ea706a46-kube-api-access-mf45t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6\" (UID: \"2251acc4-d970-44cf-89bd-8f35ea706a46\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.709800 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.709702    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:48.856067 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:48.855991    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"]
Jul 02 20:42:48.859225 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:42:48.859194    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2251acc4_d970_44cf_89bd_8f35ea706a46.slice/crio-f54d2629c88ad923f970f8d98470f0cb2693f1ad90f620d6079381a76c36a31b WatchSource:0}: Error finding container f54d2629c88ad923f970f8d98470f0cb2693f1ad90f620d6079381a76c36a31b: Status 404 returned error can't find the container with id f54d2629c88ad923f970f8d98470f0cb2693f1ad90f620d6079381a76c36a31b
Jul 02 20:42:49.215256 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:49.215212    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6" event={"ID":"2251acc4-d970-44cf-89bd-8f35ea706a46","Type":"ContainerStarted","Data":"7a038e2299918854816ede37454510694096205b3dc383cd4a4d8aa63b953a10"}
Jul 02 20:42:49.215452 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:49.215278    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6" event={"ID":"2251acc4-d970-44cf-89bd-8f35ea706a46","Type":"ContainerStarted","Data":"f54d2629c88ad923f970f8d98470f0cb2693f1ad90f620d6079381a76c36a31b"}
Jul 02 20:42:49.241071 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:49.237520    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6" podStartSLOduration=1.064157555 podStartE2EDuration="1.237494611s" totalImagesPullingTime="173.337056ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:42:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:42:49.234661532 +0000 UTC m=+592.357830566" watchObservedRunningTime="2026-07-02 20:42:49.237494611 +0000 UTC m=+592.360663647"
Jul 02 20:42:55.289586 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.289547    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"]
Jul 02 20:42:55.293342 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.293314    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.295766 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.295736    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 02 20:42:55.302595 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.302560    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"]
Jul 02 20:42:55.431157 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.431120    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/822d5748-c2ba-41d2-83c1-1c471594aab9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.431157 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.431167    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj7lx\" (UniqueName: \"kubernetes.io/projected/822d5748-c2ba-41d2-83c1-1c471594aab9-kube-api-access-mj7lx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.431382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.431193    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/822d5748-c2ba-41d2-83c1-1c471594aab9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.431382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.431283    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/822d5748-c2ba-41d2-83c1-1c471594aab9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.431382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.431315    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/822d5748-c2ba-41d2-83c1-1c471594aab9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.431382 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.431331    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/822d5748-c2ba-41d2-83c1-1c471594aab9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.532533 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.532486    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/822d5748-c2ba-41d2-83c1-1c471594aab9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.532533 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.532537    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj7lx\" (UniqueName: \"kubernetes.io/projected/822d5748-c2ba-41d2-83c1-1c471594aab9-kube-api-access-mj7lx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.532796 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.532571    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/822d5748-c2ba-41d2-83c1-1c471594aab9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.532796 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.532618    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/822d5748-c2ba-41d2-83c1-1c471594aab9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.532796 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.532647    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/822d5748-c2ba-41d2-83c1-1c471594aab9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.532796 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.532672    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/822d5748-c2ba-41d2-83c1-1c471594aab9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.533047 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.533005    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/822d5748-c2ba-41d2-83c1-1c471594aab9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.533105 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.533046    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/822d5748-c2ba-41d2-83c1-1c471594aab9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.533105 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.533067    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/822d5748-c2ba-41d2-83c1-1c471594aab9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.535050 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.535022    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/822d5748-c2ba-41d2-83c1-1c471594aab9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.535323 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.535297    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/822d5748-c2ba-41d2-83c1-1c471594aab9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.543867 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.543788    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj7lx\" (UniqueName: \"kubernetes.io/projected/822d5748-c2ba-41d2-83c1-1c471594aab9-kube-api-access-mj7lx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w26kl\" (UID: \"822d5748-c2ba-41d2-83c1-1c471594aab9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.605663 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.605620    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:42:55.757604 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:55.757569    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"]
Jul 02 20:42:55.759913 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:42:55.759861    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822d5748_c2ba_41d2_83c1_1c471594aab9.slice/crio-63bd62ded260d74fd584c8a59c951beff392a3af26facb502fd2b325e20f0dce WatchSource:0}: Error finding container 63bd62ded260d74fd584c8a59c951beff392a3af26facb502fd2b325e20f0dce: Status 404 returned error can't find the container with id 63bd62ded260d74fd584c8a59c951beff392a3af26facb502fd2b325e20f0dce
Jul 02 20:42:56.252797 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:56.252701    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl" event={"ID":"822d5748-c2ba-41d2-83c1-1c471594aab9","Type":"ContainerStarted","Data":"f455389a82102a352b2aea3477b588f283fb83ff91282d065f5dcd084de55ce6"}
Jul 02 20:42:56.252797 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:56.252789    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl" event={"ID":"822d5748-c2ba-41d2-83c1-1c471594aab9","Type":"ContainerStarted","Data":"63bd62ded260d74fd584c8a59c951beff392a3af26facb502fd2b325e20f0dce"}
Jul 02 20:42:56.271618 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:56.271558    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl" podStartSLOduration=1.064701412 podStartE2EDuration="1.271538488s" totalImagesPullingTime="206.837076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:42:56.270159419 +0000 UTC m=+599.393328469" watchObservedRunningTime="2026-07-02 20:42:56.271538488 +0000 UTC m=+599.394707521"
Jul 02 20:42:57.327007 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:57.326972    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 20:42:57.327802 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:57.327778    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 20:42:57.329793 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:57.329769    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 20:42:57.330931 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:57.330910    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 20:42:58.710223 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:58.710184    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:58.710630 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:58.710248    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:58.723258 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:58.723228    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:42:59.278490 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:42:59.278450    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6"
Jul 02 20:43:05.606620 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:43:05.606559    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:43:05.607089 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:43:05.606643    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:43:05.619394 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:43:05.619362    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:43:06.314063 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:43:06.314029    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w26kl"
Jul 02 20:45:00.147741 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:00.147647    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv"]
Jul 02 20:45:00.151102 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:00.151079    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv"
Jul 02 20:45:00.161839 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:00.161793    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv"]
Jul 02 20:45:00.301586 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:00.301548    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxvps\" (UniqueName: \"kubernetes.io/projected/3fc079f4-f975-4d62-a1cc-6b45138ed11e-kube-api-access-kxvps\") pod \"maas-api-key-cleanup-29717085-2bvzv\" (UID: \"3fc079f4-f975-4d62-a1cc-6b45138ed11e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv"
Jul 02 20:45:00.402779 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:00.402669    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxvps\" (UniqueName: \"kubernetes.io/projected/3fc079f4-f975-4d62-a1cc-6b45138ed11e-kube-api-access-kxvps\") pod \"maas-api-key-cleanup-29717085-2bvzv\" (UID: \"3fc079f4-f975-4d62-a1cc-6b45138ed11e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv"
Jul 02 20:45:00.413339 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:00.413299    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxvps\" (UniqueName: \"kubernetes.io/projected/3fc079f4-f975-4d62-a1cc-6b45138ed11e-kube-api-access-kxvps\") pod \"maas-api-key-cleanup-29717085-2bvzv\" (UID: \"3fc079f4-f975-4d62-a1cc-6b45138ed11e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv"
Jul 02 20:45:00.467289 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:00.467247    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv"
Jul 02 20:45:00.613169 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:00.613028    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv"]
Jul 02 20:45:00.616308 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:45:00.616260    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc079f4_f975_4d62_a1cc_6b45138ed11e.slice/crio-f742b83872ec8bb345456cdb95b66ede2a218f3eb013aeaa7cae0dfb1dedd01f WatchSource:0}: Error finding container f742b83872ec8bb345456cdb95b66ede2a218f3eb013aeaa7cae0dfb1dedd01f: Status 404 returned error can't find the container with id f742b83872ec8bb345456cdb95b66ede2a218f3eb013aeaa7cae0dfb1dedd01f
Jul 02 20:45:00.618397 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:00.618373    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:45:00.881523 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:00.881481    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv" event={"ID":"3fc079f4-f975-4d62-a1cc-6b45138ed11e","Type":"ContainerStarted","Data":"f742b83872ec8bb345456cdb95b66ede2a218f3eb013aeaa7cae0dfb1dedd01f"}
Jul 02 20:45:06.915550 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:06.915510    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv" event={"ID":"3fc079f4-f975-4d62-a1cc-6b45138ed11e","Type":"ContainerStarted","Data":"900c5a091b8e0a87192e2a1919c55c4e646a0a9e91c664fa162e2310f679f873"}
Jul 02 20:45:06.934752 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:06.934697    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv" podStartSLOduration=1.612693051 podStartE2EDuration="6.934679321s" totalImagesPullingTime="5.32198627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:45:06.933691743 +0000 UTC m=+730.056860802" watchObservedRunningTime="2026-07-02 20:45:06.934679321 +0000 UTC m=+730.057848402"
Jul 02 20:45:18.968934 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:18.968871    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dc556f97c-rmh4m"]
Jul 02 20:45:18.969320 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:18.969200    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7dc556f97c-rmh4m" podUID="ad21b1dd-77b9-4d25-8c99-079842bab8b9" containerName="manager" containerID="cri-o://a1cbed20b506cad34945beaa64ed8b9bf54ba5eb10642d8aa1233f5a7a3462b3" gracePeriod=30
Jul 02 20:45:19.232584 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.232514    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc556f97c-rmh4m"
Jul 02 20:45:19.284254 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.284215    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad21b1dd-77b9-4d25-8c99-079842bab8b9-webhook-cert\") pod \"ad21b1dd-77b9-4d25-8c99-079842bab8b9\" (UID: \"ad21b1dd-77b9-4d25-8c99-079842bab8b9\") "
Jul 02 20:45:19.284446 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.284272    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckgvs\" (UniqueName: \"kubernetes.io/projected/ad21b1dd-77b9-4d25-8c99-079842bab8b9-kube-api-access-ckgvs\") pod \"ad21b1dd-77b9-4d25-8c99-079842bab8b9\" (UID: \"ad21b1dd-77b9-4d25-8c99-079842bab8b9\") "
Jul 02 20:45:19.286447 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.286405    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad21b1dd-77b9-4d25-8c99-079842bab8b9-kube-api-access-ckgvs" (OuterVolumeSpecName: "kube-api-access-ckgvs") pod "ad21b1dd-77b9-4d25-8c99-079842bab8b9" (UID: "ad21b1dd-77b9-4d25-8c99-079842bab8b9"). InnerVolumeSpecName "kube-api-access-ckgvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:45:19.286600 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.286574    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad21b1dd-77b9-4d25-8c99-079842bab8b9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ad21b1dd-77b9-4d25-8c99-079842bab8b9" (UID: "ad21b1dd-77b9-4d25-8c99-079842bab8b9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:45:19.385277 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.385237    2586 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad21b1dd-77b9-4d25-8c99-079842bab8b9-webhook-cert\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:45:19.385277 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.385271    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckgvs\" (UniqueName: \"kubernetes.io/projected/ad21b1dd-77b9-4d25-8c99-079842bab8b9-kube-api-access-ckgvs\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:45:19.978262 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.978225    2586 generic.go:356] "Generic (PLEG): container finished" podID="ad21b1dd-77b9-4d25-8c99-079842bab8b9" containerID="a1cbed20b506cad34945beaa64ed8b9bf54ba5eb10642d8aa1233f5a7a3462b3" exitCode=0
Jul 02 20:45:19.978677 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.978269    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc556f97c-rmh4m"
Jul 02 20:45:19.978677 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.978301    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc556f97c-rmh4m" event={"ID":"ad21b1dd-77b9-4d25-8c99-079842bab8b9","Type":"ContainerDied","Data":"a1cbed20b506cad34945beaa64ed8b9bf54ba5eb10642d8aa1233f5a7a3462b3"}
Jul 02 20:45:19.978677 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.978364    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc556f97c-rmh4m" event={"ID":"ad21b1dd-77b9-4d25-8c99-079842bab8b9","Type":"ContainerDied","Data":"995a2a5c9d47c6a6d01b187b4c8f478ab22d76f26affc0776c50bf564c458249"}
Jul 02 20:45:19.978677 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.978394    2586 scope.go:117] "RemoveContainer" containerID="a1cbed20b506cad34945beaa64ed8b9bf54ba5eb10642d8aa1233f5a7a3462b3"
Jul 02 20:45:19.987416 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.987389    2586 scope.go:117] "RemoveContainer" containerID="a1cbed20b506cad34945beaa64ed8b9bf54ba5eb10642d8aa1233f5a7a3462b3"
Jul 02 20:45:19.987770 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:45:19.987745    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1cbed20b506cad34945beaa64ed8b9bf54ba5eb10642d8aa1233f5a7a3462b3\": container with ID starting with a1cbed20b506cad34945beaa64ed8b9bf54ba5eb10642d8aa1233f5a7a3462b3 not found: ID does not exist" containerID="a1cbed20b506cad34945beaa64ed8b9bf54ba5eb10642d8aa1233f5a7a3462b3"
Jul 02 20:45:19.987836 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.987780    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1cbed20b506cad34945beaa64ed8b9bf54ba5eb10642d8aa1233f5a7a3462b3"} err="failed to get container status \"a1cbed20b506cad34945beaa64ed8b9bf54ba5eb10642d8aa1233f5a7a3462b3\": rpc error: code = NotFound desc = could not find container \"a1cbed20b506cad34945beaa64ed8b9bf54ba5eb10642d8aa1233f5a7a3462b3\": container with ID starting with a1cbed20b506cad34945beaa64ed8b9bf54ba5eb10642d8aa1233f5a7a3462b3 not found: ID does not exist"
Jul 02 20:45:19.995426 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.995391    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dc556f97c-rmh4m"]
Jul 02 20:45:19.998777 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:19.998743    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7dc556f97c-rmh4m"]
Jul 02 20:45:20.793558 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:20.793522    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dc556f97c-92jqf"]
Jul 02 20:45:20.793930 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:20.793918    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad21b1dd-77b9-4d25-8c99-079842bab8b9" containerName="manager"
Jul 02 20:45:20.794030 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:20.793932    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad21b1dd-77b9-4d25-8c99-079842bab8b9" containerName="manager"
Jul 02 20:45:20.794030 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:20.793998    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad21b1dd-77b9-4d25-8c99-079842bab8b9" containerName="manager"
Jul 02 20:45:20.798619 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:20.798596    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc556f97c-92jqf"
Jul 02 20:45:20.802721 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:20.802691    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 20:45:20.802721 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:20.802692    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-42zhx\""
Jul 02 20:45:20.803054 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:20.802692    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 20:45:20.805617 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:20.805582    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dc556f97c-92jqf"]
Jul 02 20:45:20.896696 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:20.896658    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc182790-91ff-4305-baf1-13a7586999b8-webhook-cert\") pod \"maas-controller-7dc556f97c-92jqf\" (UID: \"dc182790-91ff-4305-baf1-13a7586999b8\") " pod="opendatahub/maas-controller-7dc556f97c-92jqf"
Jul 02 20:45:20.896874 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:20.896733    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvjfl\" (UniqueName: \"kubernetes.io/projected/dc182790-91ff-4305-baf1-13a7586999b8-kube-api-access-nvjfl\") pod \"maas-controller-7dc556f97c-92jqf\" (UID: \"dc182790-91ff-4305-baf1-13a7586999b8\") " pod="opendatahub/maas-controller-7dc556f97c-92jqf"
Jul 02 20:45:20.997278 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:20.997243    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvjfl\" (UniqueName: \"kubernetes.io/projected/dc182790-91ff-4305-baf1-13a7586999b8-kube-api-access-nvjfl\") pod \"maas-controller-7dc556f97c-92jqf\" (UID: \"dc182790-91ff-4305-baf1-13a7586999b8\") " pod="opendatahub/maas-controller-7dc556f97c-92jqf"
Jul 02 20:45:20.997675 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:20.997319    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc182790-91ff-4305-baf1-13a7586999b8-webhook-cert\") pod \"maas-controller-7dc556f97c-92jqf\" (UID: \"dc182790-91ff-4305-baf1-13a7586999b8\") " pod="opendatahub/maas-controller-7dc556f97c-92jqf"
Jul 02 20:45:20.999789 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:20.999763    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc182790-91ff-4305-baf1-13a7586999b8-webhook-cert\") pod \"maas-controller-7dc556f97c-92jqf\" (UID: \"dc182790-91ff-4305-baf1-13a7586999b8\") " pod="opendatahub/maas-controller-7dc556f97c-92jqf"
Jul 02 20:45:21.006106 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:21.006075    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvjfl\" (UniqueName: \"kubernetes.io/projected/dc182790-91ff-4305-baf1-13a7586999b8-kube-api-access-nvjfl\") pod \"maas-controller-7dc556f97c-92jqf\" (UID: \"dc182790-91ff-4305-baf1-13a7586999b8\") " pod="opendatahub/maas-controller-7dc556f97c-92jqf"
Jul 02 20:45:21.109862 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:21.109774    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc556f97c-92jqf"
Jul 02 20:45:21.254988 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:21.254955    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dc556f97c-92jqf"]
Jul 02 20:45:21.258618 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:45:21.258586    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc182790_91ff_4305_baf1_13a7586999b8.slice/crio-1312025ebb3a0c35228161008cc17d01f0011eaddbf4c1300814e6d55fcb2081 WatchSource:0}: Error finding container 1312025ebb3a0c35228161008cc17d01f0011eaddbf4c1300814e6d55fcb2081: Status 404 returned error can't find the container with id 1312025ebb3a0c35228161008cc17d01f0011eaddbf4c1300814e6d55fcb2081
Jul 02 20:45:21.494167 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:21.494080    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad21b1dd-77b9-4d25-8c99-079842bab8b9" path="/var/lib/kubelet/pods/ad21b1dd-77b9-4d25-8c99-079842bab8b9/volumes"
Jul 02 20:45:21.990276 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:21.990233    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc556f97c-92jqf" event={"ID":"dc182790-91ff-4305-baf1-13a7586999b8","Type":"ContainerStarted","Data":"141c4c0a8eb1c16f61caf8115d24b1cb12bfe254e8ea3d075cf95c271f78ae00"}
Jul 02 20:45:21.990452 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:21.990302    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc556f97c-92jqf" event={"ID":"dc182790-91ff-4305-baf1-13a7586999b8","Type":"ContainerStarted","Data":"1312025ebb3a0c35228161008cc17d01f0011eaddbf4c1300814e6d55fcb2081"}
Jul 02 20:45:21.990452 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:21.990353    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dc556f97c-92jqf"
Jul 02 20:45:22.008632 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:22.008581    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7dc556f97c-92jqf" podStartSLOduration=1.478274346 podStartE2EDuration="2.008564975s" totalImagesPullingTime="530.290629ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:45:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:45:22.008095101 +0000 UTC m=+745.131264134" watchObservedRunningTime="2026-07-02 20:45:22.008564975 +0000 UTC m=+745.131734011"
Jul 02 20:45:33.001608 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:45:33.001574    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dc556f97c-92jqf"
Jul 02 20:46:00.010823 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:00.010768    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv"]
Jul 02 20:46:00.011367 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:00.011083    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv" podUID="3fc079f4-f975-4d62-a1cc-6b45138ed11e" containerName="cleanup" containerID="cri-o://900c5a091b8e0a87192e2a1919c55c4e646a0a9e91c664fa162e2310f679f873" gracePeriod=30
Jul 02 20:46:30.197511 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:30.197481    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv"
Jul 02 20:46:30.328307 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:30.328271    2586 generic.go:356] "Generic (PLEG): container finished" podID="3fc079f4-f975-4d62-a1cc-6b45138ed11e" containerID="900c5a091b8e0a87192e2a1919c55c4e646a0a9e91c664fa162e2310f679f873" exitCode=137
Jul 02 20:46:30.328307 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:30.328314    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv"
Jul 02 20:46:30.328525 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:30.328360    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv" event={"ID":"3fc079f4-f975-4d62-a1cc-6b45138ed11e","Type":"ContainerDied","Data":"900c5a091b8e0a87192e2a1919c55c4e646a0a9e91c664fa162e2310f679f873"}
Jul 02 20:46:30.328525 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:30.328418    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv" event={"ID":"3fc079f4-f975-4d62-a1cc-6b45138ed11e","Type":"ContainerDied","Data":"f742b83872ec8bb345456cdb95b66ede2a218f3eb013aeaa7cae0dfb1dedd01f"}
Jul 02 20:46:30.328525 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:30.328444    2586 scope.go:117] "RemoveContainer" containerID="900c5a091b8e0a87192e2a1919c55c4e646a0a9e91c664fa162e2310f679f873"
Jul 02 20:46:30.337085 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:30.337062    2586 scope.go:117] "RemoveContainer" containerID="900c5a091b8e0a87192e2a1919c55c4e646a0a9e91c664fa162e2310f679f873"
Jul 02 20:46:30.337404 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:46:30.337382    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"900c5a091b8e0a87192e2a1919c55c4e646a0a9e91c664fa162e2310f679f873\": container with ID starting with 900c5a091b8e0a87192e2a1919c55c4e646a0a9e91c664fa162e2310f679f873 not found: ID does not exist" containerID="900c5a091b8e0a87192e2a1919c55c4e646a0a9e91c664fa162e2310f679f873"
Jul 02 20:46:30.337453 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:30.337416    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"900c5a091b8e0a87192e2a1919c55c4e646a0a9e91c664fa162e2310f679f873"} err="failed to get container status \"900c5a091b8e0a87192e2a1919c55c4e646a0a9e91c664fa162e2310f679f873\": rpc error: code = NotFound desc = could not find container \"900c5a091b8e0a87192e2a1919c55c4e646a0a9e91c664fa162e2310f679f873\": container with ID starting with 900c5a091b8e0a87192e2a1919c55c4e646a0a9e91c664fa162e2310f679f873 not found: ID does not exist"
Jul 02 20:46:30.342764 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:30.342736    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxvps\" (UniqueName: \"kubernetes.io/projected/3fc079f4-f975-4d62-a1cc-6b45138ed11e-kube-api-access-kxvps\") pod \"3fc079f4-f975-4d62-a1cc-6b45138ed11e\" (UID: \"3fc079f4-f975-4d62-a1cc-6b45138ed11e\") "
Jul 02 20:46:30.344979 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:30.344948    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc079f4-f975-4d62-a1cc-6b45138ed11e-kube-api-access-kxvps" (OuterVolumeSpecName: "kube-api-access-kxvps") pod "3fc079f4-f975-4d62-a1cc-6b45138ed11e" (UID: "3fc079f4-f975-4d62-a1cc-6b45138ed11e"). InnerVolumeSpecName "kube-api-access-kxvps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:46:30.444250 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:30.444210    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxvps\" (UniqueName: \"kubernetes.io/projected/3fc079f4-f975-4d62-a1cc-6b45138ed11e-kube-api-access-kxvps\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:46:30.650133 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:30.650094    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv"]
Jul 02 20:46:30.654620 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:30.654592    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717085-2bvzv"]
Jul 02 20:46:31.493748 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:46:31.493711    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fc079f4-f975-4d62-a1cc-6b45138ed11e" path="/var/lib/kubelet/pods/3fc079f4-f975-4d62-a1cc-6b45138ed11e/volumes"
Jul 02 20:47:57.364700 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:47:57.364624    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 20:47:57.366744 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:47:57.366718    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 20:47:57.368466 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:47:57.368438    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 20:47:57.369869 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:47:57.369847    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 20:52:57.395941 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:52:57.395909    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 20:52:57.398687 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:52:57.398664    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 20:52:57.398979 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:52:57.398961    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 20:52:57.401703 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:52:57.401676    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 20:57:17.895444 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:17.895406    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"]
Jul 02 20:57:17.895867 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:17.895805    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc079f4-f975-4d62-a1cc-6b45138ed11e" containerName="cleanup"
Jul 02 20:57:17.895867 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:17.895816    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc079f4-f975-4d62-a1cc-6b45138ed11e" containerName="cleanup"
Jul 02 20:57:17.895962 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:17.895894    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc079f4-f975-4d62-a1cc-6b45138ed11e" containerName="cleanup"
Jul 02 20:57:17.899011 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:17.898986    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:17.902963 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:17.902925    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-473c1531-serving-cert\""
Jul 02 20:57:17.914397 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:17.914362    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"]
Jul 02 20:57:18.017715 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:18.017670    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-openshift-service-ca\") pod \"maas-api-e2e-ait-473c1531-594c4764f5-bvl26\" (UID: \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:18.017931 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:18.017731    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rj9c\" (UniqueName: \"kubernetes.io/projected/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-kube-api-access-7rj9c\") pod \"maas-api-e2e-ait-473c1531-594c4764f5-bvl26\" (UID: \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:18.017931 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:18.017833    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-maas-api-tls\") pod \"maas-api-e2e-ait-473c1531-594c4764f5-bvl26\" (UID: \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:18.119037 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:18.118995    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-maas-api-tls\") pod \"maas-api-e2e-ait-473c1531-594c4764f5-bvl26\" (UID: \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:18.119227 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:57:18.119160    2586 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-serving-cert: secret "maas-api-e2e-ait-473c1531-serving-cert" not found
Jul 02 20:57:18.119227 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:18.119166    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-openshift-service-ca\") pod \"maas-api-e2e-ait-473c1531-594c4764f5-bvl26\" (UID: \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:18.119334 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:57:18.119236    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-maas-api-tls podName:89010514-ba7c-4b7f-b42e-f4ddbfd3bed9 nodeName:}" failed. No retries permitted until 2026-07-02 20:57:18.619215261 +0000 UTC m=+1461.742384272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-maas-api-tls") pod "maas-api-e2e-ait-473c1531-594c4764f5-bvl26" (UID: "89010514-ba7c-4b7f-b42e-f4ddbfd3bed9") : secret "maas-api-e2e-ait-473c1531-serving-cert" not found
Jul 02 20:57:18.119334 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:18.119312    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rj9c\" (UniqueName: \"kubernetes.io/projected/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-kube-api-access-7rj9c\") pod \"maas-api-e2e-ait-473c1531-594c4764f5-bvl26\" (UID: \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:18.119806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:18.119785    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-openshift-service-ca\") pod \"maas-api-e2e-ait-473c1531-594c4764f5-bvl26\" (UID: \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:18.133960 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:18.133916    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rj9c\" (UniqueName: \"kubernetes.io/projected/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-kube-api-access-7rj9c\") pod \"maas-api-e2e-ait-473c1531-594c4764f5-bvl26\" (UID: \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:18.624421 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:18.624379    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-maas-api-tls\") pod \"maas-api-e2e-ait-473c1531-594c4764f5-bvl26\" (UID: \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:18.627224 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:18.627190    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-maas-api-tls\") pod \"maas-api-e2e-ait-473c1531-594c4764f5-bvl26\" (UID: \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:18.810186 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:18.810142    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:18.980363 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:18.980334    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"]
Jul 02 20:57:18.983119 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:57:18.983090    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89010514_ba7c_4b7f_b42e_f4ddbfd3bed9.slice/crio-63a2162efd252b085d51cd9f973b4cb0d831d90bc997f006aca0990e88a531ec WatchSource:0}: Error finding container 63a2162efd252b085d51cd9f973b4cb0d831d90bc997f006aca0990e88a531ec: Status 404 returned error can't find the container with id 63a2162efd252b085d51cd9f973b4cb0d831d90bc997f006aca0990e88a531ec
Jul 02 20:57:18.984873 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:18.984849    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:57:19.477400 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:19.477367    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26" event={"ID":"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9","Type":"ContainerStarted","Data":"63a2162efd252b085d51cd9f973b4cb0d831d90bc997f006aca0990e88a531ec"}
Jul 02 20:57:20.483854 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:20.483811    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26" event={"ID":"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9","Type":"ContainerStarted","Data":"736ed1627afa6bf709a833e475d6ae074f0830549a1ea84cd657235fb79b6597"}
Jul 02 20:57:20.484265 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:20.483898    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:20.501275 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:20.501202    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26" podStartSLOduration=3.069101757 podStartE2EDuration="3.501182627s" totalImagesPullingTime="432.08087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:57:20.499873649 +0000 UTC m=+1463.623042706" watchObservedRunningTime="2026-07-02 20:57:20.501182627 +0000 UTC m=+1463.624351659"
Jul 02 20:57:23.208492 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.208450    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"]
Jul 02 20:57:23.209195 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.209165    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26" podUID="89010514-ba7c-4b7f-b42e-f4ddbfd3bed9" containerName="maas-api" containerID="cri-o://736ed1627afa6bf709a833e475d6ae074f0830549a1ea84cd657235fb79b6597" gracePeriod=30
Jul 02 20:57:23.461762 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.461685    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:23.470422 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.470395    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-maas-api-tls\") pod \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\" (UID: \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\") "
Jul 02 20:57:23.470497 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.470432    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rj9c\" (UniqueName: \"kubernetes.io/projected/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-kube-api-access-7rj9c\") pod \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\" (UID: \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\") "
Jul 02 20:57:23.470497 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.470474    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-openshift-service-ca\") pod \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\" (UID: \"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9\") "
Jul 02 20:57:23.470941 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.470911    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "89010514-ba7c-4b7f-b42e-f4ddbfd3bed9" (UID: "89010514-ba7c-4b7f-b42e-f4ddbfd3bed9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:57:23.472657 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.472633    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "89010514-ba7c-4b7f-b42e-f4ddbfd3bed9" (UID: "89010514-ba7c-4b7f-b42e-f4ddbfd3bed9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:57:23.472766 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.472684    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-kube-api-access-7rj9c" (OuterVolumeSpecName: "kube-api-access-7rj9c") pod "89010514-ba7c-4b7f-b42e-f4ddbfd3bed9" (UID: "89010514-ba7c-4b7f-b42e-f4ddbfd3bed9"). InnerVolumeSpecName "kube-api-access-7rj9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:57:23.503033 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.502999    2586 generic.go:356] "Generic (PLEG): container finished" podID="89010514-ba7c-4b7f-b42e-f4ddbfd3bed9" containerID="736ed1627afa6bf709a833e475d6ae074f0830549a1ea84cd657235fb79b6597" exitCode=0
Jul 02 20:57:23.503199 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.503064    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"
Jul 02 20:57:23.503199 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.503079    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26" event={"ID":"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9","Type":"ContainerDied","Data":"736ed1627afa6bf709a833e475d6ae074f0830549a1ea84cd657235fb79b6597"}
Jul 02 20:57:23.503199 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.503135    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26" event={"ID":"89010514-ba7c-4b7f-b42e-f4ddbfd3bed9","Type":"ContainerDied","Data":"63a2162efd252b085d51cd9f973b4cb0d831d90bc997f006aca0990e88a531ec"}
Jul 02 20:57:23.503199 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.503159    2586 scope.go:117] "RemoveContainer" containerID="736ed1627afa6bf709a833e475d6ae074f0830549a1ea84cd657235fb79b6597"
Jul 02 20:57:23.516423 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.516394    2586 scope.go:117] "RemoveContainer" containerID="736ed1627afa6bf709a833e475d6ae074f0830549a1ea84cd657235fb79b6597"
Jul 02 20:57:23.516786 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:57:23.516762    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"736ed1627afa6bf709a833e475d6ae074f0830549a1ea84cd657235fb79b6597\": container with ID starting with 736ed1627afa6bf709a833e475d6ae074f0830549a1ea84cd657235fb79b6597 not found: ID does not exist" containerID="736ed1627afa6bf709a833e475d6ae074f0830549a1ea84cd657235fb79b6597"
Jul 02 20:57:23.516860 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.516799    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"736ed1627afa6bf709a833e475d6ae074f0830549a1ea84cd657235fb79b6597"} err="failed to get container status \"736ed1627afa6bf709a833e475d6ae074f0830549a1ea84cd657235fb79b6597\": rpc error: code = NotFound desc = could not find container \"736ed1627afa6bf709a833e475d6ae074f0830549a1ea84cd657235fb79b6597\": container with ID starting with 736ed1627afa6bf709a833e475d6ae074f0830549a1ea84cd657235fb79b6597 not found: ID does not exist"
Jul 02 20:57:23.520976 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.520946    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"]
Jul 02 20:57:23.526644 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.526615    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-473c1531-594c4764f5-bvl26"]
Jul 02 20:57:23.572532 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.572502    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-maas-api-tls\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:57:23.572532 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.572531    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rj9c\" (UniqueName: \"kubernetes.io/projected/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-kube-api-access-7rj9c\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:57:23.572729 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:23.572546    2586 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9-openshift-service-ca\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:57:25.493414 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:25.493375    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89010514-ba7c-4b7f-b42e-f4ddbfd3bed9" path="/var/lib/kubelet/pods/89010514-ba7c-4b7f-b42e-f4ddbfd3bed9/volumes"
Jul 02 20:57:30.383950 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.383900    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"]
Jul 02 20:57:30.384490 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.384471    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89010514-ba7c-4b7f-b42e-f4ddbfd3bed9" containerName="maas-api"
Jul 02 20:57:30.384579 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.384494    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="89010514-ba7c-4b7f-b42e-f4ddbfd3bed9" containerName="maas-api"
Jul 02 20:57:30.384631 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.384599    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="89010514-ba7c-4b7f-b42e-f4ddbfd3bed9" containerName="maas-api"
Jul 02 20:57:30.387515 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.387489    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:30.390060 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.390030    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d9de6a34-serving-cert\""
Jul 02 20:57:30.399223 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.399198    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"]
Jul 02 20:57:30.434958 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.434916    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-openshift-service-ca\") pod \"maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq\" (UID: \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:30.435120 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.434969    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-maas-api-tls\") pod \"maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq\" (UID: \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:30.435120 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.435052    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5krxb\" (UniqueName: \"kubernetes.io/projected/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-kube-api-access-5krxb\") pod \"maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq\" (UID: \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:30.536303 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.536270    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-openshift-service-ca\") pod \"maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq\" (UID: \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:30.536459 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.536319    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-maas-api-tls\") pod \"maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq\" (UID: \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:30.536459 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.536359    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5krxb\" (UniqueName: \"kubernetes.io/projected/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-kube-api-access-5krxb\") pod \"maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq\" (UID: \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:30.536555 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:57:30.536505    2586 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-serving-cert: secret "maas-api-e2e-ait-d9de6a34-serving-cert" not found
Jul 02 20:57:30.536590 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:57:30.536567    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-maas-api-tls podName:767d1c4b-16a2-4e61-bc05-396b6bee2b9a nodeName:}" failed. No retries permitted until 2026-07-02 20:57:31.036550376 +0000 UTC m=+1474.159719391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-maas-api-tls") pod "maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq" (UID: "767d1c4b-16a2-4e61-bc05-396b6bee2b9a") : secret "maas-api-e2e-ait-d9de6a34-serving-cert" not found
Jul 02 20:57:30.537177 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.537153    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-openshift-service-ca\") pod \"maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq\" (UID: \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:30.550533 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:30.550496    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5krxb\" (UniqueName: \"kubernetes.io/projected/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-kube-api-access-5krxb\") pod \"maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq\" (UID: \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:31.041649 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:31.041616    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-maas-api-tls\") pod \"maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq\" (UID: \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:31.044223 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:31.044195    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-maas-api-tls\") pod \"maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq\" (UID: \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:31.298454 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:31.298360    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:31.446840 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:31.446810    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"]
Jul 02 20:57:31.449863 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:57:31.449834    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767d1c4b_16a2_4e61_bc05_396b6bee2b9a.slice/crio-4c4b52fa2bc6e89f4c2ea8f4eba5a94c4fb5e09ea3a75574c9eaa674fe661955 WatchSource:0}: Error finding container 4c4b52fa2bc6e89f4c2ea8f4eba5a94c4fb5e09ea3a75574c9eaa674fe661955: Status 404 returned error can't find the container with id 4c4b52fa2bc6e89f4c2ea8f4eba5a94c4fb5e09ea3a75574c9eaa674fe661955
Jul 02 20:57:31.547062 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:31.547016    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq" event={"ID":"767d1c4b-16a2-4e61-bc05-396b6bee2b9a","Type":"ContainerStarted","Data":"4c4b52fa2bc6e89f4c2ea8f4eba5a94c4fb5e09ea3a75574c9eaa674fe661955"}
Jul 02 20:57:32.553356 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:32.553318    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq" event={"ID":"767d1c4b-16a2-4e61-bc05-396b6bee2b9a","Type":"ContainerStarted","Data":"1d111cadb4272aa74799a49adda070df5b13dd9c5da76a4bbb88f04e68f91d88"}
Jul 02 20:57:32.553780 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:32.553452    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:32.574429 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:32.574365    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq" podStartSLOduration=2.249132689 podStartE2EDuration="2.574348789s" totalImagesPullingTime="325.2161ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:57:32.572230179 +0000 UTC m=+1475.695399238" watchObservedRunningTime="2026-07-02 20:57:32.574348789 +0000 UTC m=+1475.697517821"
Jul 02 20:57:35.738316 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:35.738273    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"]
Jul 02 20:57:35.738768 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:35.738540    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq" podUID="767d1c4b-16a2-4e61-bc05-396b6bee2b9a" containerName="maas-api" containerID="cri-o://1d111cadb4272aa74799a49adda070df5b13dd9c5da76a4bbb88f04e68f91d88" gracePeriod=30
Jul 02 20:57:35.997602 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:35.997531    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:36.093172 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.093133    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-openshift-service-ca\") pod \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\" (UID: \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\") "
Jul 02 20:57:36.093363 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.093216    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5krxb\" (UniqueName: \"kubernetes.io/projected/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-kube-api-access-5krxb\") pod \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\" (UID: \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\") "
Jul 02 20:57:36.093363 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.093284    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-maas-api-tls\") pod \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\" (UID: \"767d1c4b-16a2-4e61-bc05-396b6bee2b9a\") "
Jul 02 20:57:36.093598 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.093573    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "767d1c4b-16a2-4e61-bc05-396b6bee2b9a" (UID: "767d1c4b-16a2-4e61-bc05-396b6bee2b9a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:57:36.095412 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.095388    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-kube-api-access-5krxb" (OuterVolumeSpecName: "kube-api-access-5krxb") pod "767d1c4b-16a2-4e61-bc05-396b6bee2b9a" (UID: "767d1c4b-16a2-4e61-bc05-396b6bee2b9a"). InnerVolumeSpecName "kube-api-access-5krxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:57:36.095573 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.095551    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "767d1c4b-16a2-4e61-bc05-396b6bee2b9a" (UID: "767d1c4b-16a2-4e61-bc05-396b6bee2b9a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:57:36.194399 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.194340    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-maas-api-tls\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:57:36.194399 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.194393    2586 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-openshift-service-ca\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:57:36.194399 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.194407    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5krxb\" (UniqueName: \"kubernetes.io/projected/767d1c4b-16a2-4e61-bc05-396b6bee2b9a-kube-api-access-5krxb\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:57:36.574672 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.574639    2586 generic.go:356] "Generic (PLEG): container finished" podID="767d1c4b-16a2-4e61-bc05-396b6bee2b9a" containerID="1d111cadb4272aa74799a49adda070df5b13dd9c5da76a4bbb88f04e68f91d88" exitCode=0
Jul 02 20:57:36.574833 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.574686    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"
Jul 02 20:57:36.574833 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.574728    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq" event={"ID":"767d1c4b-16a2-4e61-bc05-396b6bee2b9a","Type":"ContainerDied","Data":"1d111cadb4272aa74799a49adda070df5b13dd9c5da76a4bbb88f04e68f91d88"}
Jul 02 20:57:36.574833 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.574779    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq" event={"ID":"767d1c4b-16a2-4e61-bc05-396b6bee2b9a","Type":"ContainerDied","Data":"4c4b52fa2bc6e89f4c2ea8f4eba5a94c4fb5e09ea3a75574c9eaa674fe661955"}
Jul 02 20:57:36.574833 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.574801    2586 scope.go:117] "RemoveContainer" containerID="1d111cadb4272aa74799a49adda070df5b13dd9c5da76a4bbb88f04e68f91d88"
Jul 02 20:57:36.584523 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.584502    2586 scope.go:117] "RemoveContainer" containerID="1d111cadb4272aa74799a49adda070df5b13dd9c5da76a4bbb88f04e68f91d88"
Jul 02 20:57:36.584821 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:57:36.584800    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d111cadb4272aa74799a49adda070df5b13dd9c5da76a4bbb88f04e68f91d88\": container with ID starting with 1d111cadb4272aa74799a49adda070df5b13dd9c5da76a4bbb88f04e68f91d88 not found: ID does not exist" containerID="1d111cadb4272aa74799a49adda070df5b13dd9c5da76a4bbb88f04e68f91d88"
Jul 02 20:57:36.584908 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.584830    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d111cadb4272aa74799a49adda070df5b13dd9c5da76a4bbb88f04e68f91d88"} err="failed to get container status \"1d111cadb4272aa74799a49adda070df5b13dd9c5da76a4bbb88f04e68f91d88\": rpc error: code = NotFound desc = could not find container \"1d111cadb4272aa74799a49adda070df5b13dd9c5da76a4bbb88f04e68f91d88\": container with ID starting with 1d111cadb4272aa74799a49adda070df5b13dd9c5da76a4bbb88f04e68f91d88 not found: ID does not exist"
Jul 02 20:57:36.598519 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.598488    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"]
Jul 02 20:57:36.602847 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:36.602817    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9de6a34-87bfbfd6b-229qq"]
Jul 02 20:57:37.493155 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:37.493123    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="767d1c4b-16a2-4e61-bc05-396b6bee2b9a" path="/var/lib/kubelet/pods/767d1c4b-16a2-4e61-bc05-396b6bee2b9a/volumes"
Jul 02 20:57:49.893417 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:49.893376    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"]
Jul 02 20:57:49.893840 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:49.893796    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="767d1c4b-16a2-4e61-bc05-396b6bee2b9a" containerName="maas-api"
Jul 02 20:57:49.893840 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:49.893808    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="767d1c4b-16a2-4e61-bc05-396b6bee2b9a" containerName="maas-api"
Jul 02 20:57:49.893943 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:49.893867    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="767d1c4b-16a2-4e61-bc05-396b6bee2b9a" containerName="maas-api"
Jul 02 20:57:49.898294 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:49.898271    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:49.900626 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:49.900596    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-95ac1704-serving-cert\""
Jul 02 20:57:49.907427 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:49.907401    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"]
Jul 02 20:57:50.027350 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:50.027309    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-openshift-service-ca\") pod \"maas-api-e2e-derive-95ac1704-775894bc77-d7vpn\" (UID: \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:50.027350 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:50.027344    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szlnl\" (UniqueName: \"kubernetes.io/projected/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-kube-api-access-szlnl\") pod \"maas-api-e2e-derive-95ac1704-775894bc77-d7vpn\" (UID: \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:50.027566 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:50.027438    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-maas-api-tls\") pod \"maas-api-e2e-derive-95ac1704-775894bc77-d7vpn\" (UID: \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:50.128808 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:50.128766    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-openshift-service-ca\") pod \"maas-api-e2e-derive-95ac1704-775894bc77-d7vpn\" (UID: \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:50.128808 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:50.128807    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szlnl\" (UniqueName: \"kubernetes.io/projected/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-kube-api-access-szlnl\") pod \"maas-api-e2e-derive-95ac1704-775894bc77-d7vpn\" (UID: \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:50.129036 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:50.128862    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-maas-api-tls\") pod \"maas-api-e2e-derive-95ac1704-775894bc77-d7vpn\" (UID: \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:50.129083 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:57:50.129032    2586 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-serving-cert: secret "maas-api-e2e-derive-95ac1704-serving-cert" not found
Jul 02 20:57:50.129119 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:57:50.129097    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-maas-api-tls podName:f6716133-63dc-4cf4-a50d-6a5e33acb4ad nodeName:}" failed. No retries permitted until 2026-07-02 20:57:50.629078057 +0000 UTC m=+1493.752247068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-maas-api-tls") pod "maas-api-e2e-derive-95ac1704-775894bc77-d7vpn" (UID: "f6716133-63dc-4cf4-a50d-6a5e33acb4ad") : secret "maas-api-e2e-derive-95ac1704-serving-cert" not found
Jul 02 20:57:50.129619 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:50.129594    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-openshift-service-ca\") pod \"maas-api-e2e-derive-95ac1704-775894bc77-d7vpn\" (UID: \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:50.139229 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:50.139195    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szlnl\" (UniqueName: \"kubernetes.io/projected/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-kube-api-access-szlnl\") pod \"maas-api-e2e-derive-95ac1704-775894bc77-d7vpn\" (UID: \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:50.632612 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:50.632568    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-maas-api-tls\") pod \"maas-api-e2e-derive-95ac1704-775894bc77-d7vpn\" (UID: \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:50.635162 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:50.635136    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-maas-api-tls\") pod \"maas-api-e2e-derive-95ac1704-775894bc77-d7vpn\" (UID: \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:50.810740 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:50.810703    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:50.960686 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:50.959384    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"]
Jul 02 20:57:51.651240 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:51.651132    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn" event={"ID":"f6716133-63dc-4cf4-a50d-6a5e33acb4ad","Type":"ContainerStarted","Data":"161ea9705da40973ee595749cfb0f3008e5d20e870727affbde4550c3ff7ff2d"}
Jul 02 20:57:51.651240 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:51.651207    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:51.651240 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:51.651227    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn" event={"ID":"f6716133-63dc-4cf4-a50d-6a5e33acb4ad","Type":"ContainerStarted","Data":"6f72cbe4fb49c33e53534438b0ea247e0ee73d3af9afa44ea40f8312103b8f4e"}
Jul 02 20:57:51.672148 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:51.672086    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn" podStartSLOduration=2.347989822 podStartE2EDuration="2.672068793s" totalImagesPullingTime="324.078971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:57:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:57:51.670023955 +0000 UTC m=+1494.793193030" watchObservedRunningTime="2026-07-02 20:57:51.672068793 +0000 UTC m=+1494.795237825"
Jul 02 20:57:54.490135 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:54.490078    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"]
Jul 02 20:57:54.490619 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:54.490359    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn" podUID="f6716133-63dc-4cf4-a50d-6a5e33acb4ad" containerName="maas-api" containerID="cri-o://161ea9705da40973ee595749cfb0f3008e5d20e870727affbde4550c3ff7ff2d" gracePeriod=30
Jul 02 20:57:54.669536 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:54.669506    2586 generic.go:356] "Generic (PLEG): container finished" podID="f6716133-63dc-4cf4-a50d-6a5e33acb4ad" containerID="161ea9705da40973ee595749cfb0f3008e5d20e870727affbde4550c3ff7ff2d" exitCode=0
Jul 02 20:57:54.669698 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:54.669558    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn" event={"ID":"f6716133-63dc-4cf4-a50d-6a5e33acb4ad","Type":"ContainerDied","Data":"161ea9705da40973ee595749cfb0f3008e5d20e870727affbde4550c3ff7ff2d"}
Jul 02 20:57:54.758128 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:54.758093    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:54.871431 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:54.871392    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-openshift-service-ca\") pod \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\" (UID: \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\") "
Jul 02 20:57:54.871595 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:54.871463    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szlnl\" (UniqueName: \"kubernetes.io/projected/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-kube-api-access-szlnl\") pod \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\" (UID: \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\") "
Jul 02 20:57:54.871595 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:54.871568    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-maas-api-tls\") pod \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\" (UID: \"f6716133-63dc-4cf4-a50d-6a5e33acb4ad\") "
Jul 02 20:57:54.871801 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:54.871779    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6716133-63dc-4cf4-a50d-6a5e33acb4ad" (UID: "f6716133-63dc-4cf4-a50d-6a5e33acb4ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:57:54.871984 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:54.871960    2586 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-openshift-service-ca\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:57:54.873548 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:54.873526    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-kube-api-access-szlnl" (OuterVolumeSpecName: "kube-api-access-szlnl") pod "f6716133-63dc-4cf4-a50d-6a5e33acb4ad" (UID: "f6716133-63dc-4cf4-a50d-6a5e33acb4ad"). InnerVolumeSpecName "kube-api-access-szlnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:57:54.873654 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:54.873634    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6716133-63dc-4cf4-a50d-6a5e33acb4ad" (UID: "f6716133-63dc-4cf4-a50d-6a5e33acb4ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:57:54.972806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:54.972765    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szlnl\" (UniqueName: \"kubernetes.io/projected/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-kube-api-access-szlnl\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:57:54.972806 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:54.972799    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6716133-63dc-4cf4-a50d-6a5e33acb4ad-maas-api-tls\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:57:55.675494 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:55.675458    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn" event={"ID":"f6716133-63dc-4cf4-a50d-6a5e33acb4ad","Type":"ContainerDied","Data":"6f72cbe4fb49c33e53534438b0ea247e0ee73d3af9afa44ea40f8312103b8f4e"}
Jul 02 20:57:55.675494 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:55.675490    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"
Jul 02 20:57:55.675992 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:55.675524    2586 scope.go:117] "RemoveContainer" containerID="161ea9705da40973ee595749cfb0f3008e5d20e870727affbde4550c3ff7ff2d"
Jul 02 20:57:55.711416 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:55.711374    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"]
Jul 02 20:57:55.718314 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:55.718281    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-95ac1704-775894bc77-d7vpn"]
Jul 02 20:57:57.425566 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:57.425538    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 20:57:57.428421 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:57.428397    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 20:57:57.429168 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:57.429146    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 20:57:57.432096 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:57.432074    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 20:57:57.493139 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:57:57.493102    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6716133-63dc-4cf4-a50d-6a5e33acb4ad" path="/var/lib/kubelet/pods/f6716133-63dc-4cf4-a50d-6a5e33acb4ad/volumes"
Jul 02 20:59:40.107550 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.107506    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"]
Jul 02 20:59:40.108083 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.107975    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6716133-63dc-4cf4-a50d-6a5e33acb4ad" containerName="maas-api"
Jul 02 20:59:40.108083 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.107990    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6716133-63dc-4cf4-a50d-6a5e33acb4ad" containerName="maas-api"
Jul 02 20:59:40.108083 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.108059    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6716133-63dc-4cf4-a50d-6a5e33acb4ad" containerName="maas-api"
Jul 02 20:59:40.110752 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.110734    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:40.113190 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.113158    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-27c57383-serving-cert\""
Jul 02 20:59:40.121699 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.121667    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"]
Jul 02 20:59:40.148185 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.148149    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-openshift-service-ca\") pod \"maas-api-e2e-mt-27c57383-5d744966f-w5f2g\" (UID: \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:40.148405 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.148215    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq6qd\" (UniqueName: \"kubernetes.io/projected/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-kube-api-access-gq6qd\") pod \"maas-api-e2e-mt-27c57383-5d744966f-w5f2g\" (UID: \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:40.148405 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.148297    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-maas-api-tls\") pod \"maas-api-e2e-mt-27c57383-5d744966f-w5f2g\" (UID: \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:40.249765 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.249718    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-maas-api-tls\") pod \"maas-api-e2e-mt-27c57383-5d744966f-w5f2g\" (UID: \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:40.249969 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.249778    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-openshift-service-ca\") pod \"maas-api-e2e-mt-27c57383-5d744966f-w5f2g\" (UID: \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:40.249969 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.249826    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq6qd\" (UniqueName: \"kubernetes.io/projected/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-kube-api-access-gq6qd\") pod \"maas-api-e2e-mt-27c57383-5d744966f-w5f2g\" (UID: \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:40.249969 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:59:40.249872    2586 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-serving-cert: secret "maas-api-e2e-mt-27c57383-serving-cert" not found
Jul 02 20:59:40.250088 ip-10-0-132-48 kubenswrapper[2586]: E0702 20:59:40.249970    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-maas-api-tls podName:a0bc37c2-0df2-483e-a1ea-0be2fca46b07 nodeName:}" failed. No retries permitted until 2026-07-02 20:59:40.74994847 +0000 UTC m=+1603.873117486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-maas-api-tls") pod "maas-api-e2e-mt-27c57383-5d744966f-w5f2g" (UID: "a0bc37c2-0df2-483e-a1ea-0be2fca46b07") : secret "maas-api-e2e-mt-27c57383-serving-cert" not found
Jul 02 20:59:40.250506 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.250486    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-openshift-service-ca\") pod \"maas-api-e2e-mt-27c57383-5d744966f-w5f2g\" (UID: \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:40.263827 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.263792    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq6qd\" (UniqueName: \"kubernetes.io/projected/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-kube-api-access-gq6qd\") pod \"maas-api-e2e-mt-27c57383-5d744966f-w5f2g\" (UID: \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:40.754480 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.754433    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-maas-api-tls\") pod \"maas-api-e2e-mt-27c57383-5d744966f-w5f2g\" (UID: \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:40.757304 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:40.757269    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-maas-api-tls\") pod \"maas-api-e2e-mt-27c57383-5d744966f-w5f2g\" (UID: \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:41.021719 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:41.021627    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:41.171116 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:41.171079    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"]
Jul 02 20:59:41.174037 ip-10-0-132-48 kubenswrapper[2586]: W0702 20:59:41.174001    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0bc37c2_0df2_483e_a1ea_0be2fca46b07.slice/crio-29e84b3061a20d53019c2eadca0f5beb3905be978547d2eefdda3c5dc7021187 WatchSource:0}: Error finding container 29e84b3061a20d53019c2eadca0f5beb3905be978547d2eefdda3c5dc7021187: Status 404 returned error can't find the container with id 29e84b3061a20d53019c2eadca0f5beb3905be978547d2eefdda3c5dc7021187
Jul 02 20:59:41.188978 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:41.188945    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g" event={"ID":"a0bc37c2-0df2-483e-a1ea-0be2fca46b07","Type":"ContainerStarted","Data":"29e84b3061a20d53019c2eadca0f5beb3905be978547d2eefdda3c5dc7021187"}
Jul 02 20:59:42.195306 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:42.195263    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g" event={"ID":"a0bc37c2-0df2-483e-a1ea-0be2fca46b07","Type":"ContainerStarted","Data":"d3a3cd24daeb9dd5b5430b293c539c292799a5f9c2a14ba1cddc097fa6eb979b"}
Jul 02 20:59:42.195794 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:42.195354    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:42.214323 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:42.214262    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g" podStartSLOduration=1.699303251 podStartE2EDuration="2.214243682s" totalImagesPullingTime="514.940431ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:59:42.213105602 +0000 UTC m=+1605.336274636" watchObservedRunningTime="2026-07-02 20:59:42.214243682 +0000 UTC m=+1605.337412716"
Jul 02 20:59:48.205692 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:48.205661    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:52.088752 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:52.088651    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"]
Jul 02 20:59:52.089239 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:52.088901    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g" podUID="a0bc37c2-0df2-483e-a1ea-0be2fca46b07" containerName="maas-api" containerID="cri-o://d3a3cd24daeb9dd5b5430b293c539c292799a5f9c2a14ba1cddc097fa6eb979b" gracePeriod=30
Jul 02 20:59:52.248452 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:52.248421    2586 generic.go:356] "Generic (PLEG): container finished" podID="a0bc37c2-0df2-483e-a1ea-0be2fca46b07" containerID="d3a3cd24daeb9dd5b5430b293c539c292799a5f9c2a14ba1cddc097fa6eb979b" exitCode=0
Jul 02 20:59:52.248615 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:52.248494    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g" event={"ID":"a0bc37c2-0df2-483e-a1ea-0be2fca46b07","Type":"ContainerDied","Data":"d3a3cd24daeb9dd5b5430b293c539c292799a5f9c2a14ba1cddc097fa6eb979b"}
Jul 02 20:59:52.350237 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:52.350162    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:52.457656 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:52.457617    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-openshift-service-ca\") pod \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\" (UID: \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\") "
Jul 02 20:59:52.457838 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:52.457677    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-maas-api-tls\") pod \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\" (UID: \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\") "
Jul 02 20:59:52.457838 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:52.457723    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq6qd\" (UniqueName: \"kubernetes.io/projected/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-kube-api-access-gq6qd\") pod \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\" (UID: \"a0bc37c2-0df2-483e-a1ea-0be2fca46b07\") "
Jul 02 20:59:52.458059 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:52.458032    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a0bc37c2-0df2-483e-a1ea-0be2fca46b07" (UID: "a0bc37c2-0df2-483e-a1ea-0be2fca46b07"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:59:52.459935 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:52.459904    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-kube-api-access-gq6qd" (OuterVolumeSpecName: "kube-api-access-gq6qd") pod "a0bc37c2-0df2-483e-a1ea-0be2fca46b07" (UID: "a0bc37c2-0df2-483e-a1ea-0be2fca46b07"). InnerVolumeSpecName "kube-api-access-gq6qd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:59:52.460056 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:52.459965    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a0bc37c2-0df2-483e-a1ea-0be2fca46b07" (UID: "a0bc37c2-0df2-483e-a1ea-0be2fca46b07"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:59:52.558532 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:52.558491    2586 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-openshift-service-ca\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:59:52.558532 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:52.558526    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-maas-api-tls\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:59:52.558532 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:52.558536    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq6qd\" (UniqueName: \"kubernetes.io/projected/a0bc37c2-0df2-483e-a1ea-0be2fca46b07-kube-api-access-gq6qd\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 20:59:53.254466 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:53.254436    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"
Jul 02 20:59:53.254955 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:53.254439    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g" event={"ID":"a0bc37c2-0df2-483e-a1ea-0be2fca46b07","Type":"ContainerDied","Data":"29e84b3061a20d53019c2eadca0f5beb3905be978547d2eefdda3c5dc7021187"}
Jul 02 20:59:53.254955 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:53.254577    2586 scope.go:117] "RemoveContainer" containerID="d3a3cd24daeb9dd5b5430b293c539c292799a5f9c2a14ba1cddc097fa6eb979b"
Jul 02 20:59:53.282429 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:53.282395    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"]
Jul 02 20:59:53.284075 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:53.284049    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-27c57383-5d744966f-w5f2g"]
Jul 02 20:59:53.495133 ip-10-0-132-48 kubenswrapper[2586]: I0702 20:59:53.495091    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0bc37c2-0df2-483e-a1ea-0be2fca46b07" path="/var/lib/kubelet/pods/a0bc37c2-0df2-483e-a1ea-0be2fca46b07/volumes"
Jul 02 21:00:00.135821 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:00.135780    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4"]
Jul 02 21:00:00.136353 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:00.136335    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0bc37c2-0df2-483e-a1ea-0be2fca46b07" containerName="maas-api"
Jul 02 21:00:00.136396 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:00.136355    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0bc37c2-0df2-483e-a1ea-0be2fca46b07" containerName="maas-api"
Jul 02 21:00:00.136435 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:00.136423    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0bc37c2-0df2-483e-a1ea-0be2fca46b07" containerName="maas-api"
Jul 02 21:00:00.139220 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:00.139202    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4"
Jul 02 21:00:00.146923 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:00.146871    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4"]
Jul 02 21:00:00.232457 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:00.232403    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbnp7\" (UniqueName: \"kubernetes.io/projected/b5d96573-9da0-40ef-9cdf-7e692c650c1a-kube-api-access-sbnp7\") pod \"maas-api-key-cleanup-29717100-hf9c4\" (UID: \"b5d96573-9da0-40ef-9cdf-7e692c650c1a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4"
Jul 02 21:00:00.333070 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:00.333009    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbnp7\" (UniqueName: \"kubernetes.io/projected/b5d96573-9da0-40ef-9cdf-7e692c650c1a-kube-api-access-sbnp7\") pod \"maas-api-key-cleanup-29717100-hf9c4\" (UID: \"b5d96573-9da0-40ef-9cdf-7e692c650c1a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4"
Jul 02 21:00:00.344126 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:00.344092    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbnp7\" (UniqueName: \"kubernetes.io/projected/b5d96573-9da0-40ef-9cdf-7e692c650c1a-kube-api-access-sbnp7\") pod \"maas-api-key-cleanup-29717100-hf9c4\" (UID: \"b5d96573-9da0-40ef-9cdf-7e692c650c1a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4"
Jul 02 21:00:00.450834 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:00.450722    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4"
Jul 02 21:00:00.598820 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:00.598787    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4"]
Jul 02 21:00:00.600902 ip-10-0-132-48 kubenswrapper[2586]: W0702 21:00:00.600851    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5d96573_9da0_40ef_9cdf_7e692c650c1a.slice/crio-fb77b62cc2bb5ac3c2611147142fefb7a072ac28fccb7515869be47d62d72306 WatchSource:0}: Error finding container fb77b62cc2bb5ac3c2611147142fefb7a072ac28fccb7515869be47d62d72306: Status 404 returned error can't find the container with id fb77b62cc2bb5ac3c2611147142fefb7a072ac28fccb7515869be47d62d72306
Jul 02 21:00:01.296106 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:01.296068    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4" event={"ID":"b5d96573-9da0-40ef-9cdf-7e692c650c1a","Type":"ContainerStarted","Data":"f329e171eb9d289aa31d15d7a38eaeee6c99bc48827c494fbb9c73a84f93b2eb"}
Jul 02 21:00:01.296488 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:01.296131    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4" event={"ID":"b5d96573-9da0-40ef-9cdf-7e692c650c1a","Type":"ContainerStarted","Data":"fb77b62cc2bb5ac3c2611147142fefb7a072ac28fccb7515869be47d62d72306"}
Jul 02 21:00:01.313230 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:01.313173    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4" podStartSLOduration=1.313149307 podStartE2EDuration="1.313149307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:00:01.31173478 +0000 UTC m=+1624.434903805" watchObservedRunningTime="2026-07-02 21:00:01.313149307 +0000 UTC m=+1624.436318373"
Jul 02 21:00:21.124530 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:21.124487    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"]
Jul 02 21:00:21.128388 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:21.128365    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:00:21.135669 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:21.135646    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7600a295-serving-cert\""
Jul 02 21:00:21.144484 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:21.144454    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"]
Jul 02 21:00:21.241532 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:21.241485    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e18a610-20a4-4a31-ab23-30257deb8242-openshift-service-ca\") pod \"maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb\" (UID: \"1e18a610-20a4-4a31-ab23-30257deb8242\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:00:21.241723 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:21.241590    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e18a610-20a4-4a31-ab23-30257deb8242-maas-api-tls\") pod \"maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb\" (UID: \"1e18a610-20a4-4a31-ab23-30257deb8242\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:00:21.241723 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:21.241632    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4zmx\" (UniqueName: \"kubernetes.io/projected/1e18a610-20a4-4a31-ab23-30257deb8242-kube-api-access-v4zmx\") pod \"maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb\" (UID: \"1e18a610-20a4-4a31-ab23-30257deb8242\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:00:21.342304 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:21.342248    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e18a610-20a4-4a31-ab23-30257deb8242-maas-api-tls\") pod \"maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb\" (UID: \"1e18a610-20a4-4a31-ab23-30257deb8242\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:00:21.342304 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:21.342308    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4zmx\" (UniqueName: \"kubernetes.io/projected/1e18a610-20a4-4a31-ab23-30257deb8242-kube-api-access-v4zmx\") pod \"maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb\" (UID: \"1e18a610-20a4-4a31-ab23-30257deb8242\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:00:21.342596 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:21.342378    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e18a610-20a4-4a31-ab23-30257deb8242-openshift-service-ca\") pod \"maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb\" (UID: \"1e18a610-20a4-4a31-ab23-30257deb8242\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:00:21.342596 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:00:21.342428    2586 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-serving-cert: secret "maas-api-e2e-mt-7600a295-serving-cert" not found
Jul 02 21:00:21.342596 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:00:21.342524    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e18a610-20a4-4a31-ab23-30257deb8242-maas-api-tls podName:1e18a610-20a4-4a31-ab23-30257deb8242 nodeName:}" failed. No retries permitted until 2026-07-02 21:00:21.842504922 +0000 UTC m=+1644.965673941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1e18a610-20a4-4a31-ab23-30257deb8242-maas-api-tls") pod "maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb" (UID: "1e18a610-20a4-4a31-ab23-30257deb8242") : secret "maas-api-e2e-mt-7600a295-serving-cert" not found
Jul 02 21:00:21.343010 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:21.342992    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e18a610-20a4-4a31-ab23-30257deb8242-openshift-service-ca\") pod \"maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb\" (UID: \"1e18a610-20a4-4a31-ab23-30257deb8242\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:00:21.352754 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:21.352728    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4zmx\" (UniqueName: \"kubernetes.io/projected/1e18a610-20a4-4a31-ab23-30257deb8242-kube-api-access-v4zmx\") pod \"maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb\" (UID: \"1e18a610-20a4-4a31-ab23-30257deb8242\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:00:21.846244 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:21.846202    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e18a610-20a4-4a31-ab23-30257deb8242-maas-api-tls\") pod \"maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb\" (UID: \"1e18a610-20a4-4a31-ab23-30257deb8242\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:00:21.848990 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:21.848961    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e18a610-20a4-4a31-ab23-30257deb8242-maas-api-tls\") pod \"maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb\" (UID: \"1e18a610-20a4-4a31-ab23-30257deb8242\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:00:22.038564 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:22.038513    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:00:22.189204 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:22.189178    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"]
Jul 02 21:00:22.191968 ip-10-0-132-48 kubenswrapper[2586]: W0702 21:00:22.191921    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e18a610_20a4_4a31_ab23_30257deb8242.slice/crio-defa05861ea23d2e0f87e4188ec43bd1bfab635445b3fd7626fecd1086e6bdd4 WatchSource:0}: Error finding container defa05861ea23d2e0f87e4188ec43bd1bfab635445b3fd7626fecd1086e6bdd4: Status 404 returned error can't find the container with id defa05861ea23d2e0f87e4188ec43bd1bfab635445b3fd7626fecd1086e6bdd4
Jul 02 21:00:22.397400 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:22.397315    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb" event={"ID":"1e18a610-20a4-4a31-ab23-30257deb8242","Type":"ContainerStarted","Data":"defa05861ea23d2e0f87e4188ec43bd1bfab635445b3fd7626fecd1086e6bdd4"}
Jul 02 21:00:23.403655 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:23.403615    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb" event={"ID":"1e18a610-20a4-4a31-ab23-30257deb8242","Type":"ContainerStarted","Data":"4d3cf3ebc1e3ab1fc2776d5eb8ff33c8e47f287b35f2ace057d1f6eb4b17fc89"}
Jul 02 21:00:23.404080 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:23.403737    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:00:23.420784 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:23.420725    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb" podStartSLOduration=1.752386156 podStartE2EDuration="2.420707919s" totalImagesPullingTime="668.321763ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:00:23.419649611 +0000 UTC m=+1646.542818673" watchObservedRunningTime="2026-07-02 21:00:23.420707919 +0000 UTC m=+1646.543876993"
Jul 02 21:00:29.414368 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:00:29.414337    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:01:00.010831 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:00.010787    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4"]
Jul 02 21:01:00.011374 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:00.011027    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4" podUID="b5d96573-9da0-40ef-9cdf-7e692c650c1a" containerName="cleanup" containerID="cri-o://f329e171eb9d289aa31d15d7a38eaeee6c99bc48827c494fbb9c73a84f93b2eb" gracePeriod=30
Jul 02 21:01:03.570991 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:03.570951    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"]
Jul 02 21:01:03.571496 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:03.571242    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb" podUID="1e18a610-20a4-4a31-ab23-30257deb8242" containerName="maas-api" containerID="cri-o://4d3cf3ebc1e3ab1fc2776d5eb8ff33c8e47f287b35f2ace057d1f6eb4b17fc89" gracePeriod=30
Jul 02 21:01:03.823182 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:03.823111    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:01:03.928386 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:03.928346    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4zmx\" (UniqueName: \"kubernetes.io/projected/1e18a610-20a4-4a31-ab23-30257deb8242-kube-api-access-v4zmx\") pod \"1e18a610-20a4-4a31-ab23-30257deb8242\" (UID: \"1e18a610-20a4-4a31-ab23-30257deb8242\") "
Jul 02 21:01:03.928578 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:03.928472    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e18a610-20a4-4a31-ab23-30257deb8242-maas-api-tls\") pod \"1e18a610-20a4-4a31-ab23-30257deb8242\" (UID: \"1e18a610-20a4-4a31-ab23-30257deb8242\") "
Jul 02 21:01:03.928578 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:03.928499    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e18a610-20a4-4a31-ab23-30257deb8242-openshift-service-ca\") pod \"1e18a610-20a4-4a31-ab23-30257deb8242\" (UID: \"1e18a610-20a4-4a31-ab23-30257deb8242\") "
Jul 02 21:01:03.928944 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:03.928911    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e18a610-20a4-4a31-ab23-30257deb8242-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e18a610-20a4-4a31-ab23-30257deb8242" (UID: "1e18a610-20a4-4a31-ab23-30257deb8242"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:01:03.930758 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:03.930725    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e18a610-20a4-4a31-ab23-30257deb8242-kube-api-access-v4zmx" (OuterVolumeSpecName: "kube-api-access-v4zmx") pod "1e18a610-20a4-4a31-ab23-30257deb8242" (UID: "1e18a610-20a4-4a31-ab23-30257deb8242"). InnerVolumeSpecName "kube-api-access-v4zmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:01:03.930868 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:03.930799    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e18a610-20a4-4a31-ab23-30257deb8242-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e18a610-20a4-4a31-ab23-30257deb8242" (UID: "1e18a610-20a4-4a31-ab23-30257deb8242"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:01:04.029346 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:04.029311    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4zmx\" (UniqueName: \"kubernetes.io/projected/1e18a610-20a4-4a31-ab23-30257deb8242-kube-api-access-v4zmx\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:01:04.029346 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:04.029339    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e18a610-20a4-4a31-ab23-30257deb8242-maas-api-tls\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:01:04.029346 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:04.029349    2586 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e18a610-20a4-4a31-ab23-30257deb8242-openshift-service-ca\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:01:04.617585 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:04.617547    2586 generic.go:356] "Generic (PLEG): container finished" podID="1e18a610-20a4-4a31-ab23-30257deb8242" containerID="4d3cf3ebc1e3ab1fc2776d5eb8ff33c8e47f287b35f2ace057d1f6eb4b17fc89" exitCode=0
Jul 02 21:01:04.618097 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:04.617597    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"
Jul 02 21:01:04.618097 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:04.617632    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb" event={"ID":"1e18a610-20a4-4a31-ab23-30257deb8242","Type":"ContainerDied","Data":"4d3cf3ebc1e3ab1fc2776d5eb8ff33c8e47f287b35f2ace057d1f6eb4b17fc89"}
Jul 02 21:01:04.618097 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:04.617690    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb" event={"ID":"1e18a610-20a4-4a31-ab23-30257deb8242","Type":"ContainerDied","Data":"defa05861ea23d2e0f87e4188ec43bd1bfab635445b3fd7626fecd1086e6bdd4"}
Jul 02 21:01:04.618097 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:04.617712    2586 scope.go:117] "RemoveContainer" containerID="4d3cf3ebc1e3ab1fc2776d5eb8ff33c8e47f287b35f2ace057d1f6eb4b17fc89"
Jul 02 21:01:04.627542 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:04.627521    2586 scope.go:117] "RemoveContainer" containerID="4d3cf3ebc1e3ab1fc2776d5eb8ff33c8e47f287b35f2ace057d1f6eb4b17fc89"
Jul 02 21:01:04.627930 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:01:04.627864    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d3cf3ebc1e3ab1fc2776d5eb8ff33c8e47f287b35f2ace057d1f6eb4b17fc89\": container with ID starting with 4d3cf3ebc1e3ab1fc2776d5eb8ff33c8e47f287b35f2ace057d1f6eb4b17fc89 not found: ID does not exist" containerID="4d3cf3ebc1e3ab1fc2776d5eb8ff33c8e47f287b35f2ace057d1f6eb4b17fc89"
Jul 02 21:01:04.628017 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:04.627940    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3cf3ebc1e3ab1fc2776d5eb8ff33c8e47f287b35f2ace057d1f6eb4b17fc89"} err="failed to get container status \"4d3cf3ebc1e3ab1fc2776d5eb8ff33c8e47f287b35f2ace057d1f6eb4b17fc89\": rpc error: code = NotFound desc = could not find container \"4d3cf3ebc1e3ab1fc2776d5eb8ff33c8e47f287b35f2ace057d1f6eb4b17fc89\": container with ID starting with 4d3cf3ebc1e3ab1fc2776d5eb8ff33c8e47f287b35f2ace057d1f6eb4b17fc89 not found: ID does not exist"
Jul 02 21:01:04.638677 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:04.638644    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"]
Jul 02 21:01:04.640992 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:04.640961    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7600a295-5c7477f7f7-w6wrb"]
Jul 02 21:01:05.494113 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:05.494077    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e18a610-20a4-4a31-ab23-30257deb8242" path="/var/lib/kubelet/pods/1e18a610-20a4-4a31-ab23-30257deb8242/volumes"
Jul 02 21:01:30.208368 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:30.208338    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4"
Jul 02 21:01:30.279254 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:30.279150    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbnp7\" (UniqueName: \"kubernetes.io/projected/b5d96573-9da0-40ef-9cdf-7e692c650c1a-kube-api-access-sbnp7\") pod \"b5d96573-9da0-40ef-9cdf-7e692c650c1a\" (UID: \"b5d96573-9da0-40ef-9cdf-7e692c650c1a\") "
Jul 02 21:01:30.281297 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:30.281269    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5d96573-9da0-40ef-9cdf-7e692c650c1a-kube-api-access-sbnp7" (OuterVolumeSpecName: "kube-api-access-sbnp7") pod "b5d96573-9da0-40ef-9cdf-7e692c650c1a" (UID: "b5d96573-9da0-40ef-9cdf-7e692c650c1a"). InnerVolumeSpecName "kube-api-access-sbnp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:01:30.380521 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:30.380477    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbnp7\" (UniqueName: \"kubernetes.io/projected/b5d96573-9da0-40ef-9cdf-7e692c650c1a-kube-api-access-sbnp7\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:01:30.746285 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:30.746252    2586 generic.go:356] "Generic (PLEG): container finished" podID="b5d96573-9da0-40ef-9cdf-7e692c650c1a" containerID="f329e171eb9d289aa31d15d7a38eaeee6c99bc48827c494fbb9c73a84f93b2eb" exitCode=137
Jul 02 21:01:30.746501 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:30.746306    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4"
Jul 02 21:01:30.746501 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:30.746333    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4" event={"ID":"b5d96573-9da0-40ef-9cdf-7e692c650c1a","Type":"ContainerDied","Data":"f329e171eb9d289aa31d15d7a38eaeee6c99bc48827c494fbb9c73a84f93b2eb"}
Jul 02 21:01:30.746501 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:30.746391    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4" event={"ID":"b5d96573-9da0-40ef-9cdf-7e692c650c1a","Type":"ContainerDied","Data":"fb77b62cc2bb5ac3c2611147142fefb7a072ac28fccb7515869be47d62d72306"}
Jul 02 21:01:30.746501 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:30.746422    2586 scope.go:117] "RemoveContainer" containerID="f329e171eb9d289aa31d15d7a38eaeee6c99bc48827c494fbb9c73a84f93b2eb"
Jul 02 21:01:30.755495 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:30.755475    2586 scope.go:117] "RemoveContainer" containerID="f329e171eb9d289aa31d15d7a38eaeee6c99bc48827c494fbb9c73a84f93b2eb"
Jul 02 21:01:30.755787 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:01:30.755768    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f329e171eb9d289aa31d15d7a38eaeee6c99bc48827c494fbb9c73a84f93b2eb\": container with ID starting with f329e171eb9d289aa31d15d7a38eaeee6c99bc48827c494fbb9c73a84f93b2eb not found: ID does not exist" containerID="f329e171eb9d289aa31d15d7a38eaeee6c99bc48827c494fbb9c73a84f93b2eb"
Jul 02 21:01:30.755836 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:30.755797    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f329e171eb9d289aa31d15d7a38eaeee6c99bc48827c494fbb9c73a84f93b2eb"} err="failed to get container status \"f329e171eb9d289aa31d15d7a38eaeee6c99bc48827c494fbb9c73a84f93b2eb\": rpc error: code = NotFound desc = could not find container \"f329e171eb9d289aa31d15d7a38eaeee6c99bc48827c494fbb9c73a84f93b2eb\": container with ID starting with f329e171eb9d289aa31d15d7a38eaeee6c99bc48827c494fbb9c73a84f93b2eb not found: ID does not exist"
Jul 02 21:01:30.768145 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:30.768113    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4"]
Jul 02 21:01:30.773601 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:30.773569    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29717100-hf9c4"]
Jul 02 21:01:31.493959 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:01:31.493929    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5d96573-9da0-40ef-9cdf-7e692c650c1a" path="/var/lib/kubelet/pods/b5d96573-9da0-40ef-9cdf-7e692c650c1a/volumes"
Jul 02 21:02:56.299051 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.299011    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"]
Jul 02 21:02:56.299625 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.299605    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d96573-9da0-40ef-9cdf-7e692c650c1a" containerName="cleanup"
Jul 02 21:02:56.299703 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.299628    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d96573-9da0-40ef-9cdf-7e692c650c1a" containerName="cleanup"
Jul 02 21:02:56.299703 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.299651    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e18a610-20a4-4a31-ab23-30257deb8242" containerName="maas-api"
Jul 02 21:02:56.299703 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.299660    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e18a610-20a4-4a31-ab23-30257deb8242" containerName="maas-api"
Jul 02 21:02:56.299850 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.299751    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e18a610-20a4-4a31-ab23-30257deb8242" containerName="maas-api"
Jul 02 21:02:56.299850 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.299766    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5d96573-9da0-40ef-9cdf-7e692c650c1a" containerName="cleanup"
Jul 02 21:02:56.302823 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.302798    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:02:56.305546 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.305518    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-c36b13-serving-cert\""
Jul 02 21:02:56.315581 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.315550    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"]
Jul 02 21:02:56.399742 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.399693    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w\" (UID: \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:02:56.399742 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.399739    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-maas-api-tls\") pod \"maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w\" (UID: \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:02:56.400003 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.399792    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dcrj\" (UniqueName: \"kubernetes.io/projected/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-kube-api-access-7dcrj\") pod \"maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w\" (UID: \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:02:56.501085 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.501051    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w\" (UID: \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:02:56.501085 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.501092    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-maas-api-tls\") pod \"maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w\" (UID: \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:02:56.501290 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.501129    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dcrj\" (UniqueName: \"kubernetes.io/projected/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-kube-api-access-7dcrj\") pod \"maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w\" (UID: \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:02:56.501731 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.501705    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w\" (UID: \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:02:56.503570 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.503542    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-maas-api-tls\") pod \"maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w\" (UID: \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:02:56.513177 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.513151    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dcrj\" (UniqueName: \"kubernetes.io/projected/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-kube-api-access-7dcrj\") pod \"maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w\" (UID: \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:02:56.614335 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.614230    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:02:56.763450 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.763412    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"]
Jul 02 21:02:56.766740 ip-10-0-132-48 kubenswrapper[2586]: W0702 21:02:56.766707    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1cba3e2_d09c_456b_9d7a_c39b5d078bdf.slice/crio-bf6da6f9da1d97ee88f3ca246e03a6d58e331111b504b44d0003fb6a968c7d97 WatchSource:0}: Error finding container bf6da6f9da1d97ee88f3ca246e03a6d58e331111b504b44d0003fb6a968c7d97: Status 404 returned error can't find the container with id bf6da6f9da1d97ee88f3ca246e03a6d58e331111b504b44d0003fb6a968c7d97
Jul 02 21:02:56.768219 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:56.768200    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 21:02:57.170454 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:57.170414    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w" event={"ID":"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf","Type":"ContainerStarted","Data":"bf6da6f9da1d97ee88f3ca246e03a6d58e331111b504b44d0003fb6a968c7d97"}
Jul 02 21:02:57.466376 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:57.466269    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 21:02:57.469588 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:57.469563    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 21:02:57.470744 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:57.470723    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 21:02:57.473972 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:57.473941    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 21:02:58.176936 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:58.176899    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w" event={"ID":"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf","Type":"ContainerStarted","Data":"3942cccaef3bbdb8158479d25e06a0f8a7f4b8ef86293af66abb806ff00be75b"}
Jul 02 21:02:58.177146 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:58.176976    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:02:58.194572 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:02:58.194496    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w" podStartSLOduration=1.768281883 podStartE2EDuration="2.194477066s" totalImagesPullingTime="426.195183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:02:58.193766691 +0000 UTC m=+1801.316935726" watchObservedRunningTime="2026-07-02 21:02:58.194477066 +0000 UTC m=+1801.317646102"
Jul 02 21:03:04.092030 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.091982    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"]
Jul 02 21:03:04.095771 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.095748    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:03:04.098798 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.098769    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-f407e7-serving-cert\""
Jul 02 21:03:04.112604 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.112574    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"]
Jul 02 21:03:04.188233 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.188197    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:03:04.274037 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.273994    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46fqb\" (UniqueName: \"kubernetes.io/projected/54d8f3ca-723d-4547-8274-072aeda24935-kube-api-access-46fqb\") pod \"maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp\" (UID: \"54d8f3ca-723d-4547-8274-072aeda24935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:03:04.274037 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.274044    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d8f3ca-723d-4547-8274-072aeda24935-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp\" (UID: \"54d8f3ca-723d-4547-8274-072aeda24935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:03:04.274246 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.274176    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54d8f3ca-723d-4547-8274-072aeda24935-maas-api-tls\") pod \"maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp\" (UID: \"54d8f3ca-723d-4547-8274-072aeda24935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:03:04.375692 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.375591    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d8f3ca-723d-4547-8274-072aeda24935-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp\" (UID: \"54d8f3ca-723d-4547-8274-072aeda24935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:03:04.375850 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.375706    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54d8f3ca-723d-4547-8274-072aeda24935-maas-api-tls\") pod \"maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp\" (UID: \"54d8f3ca-723d-4547-8274-072aeda24935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:03:04.375850 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.375775    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46fqb\" (UniqueName: \"kubernetes.io/projected/54d8f3ca-723d-4547-8274-072aeda24935-kube-api-access-46fqb\") pod \"maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp\" (UID: \"54d8f3ca-723d-4547-8274-072aeda24935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:03:04.376369 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.376341    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d8f3ca-723d-4547-8274-072aeda24935-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp\" (UID: \"54d8f3ca-723d-4547-8274-072aeda24935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:03:04.378418 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.378392    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54d8f3ca-723d-4547-8274-072aeda24935-maas-api-tls\") pod \"maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp\" (UID: \"54d8f3ca-723d-4547-8274-072aeda24935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:03:04.384453 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.384424    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46fqb\" (UniqueName: \"kubernetes.io/projected/54d8f3ca-723d-4547-8274-072aeda24935-kube-api-access-46fqb\") pod \"maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp\" (UID: \"54d8f3ca-723d-4547-8274-072aeda24935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:03:04.407380 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.407329    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:03:04.555372 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:04.555346    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"]
Jul 02 21:03:04.558259 ip-10-0-132-48 kubenswrapper[2586]: W0702 21:03:04.558228    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d8f3ca_723d_4547_8274_072aeda24935.slice/crio-d7e1cd111b9ec4567d550be0e8924c9149ce96a042c3e5d5f7032089cf84a2db WatchSource:0}: Error finding container d7e1cd111b9ec4567d550be0e8924c9149ce96a042c3e5d5f7032089cf84a2db: Status 404 returned error can't find the container with id d7e1cd111b9ec4567d550be0e8924c9149ce96a042c3e5d5f7032089cf84a2db
Jul 02 21:03:05.212944 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:05.212822    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp" event={"ID":"54d8f3ca-723d-4547-8274-072aeda24935","Type":"ContainerStarted","Data":"01dadf0b66a22949a4a84ce5e907afbd4d3c7d03f22940487861bca6645e4c0a"}
Jul 02 21:03:05.212944 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:05.212914    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:03:05.212944 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:05.212939    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp" event={"ID":"54d8f3ca-723d-4547-8274-072aeda24935","Type":"ContainerStarted","Data":"d7e1cd111b9ec4567d550be0e8924c9149ce96a042c3e5d5f7032089cf84a2db"}
Jul 02 21:03:05.230652 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:05.230597    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp" podStartSLOduration=0.912164317 podStartE2EDuration="1.230577334s" totalImagesPullingTime="318.413017ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:03:05.22965931 +0000 UTC m=+1808.352828366" watchObservedRunningTime="2026-07-02 21:03:05.230577334 +0000 UTC m=+1808.353746367"
Jul 02 21:03:11.223386 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:11.223354    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:03:40.094348 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.094309    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"]
Jul 02 21:03:40.098063 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.098036    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.101359 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.101325    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f407e7\"/\"default-dockercfg-h826w\""
Jul 02 21:03:40.101992 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.101971    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f407e7\"/\"openshift-service-ca.crt\""
Jul 02 21:03:40.102360 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.102341    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f407e7\"/\"test-model-f407e7-kserve-self-signed-certs\""
Jul 02 21:03:40.102452 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.102385    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f407e7\"/\"kube-root-ca.crt\""
Jul 02 21:03:40.110344 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.110312    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"]
Jul 02 21:03:40.193048 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.193006    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf84h\" (UniqueName: \"kubernetes.io/projected/931ef151-509f-4a41-b246-648f432aaab6-kube-api-access-xf84h\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.193048 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.193053    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-model-cache\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.193357 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.193108    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/931ef151-509f-4a41-b246-648f432aaab6-tls-certs\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.193357 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.193200    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-tmp-dir\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.193357 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.193220    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-home\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.193357 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.193239    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-dshm\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.294302 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.294257    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/931ef151-509f-4a41-b246-648f432aaab6-tls-certs\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.294493 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.294365    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-tmp-dir\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.294493 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.294390    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-home\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.294493 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.294408    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-dshm\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.294493 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.294437    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf84h\" (UniqueName: \"kubernetes.io/projected/931ef151-509f-4a41-b246-648f432aaab6-kube-api-access-xf84h\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.294493 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.294466    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-model-cache\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.294931 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.294864    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-home\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.294931 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.294915    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-model-cache\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.295107 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.294961    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-tmp-dir\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.296765 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.296744    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-dshm\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.296936 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.296918    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/931ef151-509f-4a41-b246-648f432aaab6-tls-certs\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.306989 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.306954    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf84h\" (UniqueName: \"kubernetes.io/projected/931ef151-509f-4a41-b246-648f432aaab6-kube-api-access-xf84h\") pod \"test-model-f407e7-kserve-cdb7b7f9f-fg4kj\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") " pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.409648 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.409552    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:40.558284 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:40.558237    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"]
Jul 02 21:03:40.561306 ip-10-0-132-48 kubenswrapper[2586]: W0702 21:03:40.561280    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod931ef151_509f_4a41_b246_648f432aaab6.slice/crio-d2cc08e00dd89745165fa23549904d161031b45e607619d38f74ffbe5c7accd5 WatchSource:0}: Error finding container d2cc08e00dd89745165fa23549904d161031b45e607619d38f74ffbe5c7accd5: Status 404 returned error can't find the container with id d2cc08e00dd89745165fa23549904d161031b45e607619d38f74ffbe5c7accd5
Jul 02 21:03:41.391100 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:41.391060    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj" event={"ID":"931ef151-509f-4a41-b246-648f432aaab6","Type":"ContainerStarted","Data":"e0e7fb5fe6f556156c8d4c93dee1e320c037d29d70ad12dd630a72f3dbcc8fc3"}
Jul 02 21:03:41.391488 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:41.391112    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj" event={"ID":"931ef151-509f-4a41-b246-648f432aaab6","Type":"ContainerStarted","Data":"d2cc08e00dd89745165fa23549904d161031b45e607619d38f74ffbe5c7accd5"}
Jul 02 21:03:41.414594 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:41.414540    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj" podStartSLOduration=1.41452194 podStartE2EDuration="1.41452194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:03:41.411638025 +0000 UTC m=+1844.534807059" watchObservedRunningTime="2026-07-02 21:03:41.41452194 +0000 UTC m=+1844.537690972"
Jul 02 21:03:50.410596 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:50.410530    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:50.410596 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:50.410612    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:50.423304 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:50.423274    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:03:50.448392 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:03:50.448359    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:04:08.282022 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:08.281982    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"]
Jul 02 21:04:09.233301 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.233260    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"]
Jul 02 21:04:09.233566 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.233535    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w" podUID="e1cba3e2-d09c-456b-9d7a-c39b5d078bdf" containerName="maas-api" containerID="cri-o://3942cccaef3bbdb8158479d25e06a0f8a7f4b8ef86293af66abb806ff00be75b" gracePeriod=30
Jul 02 21:04:09.491717 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.491638    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:04:09.535295 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.535257    2586 generic.go:356] "Generic (PLEG): container finished" podID="e1cba3e2-d09c-456b-9d7a-c39b5d078bdf" containerID="3942cccaef3bbdb8158479d25e06a0f8a7f4b8ef86293af66abb806ff00be75b" exitCode=0
Jul 02 21:04:09.535519 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.535302    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w" event={"ID":"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf","Type":"ContainerDied","Data":"3942cccaef3bbdb8158479d25e06a0f8a7f4b8ef86293af66abb806ff00be75b"}
Jul 02 21:04:09.535519 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.535346    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w" event={"ID":"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf","Type":"ContainerDied","Data":"bf6da6f9da1d97ee88f3ca246e03a6d58e331111b504b44d0003fb6a968c7d97"}
Jul 02 21:04:09.535519 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.535369    2586 scope.go:117] "RemoveContainer" containerID="3942cccaef3bbdb8158479d25e06a0f8a7f4b8ef86293af66abb806ff00be75b"
Jul 02 21:04:09.535519 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.535307    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"
Jul 02 21:04:09.544143 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.544117    2586 scope.go:117] "RemoveContainer" containerID="3942cccaef3bbdb8158479d25e06a0f8a7f4b8ef86293af66abb806ff00be75b"
Jul 02 21:04:09.544444 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:04:09.544421    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3942cccaef3bbdb8158479d25e06a0f8a7f4b8ef86293af66abb806ff00be75b\": container with ID starting with 3942cccaef3bbdb8158479d25e06a0f8a7f4b8ef86293af66abb806ff00be75b not found: ID does not exist" containerID="3942cccaef3bbdb8158479d25e06a0f8a7f4b8ef86293af66abb806ff00be75b"
Jul 02 21:04:09.544534 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.544459    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3942cccaef3bbdb8158479d25e06a0f8a7f4b8ef86293af66abb806ff00be75b"} err="failed to get container status \"3942cccaef3bbdb8158479d25e06a0f8a7f4b8ef86293af66abb806ff00be75b\": rpc error: code = NotFound desc = could not find container \"3942cccaef3bbdb8158479d25e06a0f8a7f4b8ef86293af66abb806ff00be75b\": container with ID starting with 3942cccaef3bbdb8158479d25e06a0f8a7f4b8ef86293af66abb806ff00be75b not found: ID does not exist"
Jul 02 21:04:09.579980 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.579941    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-maas-api-tls\") pod \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\" (UID: \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\") "
Jul 02 21:04:09.580177 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.580032    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-openshift-service-ca\") pod \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\" (UID: \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\") "
Jul 02 21:04:09.580177 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.580102    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dcrj\" (UniqueName: \"kubernetes.io/projected/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-kube-api-access-7dcrj\") pod \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\" (UID: \"e1cba3e2-d09c-456b-9d7a-c39b5d078bdf\") "
Jul 02 21:04:09.580433 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.580407    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e1cba3e2-d09c-456b-9d7a-c39b5d078bdf" (UID: "e1cba3e2-d09c-456b-9d7a-c39b5d078bdf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:04:09.582248 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.582217    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e1cba3e2-d09c-456b-9d7a-c39b5d078bdf" (UID: "e1cba3e2-d09c-456b-9d7a-c39b5d078bdf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:04:09.582372 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.582289    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-kube-api-access-7dcrj" (OuterVolumeSpecName: "kube-api-access-7dcrj") pod "e1cba3e2-d09c-456b-9d7a-c39b5d078bdf" (UID: "e1cba3e2-d09c-456b-9d7a-c39b5d078bdf"). InnerVolumeSpecName "kube-api-access-7dcrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:04:09.680922 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.680864    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-maas-api-tls\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:04:09.680922 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.680915    2586 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-openshift-service-ca\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:04:09.681126 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.680933    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dcrj\" (UniqueName: \"kubernetes.io/projected/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf-kube-api-access-7dcrj\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:04:09.857164 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.857126    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"]
Jul 02 21:04:09.864474 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:09.864433    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c36b13-5bfc6784c7-dqj2w"]
Jul 02 21:04:11.493230 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:11.493185    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1cba3e2-d09c-456b-9d7a-c39b5d078bdf" path="/var/lib/kubelet/pods/e1cba3e2-d09c-456b-9d7a-c39b5d078bdf/volumes"
Jul 02 21:04:23.303185 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.303094    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj" podUID="931ef151-509f-4a41-b246-648f432aaab6" containerName="main" containerID="cri-o://e0e7fb5fe6f556156c8d4c93dee1e320c037d29d70ad12dd630a72f3dbcc8fc3" gracePeriod=45
Jul 02 21:04:23.568288 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.568209    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:04:23.605833 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.605795    2586 generic.go:356] "Generic (PLEG): container finished" podID="931ef151-509f-4a41-b246-648f432aaab6" containerID="e0e7fb5fe6f556156c8d4c93dee1e320c037d29d70ad12dd630a72f3dbcc8fc3" exitCode=0
Jul 02 21:04:23.606044 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.605830    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj" event={"ID":"931ef151-509f-4a41-b246-648f432aaab6","Type":"ContainerDied","Data":"e0e7fb5fe6f556156c8d4c93dee1e320c037d29d70ad12dd630a72f3dbcc8fc3"}
Jul 02 21:04:23.606044 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.605841    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"
Jul 02 21:04:23.606044 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.605910    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj" event={"ID":"931ef151-509f-4a41-b246-648f432aaab6","Type":"ContainerDied","Data":"d2cc08e00dd89745165fa23549904d161031b45e607619d38f74ffbe5c7accd5"}
Jul 02 21:04:23.606044 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.605934    2586 scope.go:117] "RemoveContainer" containerID="e0e7fb5fe6f556156c8d4c93dee1e320c037d29d70ad12dd630a72f3dbcc8fc3"
Jul 02 21:04:23.622863 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.622833    2586 scope.go:117] "RemoveContainer" containerID="e0e7fb5fe6f556156c8d4c93dee1e320c037d29d70ad12dd630a72f3dbcc8fc3"
Jul 02 21:04:23.623403 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:04:23.623372    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0e7fb5fe6f556156c8d4c93dee1e320c037d29d70ad12dd630a72f3dbcc8fc3\": container with ID starting with e0e7fb5fe6f556156c8d4c93dee1e320c037d29d70ad12dd630a72f3dbcc8fc3 not found: ID does not exist" containerID="e0e7fb5fe6f556156c8d4c93dee1e320c037d29d70ad12dd630a72f3dbcc8fc3"
Jul 02 21:04:23.623505 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.623416    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e7fb5fe6f556156c8d4c93dee1e320c037d29d70ad12dd630a72f3dbcc8fc3"} err="failed to get container status \"e0e7fb5fe6f556156c8d4c93dee1e320c037d29d70ad12dd630a72f3dbcc8fc3\": rpc error: code = NotFound desc = could not find container \"e0e7fb5fe6f556156c8d4c93dee1e320c037d29d70ad12dd630a72f3dbcc8fc3\": container with ID starting with e0e7fb5fe6f556156c8d4c93dee1e320c037d29d70ad12dd630a72f3dbcc8fc3 not found: ID does not exist"
Jul 02 21:04:23.709265 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.709222    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/931ef151-509f-4a41-b246-648f432aaab6-tls-certs\") pod \"931ef151-509f-4a41-b246-648f432aaab6\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") "
Jul 02 21:04:23.709493 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.709280    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-tmp-dir\") pod \"931ef151-509f-4a41-b246-648f432aaab6\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") "
Jul 02 21:04:23.709493 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.709310    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-home\") pod \"931ef151-509f-4a41-b246-648f432aaab6\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") "
Jul 02 21:04:23.709493 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.709343    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-model-cache\") pod \"931ef151-509f-4a41-b246-648f432aaab6\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") "
Jul 02 21:04:23.709493 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.709399    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-dshm\") pod \"931ef151-509f-4a41-b246-648f432aaab6\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") "
Jul 02 21:04:23.709493 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.709436    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf84h\" (UniqueName: \"kubernetes.io/projected/931ef151-509f-4a41-b246-648f432aaab6-kube-api-access-xf84h\") pod \"931ef151-509f-4a41-b246-648f432aaab6\" (UID: \"931ef151-509f-4a41-b246-648f432aaab6\") "
Jul 02 21:04:23.709822 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.709586    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-home" (OuterVolumeSpecName: "home") pod "931ef151-509f-4a41-b246-648f432aaab6" (UID: "931ef151-509f-4a41-b246-648f432aaab6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:04:23.709822 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.709686    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-model-cache" (OuterVolumeSpecName: "model-cache") pod "931ef151-509f-4a41-b246-648f432aaab6" (UID: "931ef151-509f-4a41-b246-648f432aaab6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:04:23.709822 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.709796    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-home\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:04:23.709822 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.709817    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-model-cache\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:04:23.710069 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.709920    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "931ef151-509f-4a41-b246-648f432aaab6" (UID: "931ef151-509f-4a41-b246-648f432aaab6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:04:23.711793 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.711750    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/931ef151-509f-4a41-b246-648f432aaab6-kube-api-access-xf84h" (OuterVolumeSpecName: "kube-api-access-xf84h") pod "931ef151-509f-4a41-b246-648f432aaab6" (UID: "931ef151-509f-4a41-b246-648f432aaab6"). InnerVolumeSpecName "kube-api-access-xf84h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:04:23.711793 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.711778    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/931ef151-509f-4a41-b246-648f432aaab6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "931ef151-509f-4a41-b246-648f432aaab6" (UID: "931ef151-509f-4a41-b246-648f432aaab6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:04:23.711955 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.711810    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-dshm" (OuterVolumeSpecName: "dshm") pod "931ef151-509f-4a41-b246-648f432aaab6" (UID: "931ef151-509f-4a41-b246-648f432aaab6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:04:23.811154 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.811105    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/931ef151-509f-4a41-b246-648f432aaab6-tls-certs\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:04:23.811154 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.811150    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-tmp-dir\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:04:23.811154 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.811163    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/931ef151-509f-4a41-b246-648f432aaab6-dshm\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:04:23.811468 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.811177    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf84h\" (UniqueName: \"kubernetes.io/projected/931ef151-509f-4a41-b246-648f432aaab6-kube-api-access-xf84h\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:04:23.927618 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.927584    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"]
Jul 02 21:04:23.934265 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:23.934228    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-f407e7/test-model-f407e7-kserve-cdb7b7f9f-fg4kj"]
Jul 02 21:04:25.494062 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:25.494021    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="931ef151-509f-4a41-b246-648f432aaab6" path="/var/lib/kubelet/pods/931ef151-509f-4a41-b246-648f432aaab6/volumes"
Jul 02 21:04:52.170784 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.170751    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"]
Jul 02 21:04:52.171331 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.171082    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp" podUID="54d8f3ca-723d-4547-8274-072aeda24935" containerName="maas-api" containerID="cri-o://01dadf0b66a22949a4a84ce5e907afbd4d3c7d03f22940487861bca6645e4c0a" gracePeriod=30
Jul 02 21:04:52.431386 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.431305    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:04:52.479491 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.479450    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46fqb\" (UniqueName: \"kubernetes.io/projected/54d8f3ca-723d-4547-8274-072aeda24935-kube-api-access-46fqb\") pod \"54d8f3ca-723d-4547-8274-072aeda24935\" (UID: \"54d8f3ca-723d-4547-8274-072aeda24935\") "
Jul 02 21:04:52.479687 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.479508    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d8f3ca-723d-4547-8274-072aeda24935-openshift-service-ca\") pod \"54d8f3ca-723d-4547-8274-072aeda24935\" (UID: \"54d8f3ca-723d-4547-8274-072aeda24935\") "
Jul 02 21:04:52.479687 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.479576    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54d8f3ca-723d-4547-8274-072aeda24935-maas-api-tls\") pod \"54d8f3ca-723d-4547-8274-072aeda24935\" (UID: \"54d8f3ca-723d-4547-8274-072aeda24935\") "
Jul 02 21:04:52.480014 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.479981    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54d8f3ca-723d-4547-8274-072aeda24935-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "54d8f3ca-723d-4547-8274-072aeda24935" (UID: "54d8f3ca-723d-4547-8274-072aeda24935"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:04:52.481682 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.481646    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54d8f3ca-723d-4547-8274-072aeda24935-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "54d8f3ca-723d-4547-8274-072aeda24935" (UID: "54d8f3ca-723d-4547-8274-072aeda24935"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:04:52.481782 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.481646    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54d8f3ca-723d-4547-8274-072aeda24935-kube-api-access-46fqb" (OuterVolumeSpecName: "kube-api-access-46fqb") pod "54d8f3ca-723d-4547-8274-072aeda24935" (UID: "54d8f3ca-723d-4547-8274-072aeda24935"). InnerVolumeSpecName "kube-api-access-46fqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:04:52.580773 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.580712    2586 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d8f3ca-723d-4547-8274-072aeda24935-openshift-service-ca\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:04:52.580773 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.580768    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54d8f3ca-723d-4547-8274-072aeda24935-maas-api-tls\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:04:52.580773 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.580778    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46fqb\" (UniqueName: \"kubernetes.io/projected/54d8f3ca-723d-4547-8274-072aeda24935-kube-api-access-46fqb\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:04:52.750226 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.750143    2586 generic.go:356] "Generic (PLEG): container finished" podID="54d8f3ca-723d-4547-8274-072aeda24935" containerID="01dadf0b66a22949a4a84ce5e907afbd4d3c7d03f22940487861bca6645e4c0a" exitCode=0
Jul 02 21:04:52.750226 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.750191    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"
Jul 02 21:04:52.750418 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.750226    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp" event={"ID":"54d8f3ca-723d-4547-8274-072aeda24935","Type":"ContainerDied","Data":"01dadf0b66a22949a4a84ce5e907afbd4d3c7d03f22940487861bca6645e4c0a"}
Jul 02 21:04:52.750418 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.750284    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp" event={"ID":"54d8f3ca-723d-4547-8274-072aeda24935","Type":"ContainerDied","Data":"d7e1cd111b9ec4567d550be0e8924c9149ce96a042c3e5d5f7032089cf84a2db"}
Jul 02 21:04:52.750418 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.750308    2586 scope.go:117] "RemoveContainer" containerID="01dadf0b66a22949a4a84ce5e907afbd4d3c7d03f22940487861bca6645e4c0a"
Jul 02 21:04:52.760023 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.760002    2586 scope.go:117] "RemoveContainer" containerID="01dadf0b66a22949a4a84ce5e907afbd4d3c7d03f22940487861bca6645e4c0a"
Jul 02 21:04:52.760312 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:04:52.760295    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01dadf0b66a22949a4a84ce5e907afbd4d3c7d03f22940487861bca6645e4c0a\": container with ID starting with 01dadf0b66a22949a4a84ce5e907afbd4d3c7d03f22940487861bca6645e4c0a not found: ID does not exist" containerID="01dadf0b66a22949a4a84ce5e907afbd4d3c7d03f22940487861bca6645e4c0a"
Jul 02 21:04:52.760382 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.760326    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01dadf0b66a22949a4a84ce5e907afbd4d3c7d03f22940487861bca6645e4c0a"} err="failed to get container status \"01dadf0b66a22949a4a84ce5e907afbd4d3c7d03f22940487861bca6645e4c0a\": rpc error: code = NotFound desc = could not find container \"01dadf0b66a22949a4a84ce5e907afbd4d3c7d03f22940487861bca6645e4c0a\": container with ID starting with 01dadf0b66a22949a4a84ce5e907afbd4d3c7d03f22940487861bca6645e4c0a not found: ID does not exist"
Jul 02 21:04:52.771815 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.771778    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"]
Jul 02 21:04:52.776016 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:52.775973    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f407e7-6569c4447f-j8hjp"]
Jul 02 21:04:53.493756 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:04:53.493708    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54d8f3ca-723d-4547-8274-072aeda24935" path="/var/lib/kubelet/pods/54d8f3ca-723d-4547-8274-072aeda24935/volumes"
Jul 02 21:05:01.744859 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.744812    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"]
Jul 02 21:05:01.745420 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.745241    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="931ef151-509f-4a41-b246-648f432aaab6" containerName="main"
Jul 02 21:05:01.745420 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.745254    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="931ef151-509f-4a41-b246-648f432aaab6" containerName="main"
Jul 02 21:05:01.745420 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.745264    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d8f3ca-723d-4547-8274-072aeda24935" containerName="maas-api"
Jul 02 21:05:01.745420 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.745270    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d8f3ca-723d-4547-8274-072aeda24935" containerName="maas-api"
Jul 02 21:05:01.745420 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.745280    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1cba3e2-d09c-456b-9d7a-c39b5d078bdf" containerName="maas-api"
Jul 02 21:05:01.745420 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.745285    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1cba3e2-d09c-456b-9d7a-c39b5d078bdf" containerName="maas-api"
Jul 02 21:05:01.745420 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.745356    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="54d8f3ca-723d-4547-8274-072aeda24935" containerName="maas-api"
Jul 02 21:05:01.745420 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.745367    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1cba3e2-d09c-456b-9d7a-c39b5d078bdf" containerName="maas-api"
Jul 02 21:05:01.745420 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.745373    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="931ef151-509f-4a41-b246-648f432aaab6" containerName="main"
Jul 02 21:05:01.748468 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.748441    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:01.751123 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.751099    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-d84344-serving-cert\""
Jul 02 21:05:01.761189 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.761150    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"]
Jul 02 21:05:01.874874 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.874833    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c2742eb-ac26-4933-9572-d08c65cdeb97-maas-api-tls\") pod \"maas-api-e2e-api-a-d84344-64b858b96c-vgs2g\" (UID: \"4c2742eb-ac26-4933-9572-d08c65cdeb97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:01.875086 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.874966    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv4ln\" (UniqueName: \"kubernetes.io/projected/4c2742eb-ac26-4933-9572-d08c65cdeb97-kube-api-access-mv4ln\") pod \"maas-api-e2e-api-a-d84344-64b858b96c-vgs2g\" (UID: \"4c2742eb-ac26-4933-9572-d08c65cdeb97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:01.875086 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.875033    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2742eb-ac26-4933-9572-d08c65cdeb97-openshift-service-ca\") pod \"maas-api-e2e-api-a-d84344-64b858b96c-vgs2g\" (UID: \"4c2742eb-ac26-4933-9572-d08c65cdeb97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:01.976273 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.976229    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2742eb-ac26-4933-9572-d08c65cdeb97-openshift-service-ca\") pod \"maas-api-e2e-api-a-d84344-64b858b96c-vgs2g\" (UID: \"4c2742eb-ac26-4933-9572-d08c65cdeb97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:01.976464 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.976287    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c2742eb-ac26-4933-9572-d08c65cdeb97-maas-api-tls\") pod \"maas-api-e2e-api-a-d84344-64b858b96c-vgs2g\" (UID: \"4c2742eb-ac26-4933-9572-d08c65cdeb97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:01.976464 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.976332    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv4ln\" (UniqueName: \"kubernetes.io/projected/4c2742eb-ac26-4933-9572-d08c65cdeb97-kube-api-access-mv4ln\") pod \"maas-api-e2e-api-a-d84344-64b858b96c-vgs2g\" (UID: \"4c2742eb-ac26-4933-9572-d08c65cdeb97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:01.976963 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.976939    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2742eb-ac26-4933-9572-d08c65cdeb97-openshift-service-ca\") pod \"maas-api-e2e-api-a-d84344-64b858b96c-vgs2g\" (UID: \"4c2742eb-ac26-4933-9572-d08c65cdeb97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:01.978787 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.978758    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c2742eb-ac26-4933-9572-d08c65cdeb97-maas-api-tls\") pod \"maas-api-e2e-api-a-d84344-64b858b96c-vgs2g\" (UID: \"4c2742eb-ac26-4933-9572-d08c65cdeb97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:01.986226 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:01.986201    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv4ln\" (UniqueName: \"kubernetes.io/projected/4c2742eb-ac26-4933-9572-d08c65cdeb97-kube-api-access-mv4ln\") pod \"maas-api-e2e-api-a-d84344-64b858b96c-vgs2g\" (UID: \"4c2742eb-ac26-4933-9572-d08c65cdeb97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:02.060399 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:02.060362    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:02.206512 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:02.206484    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"]
Jul 02 21:05:02.208776 ip-10-0-132-48 kubenswrapper[2586]: W0702 21:05:02.208745    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2742eb_ac26_4933_9572_d08c65cdeb97.slice/crio-623e7ac074828e8f66787451895d36592b91acd890c3364e951ead9b5cbe6575 WatchSource:0}: Error finding container 623e7ac074828e8f66787451895d36592b91acd890c3364e951ead9b5cbe6575: Status 404 returned error can't find the container with id 623e7ac074828e8f66787451895d36592b91acd890c3364e951ead9b5cbe6575
Jul 02 21:05:02.801906 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:02.801838    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g" event={"ID":"4c2742eb-ac26-4933-9572-d08c65cdeb97","Type":"ContainerStarted","Data":"623e7ac074828e8f66787451895d36592b91acd890c3364e951ead9b5cbe6575"}
Jul 02 21:05:03.808348 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:03.808307    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g" event={"ID":"4c2742eb-ac26-4933-9572-d08c65cdeb97","Type":"ContainerStarted","Data":"bbe12bdbed0b9f1e4e46a33c3229e5d23caea10b8fdd4b0b85fd8c3d9ade46d1"}
Jul 02 21:05:03.808781 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:03.808491    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:03.825134 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:03.825084    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g" podStartSLOduration=1.9021999950000001 podStartE2EDuration="2.825068699s" totalImagesPullingTime="922.868704ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:05:03.824137492 +0000 UTC m=+1926.947306572" watchObservedRunningTime="2026-07-02 21:05:03.825068699 +0000 UTC m=+1926.948237758"
Jul 02 21:05:09.760528 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:09.760491    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"]
Jul 02 21:05:09.764530 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:09.764498    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:09.767409 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:09.767379    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-f67bf4-serving-cert\""
Jul 02 21:05:09.776192 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:09.776161    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"]
Jul 02 21:05:09.819815 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:09.819780    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:09.851504 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:09.851459    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed784da2-cd8b-4aee-8bc8-f80faac83981-openshift-service-ca\") pod \"maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4\" (UID: \"ed784da2-cd8b-4aee-8bc8-f80faac83981\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:09.851504 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:09.851502    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9l82\" (UniqueName: \"kubernetes.io/projected/ed784da2-cd8b-4aee-8bc8-f80faac83981-kube-api-access-r9l82\") pod \"maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4\" (UID: \"ed784da2-cd8b-4aee-8bc8-f80faac83981\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:09.851756 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:09.851522    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed784da2-cd8b-4aee-8bc8-f80faac83981-maas-api-tls\") pod \"maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4\" (UID: \"ed784da2-cd8b-4aee-8bc8-f80faac83981\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:09.952513 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:09.952478    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed784da2-cd8b-4aee-8bc8-f80faac83981-maas-api-tls\") pod \"maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4\" (UID: \"ed784da2-cd8b-4aee-8bc8-f80faac83981\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:09.952676 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:09.952609    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed784da2-cd8b-4aee-8bc8-f80faac83981-openshift-service-ca\") pod \"maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4\" (UID: \"ed784da2-cd8b-4aee-8bc8-f80faac83981\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:09.952676 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:05:09.952629    2586 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-serving-cert: secret "maas-api-e2e-api-b-f67bf4-serving-cert" not found
Jul 02 21:05:09.952676 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:09.952641    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9l82\" (UniqueName: \"kubernetes.io/projected/ed784da2-cd8b-4aee-8bc8-f80faac83981-kube-api-access-r9l82\") pod \"maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4\" (UID: \"ed784da2-cd8b-4aee-8bc8-f80faac83981\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:09.952842 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:05:09.952701    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed784da2-cd8b-4aee-8bc8-f80faac83981-maas-api-tls podName:ed784da2-cd8b-4aee-8bc8-f80faac83981 nodeName:}" failed. No retries permitted until 2026-07-02 21:05:10.45267797 +0000 UTC m=+1933.575846980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ed784da2-cd8b-4aee-8bc8-f80faac83981-maas-api-tls") pod "maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4" (UID: "ed784da2-cd8b-4aee-8bc8-f80faac83981") : secret "maas-api-e2e-api-b-f67bf4-serving-cert" not found
Jul 02 21:05:09.953295 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:09.953274    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed784da2-cd8b-4aee-8bc8-f80faac83981-openshift-service-ca\") pod \"maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4\" (UID: \"ed784da2-cd8b-4aee-8bc8-f80faac83981\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:09.961314 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:09.961280    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9l82\" (UniqueName: \"kubernetes.io/projected/ed784da2-cd8b-4aee-8bc8-f80faac83981-kube-api-access-r9l82\") pod \"maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4\" (UID: \"ed784da2-cd8b-4aee-8bc8-f80faac83981\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:10.457485 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:10.457442    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed784da2-cd8b-4aee-8bc8-f80faac83981-maas-api-tls\") pod \"maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4\" (UID: \"ed784da2-cd8b-4aee-8bc8-f80faac83981\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:10.460132 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:10.460099    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed784da2-cd8b-4aee-8bc8-f80faac83981-maas-api-tls\") pod \"maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4\" (UID: \"ed784da2-cd8b-4aee-8bc8-f80faac83981\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:10.679707 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:10.679664    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:10.828108 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:10.828072    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"]
Jul 02 21:05:10.832259 ip-10-0-132-48 kubenswrapper[2586]: W0702 21:05:10.832226    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded784da2_cd8b_4aee_8bc8_f80faac83981.slice/crio-132aa4390468ffc6ba94662e18b748323f0c5367223392d2c11487ed2b2aed74 WatchSource:0}: Error finding container 132aa4390468ffc6ba94662e18b748323f0c5367223392d2c11487ed2b2aed74: Status 404 returned error can't find the container with id 132aa4390468ffc6ba94662e18b748323f0c5367223392d2c11487ed2b2aed74
Jul 02 21:05:10.840516 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:10.840483    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4" event={"ID":"ed784da2-cd8b-4aee-8bc8-f80faac83981","Type":"ContainerStarted","Data":"132aa4390468ffc6ba94662e18b748323f0c5367223392d2c11487ed2b2aed74"}
Jul 02 21:05:11.847720 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:11.847676    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4" event={"ID":"ed784da2-cd8b-4aee-8bc8-f80faac83981","Type":"ContainerStarted","Data":"2fd2f414c13c8f79474303405d79060e9906a6ce8ab8860b40b3213af3a9050f"}
Jul 02 21:05:11.848162 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:11.847748    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:11.867515 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:11.867456    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4" podStartSLOduration=2.541440529 podStartE2EDuration="2.867436871s" totalImagesPullingTime="325.996342ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:05:11.866348927 +0000 UTC m=+1934.989517974" watchObservedRunningTime="2026-07-02 21:05:11.867436871 +0000 UTC m=+1934.990605903"
Jul 02 21:05:17.857875 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:17.857843    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:22.941650 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:22.941616    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"]
Jul 02 21:05:22.942033 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:22.941821    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g" podUID="4c2742eb-ac26-4933-9572-d08c65cdeb97" containerName="maas-api" containerID="cri-o://bbe12bdbed0b9f1e4e46a33c3229e5d23caea10b8fdd4b0b85fd8c3d9ade46d1" gracePeriod=30
Jul 02 21:05:23.207830 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.207749    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:23.381995 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.381948    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2742eb-ac26-4933-9572-d08c65cdeb97-openshift-service-ca\") pod \"4c2742eb-ac26-4933-9572-d08c65cdeb97\" (UID: \"4c2742eb-ac26-4933-9572-d08c65cdeb97\") "
Jul 02 21:05:23.382197 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.382062    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c2742eb-ac26-4933-9572-d08c65cdeb97-maas-api-tls\") pod \"4c2742eb-ac26-4933-9572-d08c65cdeb97\" (UID: \"4c2742eb-ac26-4933-9572-d08c65cdeb97\") "
Jul 02 21:05:23.382197 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.382118    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv4ln\" (UniqueName: \"kubernetes.io/projected/4c2742eb-ac26-4933-9572-d08c65cdeb97-kube-api-access-mv4ln\") pod \"4c2742eb-ac26-4933-9572-d08c65cdeb97\" (UID: \"4c2742eb-ac26-4933-9572-d08c65cdeb97\") "
Jul 02 21:05:23.382359 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.382331    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2742eb-ac26-4933-9572-d08c65cdeb97-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4c2742eb-ac26-4933-9572-d08c65cdeb97" (UID: "4c2742eb-ac26-4933-9572-d08c65cdeb97"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:05:23.384256 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.384215    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c2742eb-ac26-4933-9572-d08c65cdeb97-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4c2742eb-ac26-4933-9572-d08c65cdeb97" (UID: "4c2742eb-ac26-4933-9572-d08c65cdeb97"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:05:23.384256 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.384245    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c2742eb-ac26-4933-9572-d08c65cdeb97-kube-api-access-mv4ln" (OuterVolumeSpecName: "kube-api-access-mv4ln") pod "4c2742eb-ac26-4933-9572-d08c65cdeb97" (UID: "4c2742eb-ac26-4933-9572-d08c65cdeb97"). InnerVolumeSpecName "kube-api-access-mv4ln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:05:23.483851 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.483759    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv4ln\" (UniqueName: \"kubernetes.io/projected/4c2742eb-ac26-4933-9572-d08c65cdeb97-kube-api-access-mv4ln\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:05:23.483851 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.483792    2586 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2742eb-ac26-4933-9572-d08c65cdeb97-openshift-service-ca\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:05:23.483851 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.483803    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c2742eb-ac26-4933-9572-d08c65cdeb97-maas-api-tls\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:05:23.909931 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.909867    2586 generic.go:356] "Generic (PLEG): container finished" podID="4c2742eb-ac26-4933-9572-d08c65cdeb97" containerID="bbe12bdbed0b9f1e4e46a33c3229e5d23caea10b8fdd4b0b85fd8c3d9ade46d1" exitCode=0
Jul 02 21:05:23.909931 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.909908    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g" event={"ID":"4c2742eb-ac26-4933-9572-d08c65cdeb97","Type":"ContainerDied","Data":"bbe12bdbed0b9f1e4e46a33c3229e5d23caea10b8fdd4b0b85fd8c3d9ade46d1"}
Jul 02 21:05:23.910190 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.909936    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"
Jul 02 21:05:23.910190 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.909967    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g" event={"ID":"4c2742eb-ac26-4933-9572-d08c65cdeb97","Type":"ContainerDied","Data":"623e7ac074828e8f66787451895d36592b91acd890c3364e951ead9b5cbe6575"}
Jul 02 21:05:23.910190 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.909990    2586 scope.go:117] "RemoveContainer" containerID="bbe12bdbed0b9f1e4e46a33c3229e5d23caea10b8fdd4b0b85fd8c3d9ade46d1"
Jul 02 21:05:23.919263 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.919241    2586 scope.go:117] "RemoveContainer" containerID="bbe12bdbed0b9f1e4e46a33c3229e5d23caea10b8fdd4b0b85fd8c3d9ade46d1"
Jul 02 21:05:23.919537 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:05:23.919520    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbe12bdbed0b9f1e4e46a33c3229e5d23caea10b8fdd4b0b85fd8c3d9ade46d1\": container with ID starting with bbe12bdbed0b9f1e4e46a33c3229e5d23caea10b8fdd4b0b85fd8c3d9ade46d1 not found: ID does not exist" containerID="bbe12bdbed0b9f1e4e46a33c3229e5d23caea10b8fdd4b0b85fd8c3d9ade46d1"
Jul 02 21:05:23.919611 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.919544    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe12bdbed0b9f1e4e46a33c3229e5d23caea10b8fdd4b0b85fd8c3d9ade46d1"} err="failed to get container status \"bbe12bdbed0b9f1e4e46a33c3229e5d23caea10b8fdd4b0b85fd8c3d9ade46d1\": rpc error: code = NotFound desc = could not find container \"bbe12bdbed0b9f1e4e46a33c3229e5d23caea10b8fdd4b0b85fd8c3d9ade46d1\": container with ID starting with bbe12bdbed0b9f1e4e46a33c3229e5d23caea10b8fdd4b0b85fd8c3d9ade46d1 not found: ID does not exist"
Jul 02 21:05:23.926967 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.926934    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"]
Jul 02 21:05:23.931259 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:23.931231    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d84344-64b858b96c-vgs2g"]
Jul 02 21:05:25.493211 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:25.493167    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c2742eb-ac26-4933-9572-d08c65cdeb97" path="/var/lib/kubelet/pods/4c2742eb-ac26-4933-9572-d08c65cdeb97/volumes"
Jul 02 21:05:30.232407 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.232367    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"]
Jul 02 21:05:30.232865 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.232652    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4" podUID="ed784da2-cd8b-4aee-8bc8-f80faac83981" containerName="maas-api" containerID="cri-o://2fd2f414c13c8f79474303405d79060e9906a6ce8ab8860b40b3213af3a9050f" gracePeriod=30
Jul 02 21:05:30.484691 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.484621    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:30.542151 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.542110    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed784da2-cd8b-4aee-8bc8-f80faac83981-maas-api-tls\") pod \"ed784da2-cd8b-4aee-8bc8-f80faac83981\" (UID: \"ed784da2-cd8b-4aee-8bc8-f80faac83981\") "
Jul 02 21:05:30.542321 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.542224    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed784da2-cd8b-4aee-8bc8-f80faac83981-openshift-service-ca\") pod \"ed784da2-cd8b-4aee-8bc8-f80faac83981\" (UID: \"ed784da2-cd8b-4aee-8bc8-f80faac83981\") "
Jul 02 21:05:30.542321 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.542274    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9l82\" (UniqueName: \"kubernetes.io/projected/ed784da2-cd8b-4aee-8bc8-f80faac83981-kube-api-access-r9l82\") pod \"ed784da2-cd8b-4aee-8bc8-f80faac83981\" (UID: \"ed784da2-cd8b-4aee-8bc8-f80faac83981\") "
Jul 02 21:05:30.542634 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.542610    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed784da2-cd8b-4aee-8bc8-f80faac83981-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed784da2-cd8b-4aee-8bc8-f80faac83981" (UID: "ed784da2-cd8b-4aee-8bc8-f80faac83981"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:05:30.544385 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.544350    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed784da2-cd8b-4aee-8bc8-f80faac83981-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed784da2-cd8b-4aee-8bc8-f80faac83981" (UID: "ed784da2-cd8b-4aee-8bc8-f80faac83981"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:05:30.544533 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.544416    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed784da2-cd8b-4aee-8bc8-f80faac83981-kube-api-access-r9l82" (OuterVolumeSpecName: "kube-api-access-r9l82") pod "ed784da2-cd8b-4aee-8bc8-f80faac83981" (UID: "ed784da2-cd8b-4aee-8bc8-f80faac83981"). InnerVolumeSpecName "kube-api-access-r9l82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:05:30.643178 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.643138    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed784da2-cd8b-4aee-8bc8-f80faac83981-maas-api-tls\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:05:30.643178 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.643169    2586 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed784da2-cd8b-4aee-8bc8-f80faac83981-openshift-service-ca\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:05:30.643178 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.643181    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9l82\" (UniqueName: \"kubernetes.io/projected/ed784da2-cd8b-4aee-8bc8-f80faac83981-kube-api-access-r9l82\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:05:30.950454 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.950413    2586 generic.go:356] "Generic (PLEG): container finished" podID="ed784da2-cd8b-4aee-8bc8-f80faac83981" containerID="2fd2f414c13c8f79474303405d79060e9906a6ce8ab8860b40b3213af3a9050f" exitCode=0
Jul 02 21:05:30.950664 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.950473    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"
Jul 02 21:05:30.950664 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.950503    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4" event={"ID":"ed784da2-cd8b-4aee-8bc8-f80faac83981","Type":"ContainerDied","Data":"2fd2f414c13c8f79474303405d79060e9906a6ce8ab8860b40b3213af3a9050f"}
Jul 02 21:05:30.950664 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.950561    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4" event={"ID":"ed784da2-cd8b-4aee-8bc8-f80faac83981","Type":"ContainerDied","Data":"132aa4390468ffc6ba94662e18b748323f0c5367223392d2c11487ed2b2aed74"}
Jul 02 21:05:30.950664 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.950586    2586 scope.go:117] "RemoveContainer" containerID="2fd2f414c13c8f79474303405d79060e9906a6ce8ab8860b40b3213af3a9050f"
Jul 02 21:05:30.960281 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.960261    2586 scope.go:117] "RemoveContainer" containerID="2fd2f414c13c8f79474303405d79060e9906a6ce8ab8860b40b3213af3a9050f"
Jul 02 21:05:30.960603 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:05:30.960585    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fd2f414c13c8f79474303405d79060e9906a6ce8ab8860b40b3213af3a9050f\": container with ID starting with 2fd2f414c13c8f79474303405d79060e9906a6ce8ab8860b40b3213af3a9050f not found: ID does not exist" containerID="2fd2f414c13c8f79474303405d79060e9906a6ce8ab8860b40b3213af3a9050f"
Jul 02 21:05:30.960669 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.960614    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fd2f414c13c8f79474303405d79060e9906a6ce8ab8860b40b3213af3a9050f"} err="failed to get container status \"2fd2f414c13c8f79474303405d79060e9906a6ce8ab8860b40b3213af3a9050f\": rpc error: code = NotFound desc = could not find container \"2fd2f414c13c8f79474303405d79060e9906a6ce8ab8860b40b3213af3a9050f\": container with ID starting with 2fd2f414c13c8f79474303405d79060e9906a6ce8ab8860b40b3213af3a9050f not found: ID does not exist"
Jul 02 21:05:30.973447 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.973394    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"]
Jul 02 21:05:30.977618 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:30.977579    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f67bf4-79b5fdcf76-sd6x4"]
Jul 02 21:05:31.493260 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:31.493228    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed784da2-cd8b-4aee-8bc8-f80faac83981" path="/var/lib/kubelet/pods/ed784da2-cd8b-4aee-8bc8-f80faac83981/volumes"
Jul 02 21:05:39.923056 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:39.923021    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"]
Jul 02 21:05:39.923446 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:39.923431    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c2742eb-ac26-4933-9572-d08c65cdeb97" containerName="maas-api"
Jul 02 21:05:39.923492 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:39.923448    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c2742eb-ac26-4933-9572-d08c65cdeb97" containerName="maas-api"
Jul 02 21:05:39.923492 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:39.923463    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed784da2-cd8b-4aee-8bc8-f80faac83981" containerName="maas-api"
Jul 02 21:05:39.923492 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:39.923469    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed784da2-cd8b-4aee-8bc8-f80faac83981" containerName="maas-api"
Jul 02 21:05:39.923630 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:39.923537    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed784da2-cd8b-4aee-8bc8-f80faac83981" containerName="maas-api"
Jul 02 21:05:39.923630 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:39.923549    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c2742eb-ac26-4933-9572-d08c65cdeb97" containerName="maas-api"
Jul 02 21:05:39.927780 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:39.927761    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:05:39.930525 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:39.930498    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-58d1e3-serving-cert\""
Jul 02 21:05:39.935807 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:39.935777    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"]
Jul 02 21:05:40.035338 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:40.035295    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd17bcf-b745-409d-b238-1950b7a57e11-openshift-service-ca\") pod \"maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6\" (UID: \"bfd17bcf-b745-409d-b238-1950b7a57e11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:05:40.035530 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:40.035350    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt9fq\" (UniqueName: \"kubernetes.io/projected/bfd17bcf-b745-409d-b238-1950b7a57e11-kube-api-access-pt9fq\") pod \"maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6\" (UID: \"bfd17bcf-b745-409d-b238-1950b7a57e11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:05:40.035530 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:40.035413    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd17bcf-b745-409d-b238-1950b7a57e11-maas-api-tls\") pod \"maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6\" (UID: \"bfd17bcf-b745-409d-b238-1950b7a57e11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:05:40.136167 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:40.136131    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd17bcf-b745-409d-b238-1950b7a57e11-openshift-service-ca\") pod \"maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6\" (UID: \"bfd17bcf-b745-409d-b238-1950b7a57e11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:05:40.136338 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:40.136178    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt9fq\" (UniqueName: \"kubernetes.io/projected/bfd17bcf-b745-409d-b238-1950b7a57e11-kube-api-access-pt9fq\") pod \"maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6\" (UID: \"bfd17bcf-b745-409d-b238-1950b7a57e11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:05:40.136338 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:40.136297    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd17bcf-b745-409d-b238-1950b7a57e11-maas-api-tls\") pod \"maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6\" (UID: \"bfd17bcf-b745-409d-b238-1950b7a57e11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:05:40.136892 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:40.136858    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd17bcf-b745-409d-b238-1950b7a57e11-openshift-service-ca\") pod \"maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6\" (UID: \"bfd17bcf-b745-409d-b238-1950b7a57e11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:05:40.138784 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:40.138765    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd17bcf-b745-409d-b238-1950b7a57e11-maas-api-tls\") pod \"maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6\" (UID: \"bfd17bcf-b745-409d-b238-1950b7a57e11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:05:40.143938 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:40.143909    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt9fq\" (UniqueName: \"kubernetes.io/projected/bfd17bcf-b745-409d-b238-1950b7a57e11-kube-api-access-pt9fq\") pod \"maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6\" (UID: \"bfd17bcf-b745-409d-b238-1950b7a57e11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:05:40.239752 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:40.239633    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:05:40.386694 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:40.386660    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"]
Jul 02 21:05:40.389386 ip-10-0-132-48 kubenswrapper[2586]: W0702 21:05:40.389357    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfd17bcf_b745_409d_b238_1950b7a57e11.slice/crio-ba4b39561b7b577fde64676bffb557cc410c6f9563d1345b21fbb05939e6c499 WatchSource:0}: Error finding container ba4b39561b7b577fde64676bffb557cc410c6f9563d1345b21fbb05939e6c499: Status 404 returned error can't find the container with id ba4b39561b7b577fde64676bffb557cc410c6f9563d1345b21fbb05939e6c499
Jul 02 21:05:41.000364 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:41.000326    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6" event={"ID":"bfd17bcf-b745-409d-b238-1950b7a57e11","Type":"ContainerStarted","Data":"ffa6d6ab5230d4b09c20a37a925de814f338438dc14a9129aa84fab7ebdd4fe8"}
Jul 02 21:05:41.000781 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:41.000378    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6" event={"ID":"bfd17bcf-b745-409d-b238-1950b7a57e11","Type":"ContainerStarted","Data":"ba4b39561b7b577fde64676bffb557cc410c6f9563d1345b21fbb05939e6c499"}
Jul 02 21:05:41.000781 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:41.000469    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:05:41.017722 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:41.017589    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6" podStartSLOduration=1.574309297 podStartE2EDuration="2.017563086s" totalImagesPullingTime="443.253789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:05:41.016795494 +0000 UTC m=+1964.139964552" watchObservedRunningTime="2026-07-02 21:05:41.017563086 +0000 UTC m=+1964.140732121"
Jul 02 21:05:47.010790 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:47.010759    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:05:47.987007 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:47.986967    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"]
Jul 02 21:05:47.990622 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:47.990599    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:05:47.993514 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:47.993492    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-2217fe-serving-cert\""
Jul 02 21:05:48.001056 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:48.001019    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"]
Jul 02 21:05:48.115867 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:48.115809    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bce8761-9930-452e-80ad-883979b204ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6\" (UID: \"5bce8761-9930-452e-80ad-883979b204ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:05:48.116265 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:48.115956    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bce8761-9930-452e-80ad-883979b204ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6\" (UID: \"5bce8761-9930-452e-80ad-883979b204ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:05:48.116265 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:48.116026    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjz8m\" (UniqueName: \"kubernetes.io/projected/5bce8761-9930-452e-80ad-883979b204ea-kube-api-access-kjz8m\") pod \"maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6\" (UID: \"5bce8761-9930-452e-80ad-883979b204ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:05:48.217327 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:48.217288    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjz8m\" (UniqueName: \"kubernetes.io/projected/5bce8761-9930-452e-80ad-883979b204ea-kube-api-access-kjz8m\") pod \"maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6\" (UID: \"5bce8761-9930-452e-80ad-883979b204ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:05:48.217514 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:48.217432    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bce8761-9930-452e-80ad-883979b204ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6\" (UID: \"5bce8761-9930-452e-80ad-883979b204ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:05:48.217558 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:48.217518    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bce8761-9930-452e-80ad-883979b204ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6\" (UID: \"5bce8761-9930-452e-80ad-883979b204ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:05:48.217650 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:05:48.217637    2586 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-serving-cert: secret "maas-api-e2e-shared-b-2217fe-serving-cert" not found
Jul 02 21:05:48.217717 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:05:48.217706    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce8761-9930-452e-80ad-883979b204ea-maas-api-tls podName:5bce8761-9930-452e-80ad-883979b204ea nodeName:}" failed. No retries permitted until 2026-07-02 21:05:48.717686778 +0000 UTC m=+1971.840855789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5bce8761-9930-452e-80ad-883979b204ea-maas-api-tls") pod "maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6" (UID: "5bce8761-9930-452e-80ad-883979b204ea") : secret "maas-api-e2e-shared-b-2217fe-serving-cert" not found
Jul 02 21:05:48.218152 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:48.218134    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bce8761-9930-452e-80ad-883979b204ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6\" (UID: \"5bce8761-9930-452e-80ad-883979b204ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:05:48.229455 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:48.229429    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjz8m\" (UniqueName: \"kubernetes.io/projected/5bce8761-9930-452e-80ad-883979b204ea-kube-api-access-kjz8m\") pod \"maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6\" (UID: \"5bce8761-9930-452e-80ad-883979b204ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:05:48.721721 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:48.721684    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bce8761-9930-452e-80ad-883979b204ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6\" (UID: \"5bce8761-9930-452e-80ad-883979b204ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:05:48.724236 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:48.724215    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bce8761-9930-452e-80ad-883979b204ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6\" (UID: \"5bce8761-9930-452e-80ad-883979b204ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:05:48.905358 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:48.905318    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:05:49.050222 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:49.050192    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"]
Jul 02 21:05:49.052932 ip-10-0-132-48 kubenswrapper[2586]: W0702 21:05:49.052900    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bce8761_9930_452e_80ad_883979b204ea.slice/crio-835d56dc59c5133eb0fb4b56e2fc9e0705e761169420a29ea21002a02200fb4b WatchSource:0}: Error finding container 835d56dc59c5133eb0fb4b56e2fc9e0705e761169420a29ea21002a02200fb4b: Status 404 returned error can't find the container with id 835d56dc59c5133eb0fb4b56e2fc9e0705e761169420a29ea21002a02200fb4b
Jul 02 21:05:50.045630 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:50.045593    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6" event={"ID":"5bce8761-9930-452e-80ad-883979b204ea","Type":"ContainerStarted","Data":"e56462abb0c71020dad1c807b202aa19ca94b61cc86daf22f361dcfe318b3a43"}
Jul 02 21:05:50.046116 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:50.045648    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6" event={"ID":"5bce8761-9930-452e-80ad-883979b204ea","Type":"ContainerStarted","Data":"835d56dc59c5133eb0fb4b56e2fc9e0705e761169420a29ea21002a02200fb4b"}
Jul 02 21:05:50.046116 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:50.045738    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:05:50.064109 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:50.064050    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6" podStartSLOduration=2.748365804 podStartE2EDuration="3.064029993s" totalImagesPullingTime="315.664189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:05:50.062731197 +0000 UTC m=+1973.185900230" watchObservedRunningTime="2026-07-02 21:05:50.064029993 +0000 UTC m=+1973.187199063"
Jul 02 21:05:56.055508 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:05:56.055471    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:06:38.819152 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:38.819110    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"]
Jul 02 21:06:38.822450 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:38.822430    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:38.826586 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:38.826558    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2217fe\"/\"default-dockercfg-chdds\""
Jul 02 21:06:38.826746 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:38.826564    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2217fe\"/\"auth-test-model-2217fe-kserve-self-signed-certs\""
Jul 02 21:06:38.826746 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:38.826618    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2217fe\"/\"kube-root-ca.crt\""
Jul 02 21:06:38.827502 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:38.827482    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2217fe\"/\"openshift-service-ca.crt\""
Jul 02 21:06:38.848848 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:38.848811    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"]
Jul 02 21:06:39.008119 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.008084    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-home\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.008119 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.008125    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c30d817-3b3d-402d-b801-b10f40d158de-tls-certs\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.008378 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.008218    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-tmp-dir\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.008378 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.008241    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvnq5\" (UniqueName: \"kubernetes.io/projected/8c30d817-3b3d-402d-b801-b10f40d158de-kube-api-access-bvnq5\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.008378 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.008277    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-dshm\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.008378 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.008349    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-model-cache\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.109225 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.109127    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-home\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.109225 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.109169    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c30d817-3b3d-402d-b801-b10f40d158de-tls-certs\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.109225 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.109216    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-tmp-dir\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.109524 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.109232    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvnq5\" (UniqueName: \"kubernetes.io/projected/8c30d817-3b3d-402d-b801-b10f40d158de-kube-api-access-bvnq5\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.109524 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.109256    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-dshm\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.109524 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.109354    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-model-cache\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.109687 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.109631    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-home\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.109687 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.109653    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-tmp-dir\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.109819 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.109714    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-model-cache\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.111648 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.111630    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-dshm\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.111833 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.111816    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c30d817-3b3d-402d-b801-b10f40d158de-tls-certs\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.118116 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.118088    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvnq5\" (UniqueName: \"kubernetes.io/projected/8c30d817-3b3d-402d-b801-b10f40d158de-kube-api-access-bvnq5\") pod \"auth-test-model-2217fe-kserve-574c6cc647-njrgw\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") " pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.133455 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.133416    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:39.275612 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:39.275576    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"]
Jul 02 21:06:39.282003 ip-10-0-132-48 kubenswrapper[2586]: W0702 21:06:39.281960    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c30d817_3b3d_402d_b801_b10f40d158de.slice/crio-745f451c4a11d0d3e7d3a204c5c913348be57d3517aedbc7c883cbec71f04bba WatchSource:0}: Error finding container 745f451c4a11d0d3e7d3a204c5c913348be57d3517aedbc7c883cbec71f04bba: Status 404 returned error can't find the container with id 745f451c4a11d0d3e7d3a204c5c913348be57d3517aedbc7c883cbec71f04bba
Jul 02 21:06:40.294158 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:40.294115    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw" event={"ID":"8c30d817-3b3d-402d-b801-b10f40d158de","Type":"ContainerStarted","Data":"e949c3a81970a6483568ddf782ef97936e710079170094932d4540bd82a0dca0"}
Jul 02 21:06:40.294590 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:40.294172    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw" event={"ID":"8c30d817-3b3d-402d-b801-b10f40d158de","Type":"ContainerStarted","Data":"745f451c4a11d0d3e7d3a204c5c913348be57d3517aedbc7c883cbec71f04bba"}
Jul 02 21:06:40.311751 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:40.311696    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw" podStartSLOduration=2.311679719 podStartE2EDuration="2.311679719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:06:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:06:40.310737413 +0000 UTC m=+2023.433906443" watchObservedRunningTime="2026-07-02 21:06:40.311679719 +0000 UTC m=+2023.434848752"
Jul 02 21:06:49.133802 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:49.133761    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:49.134238 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:49.133822    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:49.146308 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:49.146279    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:06:49.349850 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:06:49.349821    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:07:57.497735 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:07:57.497704    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 21:07:57.500600 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:07:57.500576    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 21:07:57.504895 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:07:57.504854    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 21:07:57.507704 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:07:57.507680    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26dr8_1a63c53e-a5d6-4b71-bc0c-10b1a4c44e43/ovn-acl-logging/0.log"
Jul 02 21:08:29.279068 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:29.279025    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"]
Jul 02 21:08:44.300666 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.300602    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw" podUID="8c30d817-3b3d-402d-b801-b10f40d158de" containerName="main" containerID="cri-o://e949c3a81970a6483568ddf782ef97936e710079170094932d4540bd82a0dca0" gracePeriod=45
Jul 02 21:08:44.555365 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.555296    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:08:44.702627 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.702586    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-home\") pod \"8c30d817-3b3d-402d-b801-b10f40d158de\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") "
Jul 02 21:08:44.702627 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.702625    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-model-cache\") pod \"8c30d817-3b3d-402d-b801-b10f40d158de\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") "
Jul 02 21:08:44.702849 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.702659    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-tmp-dir\") pod \"8c30d817-3b3d-402d-b801-b10f40d158de\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") "
Jul 02 21:08:44.702849 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.702705    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c30d817-3b3d-402d-b801-b10f40d158de-tls-certs\") pod \"8c30d817-3b3d-402d-b801-b10f40d158de\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") "
Jul 02 21:08:44.702849 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.702735    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-dshm\") pod \"8c30d817-3b3d-402d-b801-b10f40d158de\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") "
Jul 02 21:08:44.703057 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.702864    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvnq5\" (UniqueName: \"kubernetes.io/projected/8c30d817-3b3d-402d-b801-b10f40d158de-kube-api-access-bvnq5\") pod \"8c30d817-3b3d-402d-b801-b10f40d158de\" (UID: \"8c30d817-3b3d-402d-b801-b10f40d158de\") "
Jul 02 21:08:44.703057 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.702973    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-home" (OuterVolumeSpecName: "home") pod "8c30d817-3b3d-402d-b801-b10f40d158de" (UID: "8c30d817-3b3d-402d-b801-b10f40d158de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:08:44.703057 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.702987    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-model-cache" (OuterVolumeSpecName: "model-cache") pod "8c30d817-3b3d-402d-b801-b10f40d158de" (UID: "8c30d817-3b3d-402d-b801-b10f40d158de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:08:44.703057 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.702999    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8c30d817-3b3d-402d-b801-b10f40d158de" (UID: "8c30d817-3b3d-402d-b801-b10f40d158de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:08:44.703300 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.703183    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-home\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:08:44.703300 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.703196    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-model-cache\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:08:44.703300 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.703210    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-tmp-dir\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:08:44.705131 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.705092    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-dshm" (OuterVolumeSpecName: "dshm") pod "8c30d817-3b3d-402d-b801-b10f40d158de" (UID: "8c30d817-3b3d-402d-b801-b10f40d158de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:08:44.705131 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.705116    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c30d817-3b3d-402d-b801-b10f40d158de-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8c30d817-3b3d-402d-b801-b10f40d158de" (UID: "8c30d817-3b3d-402d-b801-b10f40d158de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:08:44.705290 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.705135    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c30d817-3b3d-402d-b801-b10f40d158de-kube-api-access-bvnq5" (OuterVolumeSpecName: "kube-api-access-bvnq5") pod "8c30d817-3b3d-402d-b801-b10f40d158de" (UID: "8c30d817-3b3d-402d-b801-b10f40d158de"). InnerVolumeSpecName "kube-api-access-bvnq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:08:44.804464 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.804423    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvnq5\" (UniqueName: \"kubernetes.io/projected/8c30d817-3b3d-402d-b801-b10f40d158de-kube-api-access-bvnq5\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:08:44.804464 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.804460    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c30d817-3b3d-402d-b801-b10f40d158de-tls-certs\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:08:44.804464 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.804472    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c30d817-3b3d-402d-b801-b10f40d158de-dshm\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:08:44.897660 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.897564    2586 generic.go:356] "Generic (PLEG): container finished" podID="8c30d817-3b3d-402d-b801-b10f40d158de" containerID="e949c3a81970a6483568ddf782ef97936e710079170094932d4540bd82a0dca0" exitCode=0
Jul 02 21:08:44.897660 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.897606    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"
Jul 02 21:08:44.897925 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.897606    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw" event={"ID":"8c30d817-3b3d-402d-b801-b10f40d158de","Type":"ContainerDied","Data":"e949c3a81970a6483568ddf782ef97936e710079170094932d4540bd82a0dca0"}
Jul 02 21:08:44.897925 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.897745    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw" event={"ID":"8c30d817-3b3d-402d-b801-b10f40d158de","Type":"ContainerDied","Data":"745f451c4a11d0d3e7d3a204c5c913348be57d3517aedbc7c883cbec71f04bba"}
Jul 02 21:08:44.897925 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.897777    2586 scope.go:117] "RemoveContainer" containerID="e949c3a81970a6483568ddf782ef97936e710079170094932d4540bd82a0dca0"
Jul 02 21:08:44.907997 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.907956    2586 scope.go:117] "RemoveContainer" containerID="e949c3a81970a6483568ddf782ef97936e710079170094932d4540bd82a0dca0"
Jul 02 21:08:44.908272 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:08:44.908253    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e949c3a81970a6483568ddf782ef97936e710079170094932d4540bd82a0dca0\": container with ID starting with e949c3a81970a6483568ddf782ef97936e710079170094932d4540bd82a0dca0 not found: ID does not exist" containerID="e949c3a81970a6483568ddf782ef97936e710079170094932d4540bd82a0dca0"
Jul 02 21:08:44.908338 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.908281    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e949c3a81970a6483568ddf782ef97936e710079170094932d4540bd82a0dca0"} err="failed to get container status \"e949c3a81970a6483568ddf782ef97936e710079170094932d4540bd82a0dca0\": rpc error: code = NotFound desc = could not find container \"e949c3a81970a6483568ddf782ef97936e710079170094932d4540bd82a0dca0\": container with ID starting with e949c3a81970a6483568ddf782ef97936e710079170094932d4540bd82a0dca0 not found: ID does not exist"
Jul 02 21:08:44.920160 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.920128    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"]
Jul 02 21:08:44.924351 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:44.924318    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/auth-test-model-2217fe-kserve-574c6cc647-njrgw"]
Jul 02 21:08:45.493090 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:08:45.493054    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c30d817-3b3d-402d-b801-b10f40d158de" path="/var/lib/kubelet/pods/8c30d817-3b3d-402d-b801-b10f40d158de/volumes"
Jul 02 21:09:43.580765 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.580730    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"]
Jul 02 21:09:43.581287 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.581151    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c30d817-3b3d-402d-b801-b10f40d158de" containerName="main"
Jul 02 21:09:43.581287 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.581163    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c30d817-3b3d-402d-b801-b10f40d158de" containerName="main"
Jul 02 21:09:43.581287 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.581239    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c30d817-3b3d-402d-b801-b10f40d158de" containerName="main"
Jul 02 21:09:43.584278 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.584255    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.587753 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.587725    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-58d1e3\"/\"kube-root-ca.crt\""
Jul 02 21:09:43.587753 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.587752    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-58d1e3\"/\"openshift-service-ca.crt\""
Jul 02 21:09:43.587986 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.587725    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-58d1e3\"/\"rate-test-model-58d1e3-kserve-self-signed-certs\""
Jul 02 21:09:43.587986 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.587725    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-58d1e3\"/\"default-dockercfg-d624v\""
Jul 02 21:09:43.592635 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.592318    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"]
Jul 02 21:09:43.654704 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.654658    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzlh6\" (UniqueName: \"kubernetes.io/projected/9cc956c8-9830-4b41-81c7-6c69b14a7396-kube-api-access-dzlh6\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.654908 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.654714    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-home\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.654908 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.654748    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc956c8-9830-4b41-81c7-6c69b14a7396-tls-certs\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.654908 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.654865    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-model-cache\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.655045 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.654954    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-tmp-dir\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.655045 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.654976    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-dshm\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.755850 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.755816    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-tmp-dir\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.755850 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.755852    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-dshm\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.756107 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.755913    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzlh6\" (UniqueName: \"kubernetes.io/projected/9cc956c8-9830-4b41-81c7-6c69b14a7396-kube-api-access-dzlh6\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.756107 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.755937    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-home\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.756107 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.755964    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc956c8-9830-4b41-81c7-6c69b14a7396-tls-certs\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.756107 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.756051    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-model-cache\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.756357 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.756333    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-tmp-dir\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.756403 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.756368    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-home\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.756442 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.756427    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-model-cache\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.758340 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.758303    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-dshm\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.758679 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.758663    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc956c8-9830-4b41-81c7-6c69b14a7396-tls-certs\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.764250 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.764224    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzlh6\" (UniqueName: \"kubernetes.io/projected/9cc956c8-9830-4b41-81c7-6c69b14a7396-kube-api-access-dzlh6\") pod \"rate-test-model-58d1e3-kserve-6c995c9f79-72jmb\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") " pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:43.895143 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:43.895041    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:44.044261 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:44.044229    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"]
Jul 02 21:09:44.045330 ip-10-0-132-48 kubenswrapper[2586]: W0702 21:09:44.045304    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cc956c8_9830_4b41_81c7_6c69b14a7396.slice/crio-b2639f0cef8665a566b69c237225f102aba21c42d8a33f53e453f0959d907122 WatchSource:0}: Error finding container b2639f0cef8665a566b69c237225f102aba21c42d8a33f53e453f0959d907122: Status 404 returned error can't find the container with id b2639f0cef8665a566b69c237225f102aba21c42d8a33f53e453f0959d907122
Jul 02 21:09:44.204568 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:44.204460    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb" event={"ID":"9cc956c8-9830-4b41-81c7-6c69b14a7396","Type":"ContainerStarted","Data":"16e3f8c0bf49ca78e670b967acb26c893377371024ce2992eeba2fed6a7562ac"}
Jul 02 21:09:44.204568 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:44.204507    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb" event={"ID":"9cc956c8-9830-4b41-81c7-6c69b14a7396","Type":"ContainerStarted","Data":"b2639f0cef8665a566b69c237225f102aba21c42d8a33f53e453f0959d907122"}
Jul 02 21:09:44.224984 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:44.224927    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb" podStartSLOduration=1.2249102139999999 podStartE2EDuration="1.224910214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:09:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:09:44.223802107 +0000 UTC m=+2207.346971142" watchObservedRunningTime="2026-07-02 21:09:44.224910214 +0000 UTC m=+2207.348079271"
Jul 02 21:09:53.895603 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:53.895562    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:53.896244 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:53.895625    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:53.908216 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:53.908185    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:09:54.267377 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:09:54.267293    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:10:42.518023 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:42.517937    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"]
Jul 02 21:10:45.285795 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:45.285760    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"]
Jul 02 21:10:45.286325 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:45.286033    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6" podUID="bfd17bcf-b745-409d-b238-1950b7a57e11" containerName="maas-api" containerID="cri-o://ffa6d6ab5230d4b09c20a37a925de814f338438dc14a9129aa84fab7ebdd4fe8" gracePeriod=30
Jul 02 21:10:45.511826 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:45.511792    2586 generic.go:356] "Generic (PLEG): container finished" podID="bfd17bcf-b745-409d-b238-1950b7a57e11" containerID="ffa6d6ab5230d4b09c20a37a925de814f338438dc14a9129aa84fab7ebdd4fe8" exitCode=0
Jul 02 21:10:45.512022 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:45.511845    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6" event={"ID":"bfd17bcf-b745-409d-b238-1950b7a57e11","Type":"ContainerDied","Data":"ffa6d6ab5230d4b09c20a37a925de814f338438dc14a9129aa84fab7ebdd4fe8"}
Jul 02 21:10:45.549819 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:45.549749    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:10:45.552926 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:45.552895    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd17bcf-b745-409d-b238-1950b7a57e11-maas-api-tls\") pod \"bfd17bcf-b745-409d-b238-1950b7a57e11\" (UID: \"bfd17bcf-b745-409d-b238-1950b7a57e11\") "
Jul 02 21:10:45.553079 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:45.552939    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt9fq\" (UniqueName: \"kubernetes.io/projected/bfd17bcf-b745-409d-b238-1950b7a57e11-kube-api-access-pt9fq\") pod \"bfd17bcf-b745-409d-b238-1950b7a57e11\" (UID: \"bfd17bcf-b745-409d-b238-1950b7a57e11\") "
Jul 02 21:10:45.553079 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:45.553020    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd17bcf-b745-409d-b238-1950b7a57e11-openshift-service-ca\") pod \"bfd17bcf-b745-409d-b238-1950b7a57e11\" (UID: \"bfd17bcf-b745-409d-b238-1950b7a57e11\") "
Jul 02 21:10:45.553426 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:45.553400    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfd17bcf-b745-409d-b238-1950b7a57e11-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bfd17bcf-b745-409d-b238-1950b7a57e11" (UID: "bfd17bcf-b745-409d-b238-1950b7a57e11"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:10:45.555155 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:45.555133    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfd17bcf-b745-409d-b238-1950b7a57e11-kube-api-access-pt9fq" (OuterVolumeSpecName: "kube-api-access-pt9fq") pod "bfd17bcf-b745-409d-b238-1950b7a57e11" (UID: "bfd17bcf-b745-409d-b238-1950b7a57e11"). InnerVolumeSpecName "kube-api-access-pt9fq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:10:45.555225 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:45.555151    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfd17bcf-b745-409d-b238-1950b7a57e11-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bfd17bcf-b745-409d-b238-1950b7a57e11" (UID: "bfd17bcf-b745-409d-b238-1950b7a57e11"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:10:45.654014 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:45.653976    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd17bcf-b745-409d-b238-1950b7a57e11-maas-api-tls\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:10:45.654014 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:45.654005    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt9fq\" (UniqueName: \"kubernetes.io/projected/bfd17bcf-b745-409d-b238-1950b7a57e11-kube-api-access-pt9fq\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:10:45.654014 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:45.654017    2586 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd17bcf-b745-409d-b238-1950b7a57e11-openshift-service-ca\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:10:46.517938 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:46.517905    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6" event={"ID":"bfd17bcf-b745-409d-b238-1950b7a57e11","Type":"ContainerDied","Data":"ba4b39561b7b577fde64676bffb557cc410c6f9563d1345b21fbb05939e6c499"}
Jul 02 21:10:46.517938 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:46.517931    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"
Jul 02 21:10:46.518418 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:46.517973    2586 scope.go:117] "RemoveContainer" containerID="ffa6d6ab5230d4b09c20a37a925de814f338438dc14a9129aa84fab7ebdd4fe8"
Jul 02 21:10:46.544910 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:46.541263    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"]
Jul 02 21:10:46.548009 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:46.547977    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-58d1e3-589965fb5-n7kp6"]
Jul 02 21:10:47.494458 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:47.494414    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfd17bcf-b745-409d-b238-1950b7a57e11" path="/var/lib/kubelet/pods/bfd17bcf-b745-409d-b238-1950b7a57e11/volumes"
Jul 02 21:10:57.540217 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.540174    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb" podUID="9cc956c8-9830-4b41-81c7-6c69b14a7396" containerName="main" containerID="cri-o://16e3f8c0bf49ca78e670b967acb26c893377371024ce2992eeba2fed6a7562ac" gracePeriod=45
Jul 02 21:10:57.801186 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.801114    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:10:57.867216 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.867183    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-home\") pod \"9cc956c8-9830-4b41-81c7-6c69b14a7396\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") "
Jul 02 21:10:57.867404 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.867250    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzlh6\" (UniqueName: \"kubernetes.io/projected/9cc956c8-9830-4b41-81c7-6c69b14a7396-kube-api-access-dzlh6\") pod \"9cc956c8-9830-4b41-81c7-6c69b14a7396\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") "
Jul 02 21:10:57.867404 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.867271    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-model-cache\") pod \"9cc956c8-9830-4b41-81c7-6c69b14a7396\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") "
Jul 02 21:10:57.867404 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.867290    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-tmp-dir\") pod \"9cc956c8-9830-4b41-81c7-6c69b14a7396\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") "
Jul 02 21:10:57.867404 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.867316    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc956c8-9830-4b41-81c7-6c69b14a7396-tls-certs\") pod \"9cc956c8-9830-4b41-81c7-6c69b14a7396\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") "
Jul 02 21:10:57.867404 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.867330    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-dshm\") pod \"9cc956c8-9830-4b41-81c7-6c69b14a7396\" (UID: \"9cc956c8-9830-4b41-81c7-6c69b14a7396\") "
Jul 02 21:10:57.867664 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.867495    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-home" (OuterVolumeSpecName: "home") pod "9cc956c8-9830-4b41-81c7-6c69b14a7396" (UID: "9cc956c8-9830-4b41-81c7-6c69b14a7396"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:10:57.867664 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.867578    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-model-cache" (OuterVolumeSpecName: "model-cache") pod "9cc956c8-9830-4b41-81c7-6c69b14a7396" (UID: "9cc956c8-9830-4b41-81c7-6c69b14a7396"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:10:57.867664 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.867620    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9cc956c8-9830-4b41-81c7-6c69b14a7396" (UID: "9cc956c8-9830-4b41-81c7-6c69b14a7396"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:10:57.867775 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.867663    2586 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-home\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:10:57.869671 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.869641    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc956c8-9830-4b41-81c7-6c69b14a7396-kube-api-access-dzlh6" (OuterVolumeSpecName: "kube-api-access-dzlh6") pod "9cc956c8-9830-4b41-81c7-6c69b14a7396" (UID: "9cc956c8-9830-4b41-81c7-6c69b14a7396"). InnerVolumeSpecName "kube-api-access-dzlh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:10:57.869671 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.869653    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-dshm" (OuterVolumeSpecName: "dshm") pod "9cc956c8-9830-4b41-81c7-6c69b14a7396" (UID: "9cc956c8-9830-4b41-81c7-6c69b14a7396"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:10:57.869839 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.869698    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cc956c8-9830-4b41-81c7-6c69b14a7396-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9cc956c8-9830-4b41-81c7-6c69b14a7396" (UID: "9cc956c8-9830-4b41-81c7-6c69b14a7396"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:10:57.968208 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.968175    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzlh6\" (UniqueName: \"kubernetes.io/projected/9cc956c8-9830-4b41-81c7-6c69b14a7396-kube-api-access-dzlh6\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:10:57.968208 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.968203    2586 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-model-cache\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:10:57.968208 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.968213    2586 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-tmp-dir\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:10:57.968485 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.968220    2586 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc956c8-9830-4b41-81c7-6c69b14a7396-tls-certs\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:10:57.968485 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:57.968228    2586 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc956c8-9830-4b41-81c7-6c69b14a7396-dshm\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:10:58.578111 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:58.578071    2586 generic.go:356] "Generic (PLEG): container finished" podID="9cc956c8-9830-4b41-81c7-6c69b14a7396" containerID="16e3f8c0bf49ca78e670b967acb26c893377371024ce2992eeba2fed6a7562ac" exitCode=0
Jul 02 21:10:58.578567 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:58.578126    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"
Jul 02 21:10:58.578567 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:58.578155    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb" event={"ID":"9cc956c8-9830-4b41-81c7-6c69b14a7396","Type":"ContainerDied","Data":"16e3f8c0bf49ca78e670b967acb26c893377371024ce2992eeba2fed6a7562ac"}
Jul 02 21:10:58.578567 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:58.578199    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb" event={"ID":"9cc956c8-9830-4b41-81c7-6c69b14a7396","Type":"ContainerDied","Data":"b2639f0cef8665a566b69c237225f102aba21c42d8a33f53e453f0959d907122"}
Jul 02 21:10:58.578567 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:58.578218    2586 scope.go:117] "RemoveContainer" containerID="16e3f8c0bf49ca78e670b967acb26c893377371024ce2992eeba2fed6a7562ac"
Jul 02 21:10:58.588462 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:58.588435    2586 scope.go:117] "RemoveContainer" containerID="16e3f8c0bf49ca78e670b967acb26c893377371024ce2992eeba2fed6a7562ac"
Jul 02 21:10:58.588769 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:10:58.588750    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16e3f8c0bf49ca78e670b967acb26c893377371024ce2992eeba2fed6a7562ac\": container with ID starting with 16e3f8c0bf49ca78e670b967acb26c893377371024ce2992eeba2fed6a7562ac not found: ID does not exist" containerID="16e3f8c0bf49ca78e670b967acb26c893377371024ce2992eeba2fed6a7562ac"
Jul 02 21:10:58.588832 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:58.588778    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16e3f8c0bf49ca78e670b967acb26c893377371024ce2992eeba2fed6a7562ac"} err="failed to get container status \"16e3f8c0bf49ca78e670b967acb26c893377371024ce2992eeba2fed6a7562ac\": rpc error: code = NotFound desc = could not find container \"16e3f8c0bf49ca78e670b967acb26c893377371024ce2992eeba2fed6a7562ac\": container with ID starting with 16e3f8c0bf49ca78e670b967acb26c893377371024ce2992eeba2fed6a7562ac not found: ID does not exist"
Jul 02 21:10:58.608075 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:58.608029    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"]
Jul 02 21:10:58.611695 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:58.611667    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/rate-test-model-58d1e3-kserve-6c995c9f79-72jmb"]
Jul 02 21:10:59.494653 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:10:59.494616    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cc956c8-9830-4b41-81c7-6c69b14a7396" path="/var/lib/kubelet/pods/9cc956c8-9830-4b41-81c7-6c69b14a7396/volumes"
Jul 02 21:11:28.225289 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.225244    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"]
Jul 02 21:11:28.225867 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.225528    2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6" podUID="5bce8761-9930-452e-80ad-883979b204ea" containerName="maas-api" containerID="cri-o://e56462abb0c71020dad1c807b202aa19ca94b61cc86daf22f361dcfe318b3a43" gracePeriod=30
Jul 02 21:11:28.486274 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.486203    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:11:28.656475 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.656440    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjz8m\" (UniqueName: \"kubernetes.io/projected/5bce8761-9930-452e-80ad-883979b204ea-kube-api-access-kjz8m\") pod \"5bce8761-9930-452e-80ad-883979b204ea\" (UID: \"5bce8761-9930-452e-80ad-883979b204ea\") "
Jul 02 21:11:28.656687 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.656507    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bce8761-9930-452e-80ad-883979b204ea-maas-api-tls\") pod \"5bce8761-9930-452e-80ad-883979b204ea\" (UID: \"5bce8761-9930-452e-80ad-883979b204ea\") "
Jul 02 21:11:28.656687 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.656591    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bce8761-9930-452e-80ad-883979b204ea-openshift-service-ca\") pod \"5bce8761-9930-452e-80ad-883979b204ea\" (UID: \"5bce8761-9930-452e-80ad-883979b204ea\") "
Jul 02 21:11:28.656990 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.656956    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bce8761-9930-452e-80ad-883979b204ea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5bce8761-9930-452e-80ad-883979b204ea" (UID: "5bce8761-9930-452e-80ad-883979b204ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:11:28.658934 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.658871    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bce8761-9930-452e-80ad-883979b204ea-kube-api-access-kjz8m" (OuterVolumeSpecName: "kube-api-access-kjz8m") pod "5bce8761-9930-452e-80ad-883979b204ea" (UID: "5bce8761-9930-452e-80ad-883979b204ea"). InnerVolumeSpecName "kube-api-access-kjz8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:11:28.658934 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.658897    2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bce8761-9930-452e-80ad-883979b204ea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5bce8761-9930-452e-80ad-883979b204ea" (UID: "5bce8761-9930-452e-80ad-883979b204ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:11:28.733630 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.733597    2586 generic.go:356] "Generic (PLEG): container finished" podID="5bce8761-9930-452e-80ad-883979b204ea" containerID="e56462abb0c71020dad1c807b202aa19ca94b61cc86daf22f361dcfe318b3a43" exitCode=0
Jul 02 21:11:28.733803 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.733663    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"
Jul 02 21:11:28.733803 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.733680    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6" event={"ID":"5bce8761-9930-452e-80ad-883979b204ea","Type":"ContainerDied","Data":"e56462abb0c71020dad1c807b202aa19ca94b61cc86daf22f361dcfe318b3a43"}
Jul 02 21:11:28.733803 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.733778    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6" event={"ID":"5bce8761-9930-452e-80ad-883979b204ea","Type":"ContainerDied","Data":"835d56dc59c5133eb0fb4b56e2fc9e0705e761169420a29ea21002a02200fb4b"}
Jul 02 21:11:28.733943 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.733808    2586 scope.go:117] "RemoveContainer" containerID="e56462abb0c71020dad1c807b202aa19ca94b61cc86daf22f361dcfe318b3a43"
Jul 02 21:11:28.743801 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.743773    2586 scope.go:117] "RemoveContainer" containerID="e56462abb0c71020dad1c807b202aa19ca94b61cc86daf22f361dcfe318b3a43"
Jul 02 21:11:28.744157 ip-10-0-132-48 kubenswrapper[2586]: E0702 21:11:28.744138    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e56462abb0c71020dad1c807b202aa19ca94b61cc86daf22f361dcfe318b3a43\": container with ID starting with e56462abb0c71020dad1c807b202aa19ca94b61cc86daf22f361dcfe318b3a43 not found: ID does not exist" containerID="e56462abb0c71020dad1c807b202aa19ca94b61cc86daf22f361dcfe318b3a43"
Jul 02 21:11:28.744216 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.744168    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56462abb0c71020dad1c807b202aa19ca94b61cc86daf22f361dcfe318b3a43"} err="failed to get container status \"e56462abb0c71020dad1c807b202aa19ca94b61cc86daf22f361dcfe318b3a43\": rpc error: code = NotFound desc = could not find container \"e56462abb0c71020dad1c807b202aa19ca94b61cc86daf22f361dcfe318b3a43\": container with ID starting with e56462abb0c71020dad1c807b202aa19ca94b61cc86daf22f361dcfe318b3a43 not found: ID does not exist"
Jul 02 21:11:28.757275 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.757242    2586 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bce8761-9930-452e-80ad-883979b204ea-openshift-service-ca\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:11:28.757275 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.757273    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjz8m\" (UniqueName: \"kubernetes.io/projected/5bce8761-9930-452e-80ad-883979b204ea-kube-api-access-kjz8m\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:11:28.757275 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.757285    2586 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bce8761-9930-452e-80ad-883979b204ea-maas-api-tls\") on node \"ip-10-0-132-48.ec2.internal\" DevicePath \"\""
Jul 02 21:11:28.762150 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.762116    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"]
Jul 02 21:11:28.766895 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:28.766854    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2217fe-845cb45cb9-w6tr6"]
Jul 02 21:11:29.493693 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:29.493657    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bce8761-9930-452e-80ad-883979b204ea" path="/var/lib/kubelet/pods/5bce8761-9930-452e-80ad-883979b204ea/volumes"
Jul 02 21:11:40.282837 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:40.282799    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-22pv8_4be2f398-248d-420e-9892-eddf4f21de0b/manager/0.log"
Jul 02 21:11:40.401871 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:40.401841    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wbwnt_463a6385-9165-43cc-ab3a-144e9ccc67ed/manager/0.log"
Jul 02 21:11:40.546421 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:40.546338    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7dc556f97c-92jqf_dc182790-91ff-4305-baf1-13a7586999b8/manager/0.log"
Jul 02 21:11:41.053328 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:41.053295    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b94c7db-7xtrf_51feb983-0719-40c6-b60e-743d9ab76e08/copy-manifests/0.log"
Jul 02 21:11:41.060654 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:41.060625    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b94c7db-7xtrf_51feb983-0719-40c6-b60e-743d9ab76e08/manager/0.log"
Jul 02 21:11:43.332443 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:43.332398    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-r7hkw_b90a44b7-562c-4131-83b5-fd7e4cadef79/manager/0.log"
Jul 02 21:11:44.881978 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:44.881948    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-m442z_16c82345-af6f-4487-bc57-98f82a03d701/main/0.log"
Jul 02 21:11:45.263567 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:45.263482    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8z4s6_2251acc4-d970-44cf-89bd-8f35ea706a46/main/0.log"
Jul 02 21:11:45.374325 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:45.374296    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-w26kl_822d5748-c2ba-41d2-83c1-1c471594aab9/main/0.log"
Jul 02 21:11:52.789641 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:52.789555    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6qb52_f8702e6e-b6c8-46a3-b197-a711010573f7/global-pull-secret-syncer/0.log"
Jul 02 21:11:52.883416 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:52.883380    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v857j_19657f2b-e66e-43f9-b10a-e0fb44bc558a/konnectivity-agent/0.log"
Jul 02 21:11:52.940318 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:52.940280    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-48.ec2.internal_a78b67e7c9186cd3c1495e8dc72b2fcd/haproxy/0.log"
Jul 02 21:11:58.734163 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:11:58.734067    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-r7hkw_b90a44b7-562c-4131-83b5-fd7e4cadef79/manager/0.log"
Jul 02 21:12:00.515714 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:00.515624    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-n89fk_9f2773c5-c32d-454c-8d1c-80285145d19b/cluster-monitoring-operator/0.log"
Jul 02 21:12:00.667266 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:00.667236    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-qqwxc_3a90942a-da08-4b75-8182-ec30f563224c/monitoring-plugin/0.log"
Jul 02 21:12:00.790628 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:00.790597    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vhrpd_6b9a8ddd-ce0e-4980-ae34-8e6958f54df9/node-exporter/0.log"
Jul 02 21:12:00.815759 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:00.815730    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vhrpd_6b9a8ddd-ce0e-4980-ae34-8e6958f54df9/kube-rbac-proxy/0.log"
Jul 02 21:12:00.861787 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:00.861758    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vhrpd_6b9a8ddd-ce0e-4980-ae34-8e6958f54df9/init-textfile/0.log"
Jul 02 21:12:01.187518 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:01.187437    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e83b7ab-fd47-4af0-bf31-4647edf9a138/prometheus/0.log"
Jul 02 21:12:01.215037 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:01.215008    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e83b7ab-fd47-4af0-bf31-4647edf9a138/config-reloader/0.log"
Jul 02 21:12:01.248532 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:01.243222    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e83b7ab-fd47-4af0-bf31-4647edf9a138/thanos-sidecar/0.log"
Jul 02 21:12:01.269928 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:01.269898    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e83b7ab-fd47-4af0-bf31-4647edf9a138/kube-rbac-proxy-web/0.log"
Jul 02 21:12:01.297165 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:01.297138    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e83b7ab-fd47-4af0-bf31-4647edf9a138/kube-rbac-proxy/0.log"
Jul 02 21:12:01.328768 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:01.328742    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e83b7ab-fd47-4af0-bf31-4647edf9a138/kube-rbac-proxy-thanos/0.log"
Jul 02 21:12:01.356679 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:01.356646    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e83b7ab-fd47-4af0-bf31-4647edf9a138/init-config-reloader/0.log"
Jul 02 21:12:01.572783 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:01.572753    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cfb5dd6f-jhbgs_ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb/thanos-query/0.log"
Jul 02 21:12:01.606218 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:01.606185    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cfb5dd6f-jhbgs_ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb/kube-rbac-proxy-web/0.log"
Jul 02 21:12:01.631039 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:01.631011    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cfb5dd6f-jhbgs_ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb/kube-rbac-proxy/0.log"
Jul 02 21:12:01.658105 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:01.658076    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cfb5dd6f-jhbgs_ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb/prom-label-proxy/0.log"
Jul 02 21:12:01.683492 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:01.683461    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cfb5dd6f-jhbgs_ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb/kube-rbac-proxy-rules/0.log"
Jul 02 21:12:01.714138 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:01.714106    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cfb5dd6f-jhbgs_ca2fe25c-2b6d-4896-a3b9-ef1941a4fabb/kube-rbac-proxy-metrics/0.log"
Jul 02 21:12:02.194090 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.194051    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"]
Jul 02 21:12:02.194455 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.194442    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bce8761-9930-452e-80ad-883979b204ea" containerName="maas-api"
Jul 02 21:12:02.194504 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.194456    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bce8761-9930-452e-80ad-883979b204ea" containerName="maas-api"
Jul 02 21:12:02.194504 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.194467    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfd17bcf-b745-409d-b238-1950b7a57e11" containerName="maas-api"
Jul 02 21:12:02.194504 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.194473    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd17bcf-b745-409d-b238-1950b7a57e11" containerName="maas-api"
Jul 02 21:12:02.194504 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.194488    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc956c8-9830-4b41-81c7-6c69b14a7396" containerName="main"
Jul 02 21:12:02.194504 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.194494    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc956c8-9830-4b41-81c7-6c69b14a7396" containerName="main"
Jul 02 21:12:02.194683 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.194547    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfd17bcf-b745-409d-b238-1950b7a57e11" containerName="maas-api"
Jul 02 21:12:02.194683 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.194556    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bce8761-9930-452e-80ad-883979b204ea" containerName="maas-api"
Jul 02 21:12:02.194683 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.194564    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cc956c8-9830-4b41-81c7-6c69b14a7396" containerName="main"
Jul 02 21:12:02.198827 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.198801    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.201498 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.201466    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mgldh\"/\"default-dockercfg-7xkmp\""
Jul 02 21:12:02.202448 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.202430    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mgldh\"/\"kube-root-ca.crt\""
Jul 02 21:12:02.202531 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.202448    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mgldh\"/\"openshift-service-ca.crt\""
Jul 02 21:12:02.207451 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.207426    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"]
Jul 02 21:12:02.353032 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.352991    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/132efa70-e1af-46b8-8cd6-43e37a4db1fb-podres\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.353032 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.353039    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/132efa70-e1af-46b8-8cd6-43e37a4db1fb-proc\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.353282 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.353077    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxgsf\" (UniqueName: \"kubernetes.io/projected/132efa70-e1af-46b8-8cd6-43e37a4db1fb-kube-api-access-wxgsf\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.353282 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.353114    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/132efa70-e1af-46b8-8cd6-43e37a4db1fb-lib-modules\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.353282 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.353188    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/132efa70-e1af-46b8-8cd6-43e37a4db1fb-sys\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.454659 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.454565    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxgsf\" (UniqueName: \"kubernetes.io/projected/132efa70-e1af-46b8-8cd6-43e37a4db1fb-kube-api-access-wxgsf\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.454659 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.454609    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/132efa70-e1af-46b8-8cd6-43e37a4db1fb-lib-modules\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.454859 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.454671    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/132efa70-e1af-46b8-8cd6-43e37a4db1fb-sys\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.454859 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.454734    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/132efa70-e1af-46b8-8cd6-43e37a4db1fb-podres\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.454859 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.454772    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/132efa70-e1af-46b8-8cd6-43e37a4db1fb-proc\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.454859 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.454797    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/132efa70-e1af-46b8-8cd6-43e37a4db1fb-sys\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.454859 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.454846    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/132efa70-e1af-46b8-8cd6-43e37a4db1fb-podres\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.455062 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.454857    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/132efa70-e1af-46b8-8cd6-43e37a4db1fb-lib-modules\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.455062 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.454860    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/132efa70-e1af-46b8-8cd6-43e37a4db1fb-proc\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.464636 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.464597    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxgsf\" (UniqueName: \"kubernetes.io/projected/132efa70-e1af-46b8-8cd6-43e37a4db1fb-kube-api-access-wxgsf\") pod \"perf-node-gather-daemonset-6kwzp\" (UID: \"132efa70-e1af-46b8-8cd6-43e37a4db1fb\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.510202 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.510161    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.686506 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.686474    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"]
Jul 02 21:12:02.688402 ip-10-0-132-48 kubenswrapper[2586]: W0702 21:12:02.688373    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod132efa70_e1af_46b8_8cd6_43e37a4db1fb.slice/crio-7bd0892afce1dc8887c5a18bee28fffc1746da0f81323180c93024bf41449f1b WatchSource:0}: Error finding container 7bd0892afce1dc8887c5a18bee28fffc1746da0f81323180c93024bf41449f1b: Status 404 returned error can't find the container with id 7bd0892afce1dc8887c5a18bee28fffc1746da0f81323180c93024bf41449f1b
Jul 02 21:12:02.902639 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.902605    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp" event={"ID":"132efa70-e1af-46b8-8cd6-43e37a4db1fb","Type":"ContainerStarted","Data":"6eeed1405a04687d35a6a5cbf40aeb5bf16484f92c7234c8ef75127c522eab07"}
Jul 02 21:12:02.902846 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.902656    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp" event={"ID":"132efa70-e1af-46b8-8cd6-43e37a4db1fb","Type":"ContainerStarted","Data":"7bd0892afce1dc8887c5a18bee28fffc1746da0f81323180c93024bf41449f1b"}
Jul 02 21:12:02.902846 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.902691    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:02.920362 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:02.920294    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp" podStartSLOduration=0.920271703 podStartE2EDuration="920.271703ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:12:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:12:02.919629734 +0000 UTC m=+2346.042798768" watchObservedRunningTime="2026-07-02 21:12:02.920271703 +0000 UTC m=+2346.043440739"
Jul 02 21:12:03.449864 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:03.449825    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/1.log"
Jul 02 21:12:03.453926 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:03.453897    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rd826_e65e32d6-7424-4cc3-b3ae-597696d7a09b/console-operator/2.log"
Jul 02 21:12:04.530298 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:04.530265    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-fwssc_b329bcd6-6bc1-4ef2-b4dd-c00089308cd6/volume-data-source-validator/0.log"
Jul 02 21:12:05.720612 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:05.720583    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sk5kl_38989e8b-a4f6-4305-b6fb-aa79e43cb7e6/dns/0.log"
Jul 02 21:12:05.748163 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:05.748117    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sk5kl_38989e8b-a4f6-4305-b6fb-aa79e43cb7e6/kube-rbac-proxy/0.log"
Jul 02 21:12:05.776069 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:05.776035    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c7fkk_a6196c4a-539c-4a63-b16d-d509bc6d8885/dns-node-resolver/0.log"
Jul 02 21:12:06.406312 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:06.406255    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6654f959fc-lnwzj_6cf31eff-b31d-4456-b86d-b5053d0b6b9a/registry/0.log"
Jul 02 21:12:06.495405 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:06.495375    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f7n4v_123bcb87-a2a0-4790-88d0-a97fd0ae0436/node-ca/0.log"
Jul 02 21:12:08.707507 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:08.707473    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w5rwx_e6a67d73-8d0e-4800-912c-70f15a77dd91/serve-healthcheck-canary/0.log"
Jul 02 21:12:08.917696 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:08.917663    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-6kwzp"
Jul 02 21:12:09.242533 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:09.242501    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8vsgm_1155da9c-315a-4420-9b3c-e50a246c4013/kube-rbac-proxy/0.log"
Jul 02 21:12:09.273178 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:09.273144    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8vsgm_1155da9c-315a-4420-9b3c-e50a246c4013/exporter/0.log"
Jul 02 21:12:09.298812 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:09.298786    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8vsgm_1155da9c-315a-4420-9b3c-e50a246c4013/extractor/0.log"
Jul 02 21:12:11.946899 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:11.946856    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-22pv8_4be2f398-248d-420e-9892-eddf4f21de0b/manager/0.log"
Jul 02 21:12:12.090467 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:12.090438    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wbwnt_463a6385-9165-43cc-ab3a-144e9ccc67ed/manager/0.log"
Jul 02 21:12:12.185198 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:12.185161    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7dc556f97c-92jqf_dc182790-91ff-4305-baf1-13a7586999b8/manager/0.log"
Jul 02 21:12:12.383569 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:12.383535    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b94c7db-7xtrf_51feb983-0719-40c6-b60e-743d9ab76e08/manager/0.log"
Jul 02 21:12:12.411247 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:12.411223    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b94c7db-7xtrf_51feb983-0719-40c6-b60e-743d9ab76e08/copy-manifests/0.log"
Jul 02 21:12:13.790508 ip-10-0-132-48 kubenswrapper[2586]: I0702 21:12:13.790479    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-787649fbc-wd64n_43ee67cb-c6d2-4ff8-86b3-878e19caad6e/manager/0.log"