Jul 24 13:42:55.716486 ip-10-0-132-200 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 13:42:55.716503 ip-10-0-132-200 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 13:42:55.716513 ip-10-0-132-200 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 13:42:55.716868 ip-10-0-132-200 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 13:43:05.374694 ip-10-0-132-200 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 24 13:43:05.374709 ip-10-0-132-200 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f0f0c8a5e5354c43b959d0773fe95186 --
Jul 24 13:44:51.658551 ip-10-0-132-200 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 13:44:52.003765 ip-10-0-132-200 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 13:44:52.003765 ip-10-0-132-200 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 13:44:52.003765 ip-10-0-132-200 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 13:44:52.003765 ip-10-0-132-200 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 13:44:52.003765 ip-10-0-132-200 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 13:44:52.005464 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.005368    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 13:44:52.009925 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009901    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:44:52.009925 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009920    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:44:52.009925 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009924    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:44:52.009925 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009927    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:44:52.009925 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009930    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:44:52.009925 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009933    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009937    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009940    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009943    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009945    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009948    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009953    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009958    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009960    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009964    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009969    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009972    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009975    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009977    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009980    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009983    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009985    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.009989    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010006    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:44:52.010162 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010009    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010012    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010015    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010018    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010020    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010023    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010025    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010028    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010030    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010033    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010035    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010038    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010040    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010043    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010045    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010048    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010051    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010054    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010056    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010059    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:44:52.010635 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010062    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010064    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010067    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010069    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010072    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010074    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010079    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010081    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010084    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010086    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010088    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010091    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010093    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010096    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010098    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010101    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010103    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010106    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010109    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010111    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:44:52.011116 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010113    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010116    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010118    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010120    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010123    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010126    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010128    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010132    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010135    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010138    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010141    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010144    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010146    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010149    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010152    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010154    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010157    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010159    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010162    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010165    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:44:52.011615 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010167    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010184    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010188    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010190    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010193    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010196    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010199    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010201    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010204    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010206    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010209    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010211    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010214    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010216    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010219    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010906    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010912    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010915    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010918    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010921    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:44:52.012153 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010924    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010927    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010930    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010932    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010935    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010937    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010940    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010943    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010945    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010948    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010950    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010953    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010956    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010959    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010961    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010964    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010967    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010969    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010972    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010974    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:44:52.012652 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010977    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010979    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010982    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010984    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010986    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010989    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010994    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010997    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.010999    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011001    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011004    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011007    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011009    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011012    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011014    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011017    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011021    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011025    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011028    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:44:52.013141 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011030    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011032    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011035    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011038    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011040    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011043    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011046    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011048    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011051    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011053    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011056    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011058    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011060    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011063    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011065    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011068    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011070    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011072    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011075    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011081    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:44:52.013626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011083    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011086    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011088    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011091    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011094    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011096    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011099    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011102    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011105    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011107    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011110    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011112    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011114    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011119    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011124    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011128    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011132    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011135    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011137    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:44:52.014133 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011141    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011144    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011147    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011149    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011152    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011154    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011157    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011159    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011161    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011164    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011166    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011168    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011190    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011193    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011196    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011199    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011633    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011640    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011643    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011646    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:44:52.014626 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011649    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011652    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011655    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011657    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011660    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011663    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011665    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011668    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011670    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011673    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011675    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011678    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011681    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011684    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011687    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011689    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011692    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011695    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011697    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011699    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:44:52.015114 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011702    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011705    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011707    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011710    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011713    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011716    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011719    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011721    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011723    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011727    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011730    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011732    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011735    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011749    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011751    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011754    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011757    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011759    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011762    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:44:52.015646 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011765    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011767    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011770    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011773    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011775    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011778    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011782    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011786    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011790    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011792    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011795    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011797    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011800    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011802    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011805    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011807    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011810    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011813    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011816    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:44:52.016110 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011818    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011821    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011823    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011827    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011830    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011832    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011835    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011837    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011839    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011842    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011844    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011847    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011849    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011853    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011857    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011859    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011862    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011864    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011867    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:44:52.016588 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011869    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011872    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011875    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011877    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011879    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011882    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011884    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011887    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011891    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011893    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011895    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011899    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011902    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011904    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011907    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011909    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011913    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.011916    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.011990    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.011997    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012004    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012008    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 13:44:52.017079 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012012    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012015    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012019    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012023    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012027    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012030    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012033    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012036    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012039    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012042    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012045    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012048    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012051    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012054    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012058    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012060    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012064    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012067    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012070    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012074    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012077    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012082    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012085    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012088    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 13:44:52.017620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012091    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012093    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012098    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012101    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012105    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012108    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012110    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012113    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012116    2565 flags.go:64] FLAG: --enable-server="true"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012119    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012124    2565 flags.go:64] FLAG: --event-burst="100"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012127    2565 flags.go:64] FLAG: --event-qps="50"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012130    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012133    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012135    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012139    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012142    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012145    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012147    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012150    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012153    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012156    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012160    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012162    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012165    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 13:44:52.018235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012168    2565 flags.go:64] FLAG: --feature-gates=""
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012186    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012189    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012192    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012196    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012199    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012202    2565 flags.go:64] FLAG: --help="false"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012204    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012207    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012211    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012213    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012217    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012220    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012222    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012225    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012228    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012231    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012233    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012236    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012239    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012241    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012244    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012247    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012249    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 13:44:52.018845 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012252    2565 flags.go:64] FLAG: --lock-file=""
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012255    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012258    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012260    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012266    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012269    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012272    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012275    2565 flags.go:64] FLAG: --logging-format="text"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012278    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012281    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012283    2565 flags.go:64] FLAG: --manifest-url=""
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012286    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012290    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012294    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012298    2565 flags.go:64] FLAG: --max-pods="110"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012301    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012304    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012307    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012310    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012313    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012316    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012318    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012326    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012328    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012331    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 13:44:52.019465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012334    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012337    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012342    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012345    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012347    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012350    2565 flags.go:64] FLAG: --port="10250"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012353    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012356    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04a0793981ee4289b"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012359    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012362    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012365    2565 flags.go:64] FLAG: --register-node="true"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012368    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012371    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012375    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012377    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012380    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012384    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012387    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012389    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012392    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012395    2565 flags.go:64] FLAG: --runonce="false"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012397    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012400    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012403    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012406    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 13:44:52.020078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012408    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012411    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012414    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012417    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012419    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012422    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012425    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012427    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012430    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012433    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012435    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012440    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012443    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012445    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012449    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012452    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012454    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012457    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012460    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012462    2565 flags.go:64] FLAG: --v="2"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012466    2565 flags.go:64] FLAG: --version="false"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012471    2565 flags.go:64] FLAG: --vmodule=""
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012475    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.012478    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 13:44:52.020729 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012592    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012597    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012600    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012603    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012606    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012609    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012612    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012615    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012618    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012620    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012622    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012625    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012627    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012630    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012632    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012635    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012637    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012640    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012642    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012645    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:44:52.021311 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012647    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012649    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012652    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012655    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012657    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012660    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012662    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012665    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012667    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012671    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012675    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012678    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012681    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012683    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012685    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012688    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012690    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012693    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012695    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:44:52.021797 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012697    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012700    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012702    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012705    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012707    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012710    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012712    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012715    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012717    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012720    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012722    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012724    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012727    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012729    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012731    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012734    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012736    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012738    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012741    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012743    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:44:52.022364 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012746    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012748    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012752    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012756    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012759    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012762    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012764    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012767    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012769    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012771    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012774    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012776    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012780    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012783    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012786    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012789    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012791    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012794    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012796    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012799    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:44:52.022858 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012801    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012804    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012806    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012809    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012811    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012814    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012816    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012819    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012821    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012823    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012826    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012828    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012830    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012833    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012837    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012843    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012846    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012849    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012852    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:44:52.023363 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.012856    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:44:52.023823 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.013555    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 13:44:52.023823 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.020675    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 13:44:52.023823 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.020693    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 13:44:52.023823 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.020712    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 13:44:52.023823 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.020721    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 13:44:52.023823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020796    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:44:52.023823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020801    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:44:52.023823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020805    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:44:52.023823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020808    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:44:52.023823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020812    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:44:52.023823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020814    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:44:52.023823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020817    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:44:52.023823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020820    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:44:52.023823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020823    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020826    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020829    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020832    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020834    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020837    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020839    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020842    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020844    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020846    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020851    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020854    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020857    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020859    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020862    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020864    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020873    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020875    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020878    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:44:52.024190 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020881    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020883    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020886    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020889    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020891    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020894    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020896    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020899    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020901    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020909    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020912    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020914    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020917    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020919    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020922    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020924    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020927    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020929    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020931    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020934    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:44:52.024647 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020936    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020939    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020942    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020944    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020946    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020949    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020952    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020954    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020956    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020959    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020967    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020970    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020972    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020975    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020978    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020982    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020985    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020988    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020991    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020994    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:44:52.025126 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020996    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.020999    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021002    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021005    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021007    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021010    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021012    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021016    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021020    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021022    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021025    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021028    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021031    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021033    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021035    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021039    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021041    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021044    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021046    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:44:52.025624 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021049    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021051    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021054    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021056    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021064    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021067    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021069    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021072    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021075    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021077    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021079    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021082    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021084    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.021089    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021271    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:44:52.026091 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021278    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021280    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021283    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021286    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021289    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021291    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021294    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021297    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021300    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021302    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021305    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021308    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021311    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021313    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021316    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021319    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021325    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021328    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021330    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021333    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:44:52.026545 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021335    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021338    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021347    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021349    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021352    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021355    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021357    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021360    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021362    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021365    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021367    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021369    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021372    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021374    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021377    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021379    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021381    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021384    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021386    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021388    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:44:52.027036 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021391    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021393    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021396    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021398    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021400    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021403    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021406    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021409    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021411    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021413    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021416    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021418    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021421    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021423    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021426    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021434    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021436    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021439    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021441    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021443    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:44:52.027560 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021446    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021448    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021450    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021453    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021455    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021457    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021460    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021462    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021464    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021467    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021470    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021472    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021474    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021478    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021481    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021484    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021486    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021489    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021491    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:44:52.028328 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021494    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021498    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021501    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021503    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021505    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021508    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021510    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021514    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021517    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021526    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021529    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021532    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021534    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021537    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021539    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021542    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021544    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021547    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:44:52.028823 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:52.021549    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:44:52.029403 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.021553    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 13:44:52.029403 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.021658    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 13:44:52.029403 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.023810    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 13:44:52.029403 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.025123    2565 server.go:1019] "Starting client certificate rotation"
Jul 24 13:44:52.029403 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.025242    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 13:44:52.029403 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.025954    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 13:44:52.029403 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.027659    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 13:44:52.030041 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.030002    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 13:44:52.038324 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.038302    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 24 13:44:52.040405 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.040389    2565 log.go:25] "Validated CRI v1 image API"
Jul 24 13:44:52.043606 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.043593    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 13:44:52.045784 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.045764    2565 fs.go:135] Filesystem UUIDs: map[16e8e2a6-8139-4659-9255-27e7ed948478:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ff6db1c8-46ce-4436-a461-902ba48b377e:/dev/nvme0n1p4]
Jul 24 13:44:52.045828 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.045785    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 13:44:52.051697 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.051555    2565 manager.go:216] Machine: {Timestamp:2026-07-24 13:44:52.049569916 +0000 UTC m=+0.284921269 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3260203 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec279d2d8838fc0f1221e7e776ce82f2 SystemUUID:ec279d2d-8838-fc0f-1221-e7e776ce82f2 BootID:f0f0c8a5-e535-4c43-b959-d0773fe95186 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:24:6e:a9:33:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:24:6e:a9:33:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:da:f2:3f:03:a1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 13:44:52.051697 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.051695    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 13:44:52.051837 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.051794    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 13:44:52.054544 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.054518    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 13:44:52.054689 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.054549    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-200.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 13:44:52.055860 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.055850    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 13:44:52.055901 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.055863    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 13:44:52.055901 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.055870    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 13:44:52.056012 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.055995    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 13:44:52.056491 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.056479    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 13:44:52.057883 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.057873    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 13:44:52.061884 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.061872    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 13:44:52.062218 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.062207    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 13:44:52.062254 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.062241    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 13:44:52.062254 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.062251    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 13:44:52.062311 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.062271    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 13:44:52.062311 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.062280    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 24 13:44:52.062311 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.062289    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 13:44:52.062755 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.062735    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 13:44:52.062755 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.062755    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 13:44:52.064711 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.064675    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 13:44:52.066285 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.066269    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 13:44:52.066328 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.066302    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 13:44:52.067443 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.067432    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 13:44:52.067491 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.067448    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 13:44:52.067491 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.067455    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 13:44:52.067491 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.067460    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 13:44:52.067491 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.067468    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 13:44:52.067491 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.067474    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 13:44:52.067491 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.067482    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 13:44:52.067491 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.067487    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 13:44:52.067665 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.067497    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 13:44:52.067665 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.067502    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 13:44:52.067665 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.067510    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 13:44:52.067665 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.067515    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 13:44:52.071949 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.071917    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 13:44:52.071949 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.071949    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 13:44:52.074901 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.074881    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-200.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 13:44:52.075382 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.075357    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 13:44:52.075470 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.075357    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 13:44:52.076360 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.076344    2565 server.go:1268] "Started kubelet"
Jul 24 13:44:52.076442 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.076415    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 13:44:52.076541 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.076483    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 13:44:52.076620 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.076558    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 13:44:52.077349 ip-10-0-132-200 systemd[1]: Started Kubernetes Kubelet.
Jul 24 13:44:52.078396 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.078283    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 13:44:52.078396 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.078374    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 13:44:52.082840 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.081905    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-200.ec2.internal.18c53db8fe8ebc5b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-200.ec2.internal,UID:ip-10-0-132-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-200.ec2.internal,},FirstTimestamp:2026-07-24 13:44:52.076313691 +0000 UTC m=+0.311665043,LastTimestamp:2026-07-24 13:44:52.076313691 +0000 UTC m=+0.311665043,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-200.ec2.internal,}"
Jul 24 13:44:52.083061 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.083045    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 13:44:52.086553 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.086535    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 13:44:52.086648 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.086553    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 13:44:52.086648 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.086607    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-200.ec2.internal\" not found"
Jul 24 13:44:52.087380 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.087355    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 13:44:52.087380 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.087368    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 13:44:52.087527 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.087385    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 13:44:52.087527 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.087367    2565 factory.go:55] Registering systemd factory
Jul 24 13:44:52.087527 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.087411    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 24 13:44:52.087527 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.087500    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 13:44:52.087527 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.087508    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 13:44:52.087710 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.087662    2565 factory.go:153] Registering CRI-O factory
Jul 24 13:44:52.087710 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.087674    2565 factory.go:223] Registration of the crio container factory successfully
Jul 24 13:44:52.087788 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.087728    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 13:44:52.087788 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.087764    2565 factory.go:103] Registering Raw factory
Jul 24 13:44:52.087788 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.087775    2565 manager.go:1196] Started watching for new ooms in manager
Jul 24 13:44:52.088277 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.088263    2565 manager.go:349] Starting recovery of all containers
Jul 24 13:44:52.097430 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.097252    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 13:44:52.097555 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.097530    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 13:44:52.098999 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.098977    2565 manager.go:354] Recovery completed
Jul 24 13:44:52.105322 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.105309    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:44:52.106983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.106960    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bgt7g"
Jul 24 13:44:52.107335 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.107321    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:44:52.107387 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.107349    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:44:52.107387 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.107359    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:44:52.107944 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.107929    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 13:44:52.107944 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.107943    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 13:44:52.108079 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.107957    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:44:52.108079 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.107962    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 13:44:52.108704 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.108691    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:44:52.108754 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.108717    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:44:52.108754 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.108728    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:44:52.109521 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.109459    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-200.ec2.internal.18c53db90068179c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-200.ec2.internal,UID:ip-10-0-132-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-200.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-200.ec2.internal,},FirstTimestamp:2026-07-24 13:44:52.10733558 +0000 UTC m=+0.342686936,LastTimestamp:2026-07-24 13:44:52.10733558 +0000 UTC m=+0.342686936,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-200.ec2.internal,}"
Jul 24 13:44:52.110240 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.110224    2565 policy_none.go:49] "None policy: Start"
Jul 24 13:44:52.110297 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.110246    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 13:44:52.110297 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.110260    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 13:44:52.112245 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.112232    2565 policy_none.go:47] "Start"
Jul 24 13:44:52.115382 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.115360    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bgt7g"
Jul 24 13:44:52.117108 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.117044    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-200.ec2.internal.18c53db900685d60  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-200.ec2.internal,UID:ip-10-0-132-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-200.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-200.ec2.internal,},FirstTimestamp:2026-07-24 13:44:52.10735344 +0000 UTC m=+0.342704794,LastTimestamp:2026-07-24 13:44:52.10735344 +0000 UTC m=+0.342704794,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-200.ec2.internal,}"
Jul 24 13:44:52.119059 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.119002    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-200.ec2.internal.18c53db900688141  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-200.ec2.internal,UID:ip-10-0-132-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-200.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-200.ec2.internal,},FirstTimestamp:2026-07-24 13:44:52.107362625 +0000 UTC m=+0.342713979,LastTimestamp:2026-07-24 13:44:52.107362625 +0000 UTC m=+0.342713979,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-200.ec2.internal,}"
Jul 24 13:44:52.153926 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.153906    2565 manager.go:337] "Starting Device Plugin manager"
Jul 24 13:44:52.154067 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.153946    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 13:44:52.154067 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.153957    2565 server.go:87] "Starting device plugin registration server"
Jul 24 13:44:52.154290 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.154273    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 13:44:52.154379 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.154302    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 13:44:52.154423 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.154388    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 13:44:52.154479 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.154467    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 13:44:52.154520 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.154482    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 13:44:52.155069 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.155050    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 13:44:52.155159 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.155094    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-200.ec2.internal\" not found"
Jul 24 13:44:52.187310 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.187269    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 13:44:52.194953 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.188581    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 13:44:52.194953 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.188629    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 13:44:52.194953 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.188657    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 13:44:52.194953 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.188696    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 13:44:52.194953 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.190947    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:44:52.255145 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.255066    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:44:52.256284 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.256266    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:44:52.256400 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.256301    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:44:52.256400 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.256315    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:44:52.256400 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.256343    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.265505 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.265483    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.265505 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.265507    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-200.ec2.internal\": node \"ip-10-0-132-200.ec2.internal\" not found"
Jul 24 13:44:52.289834 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.289801    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-200.ec2.internal"]
Jul 24 13:44:52.290003 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.289885    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:44:52.290824 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.290802    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:44:52.290933 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.290835    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:44:52.290933 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.290845    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:44:52.293200 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.293188    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:44:52.293323 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.293290    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.293377 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.293342    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:44:52.293893 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.293878    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:44:52.293977 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.293904    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:44:52.293977 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.293915    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:44:52.293977 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.293933    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:44:52.293977 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.293942    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:44:52.294159 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.293917    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:44:52.296265 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.296249    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.296339 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.296274    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:44:52.296964 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.296948    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:44:52.297045 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.296976    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:44:52.297045 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.296990    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:44:52.297374 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.297359    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-200.ec2.internal\" not found"
Jul 24 13:44:52.310774 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.310754    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-200.ec2.internal\" not found" node="ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.315022 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.315005    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-200.ec2.internal\" not found" node="ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.389442 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.389406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6442d36812aff0c99a37926bd67de65f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal\" (UID: \"6442d36812aff0c99a37926bd67de65f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.389442 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.389437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6442d36812aff0c99a37926bd67de65f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal\" (UID: \"6442d36812aff0c99a37926bd67de65f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.389647 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.389454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3e716dbf694181dd98fd7be7ff31819b-config\") pod \"kube-apiserver-proxy-ip-10-0-132-200.ec2.internal\" (UID: \"3e716dbf694181dd98fd7be7ff31819b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.398026 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.398003    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-200.ec2.internal\" not found"
Jul 24 13:44:52.490600 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.490509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6442d36812aff0c99a37926bd67de65f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal\" (UID: \"6442d36812aff0c99a37926bd67de65f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.490731 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.490614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6442d36812aff0c99a37926bd67de65f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal\" (UID: \"6442d36812aff0c99a37926bd67de65f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.490731 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.490631    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3e716dbf694181dd98fd7be7ff31819b-config\") pod \"kube-apiserver-proxy-ip-10-0-132-200.ec2.internal\" (UID: \"3e716dbf694181dd98fd7be7ff31819b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.490731 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.490570    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6442d36812aff0c99a37926bd67de65f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal\" (UID: \"6442d36812aff0c99a37926bd67de65f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.490731 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.490667    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3e716dbf694181dd98fd7be7ff31819b-config\") pod \"kube-apiserver-proxy-ip-10-0-132-200.ec2.internal\" (UID: \"3e716dbf694181dd98fd7be7ff31819b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.490731 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.490703    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6442d36812aff0c99a37926bd67de65f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal\" (UID: \"6442d36812aff0c99a37926bd67de65f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.498628 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.498607    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-200.ec2.internal\" not found"
Jul 24 13:44:52.599574 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.599500    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-200.ec2.internal\" not found"
Jul 24 13:44:52.612698 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.612670    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.619323 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:52.619306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:52.700326 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.700285    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-200.ec2.internal\" not found"
Jul 24 13:44:52.800820 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.800786    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-200.ec2.internal\" not found"
Jul 24 13:44:52.901431 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:52.901357    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-200.ec2.internal\" not found"
Jul 24 13:44:53.001967 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.001935    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-200.ec2.internal\" not found"
Jul 24 13:44:53.011121 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.011103    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:44:53.025061 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.025034    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 13:44:53.025178 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.025160    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 13:44:53.025262 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.025233    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 13:44:53.064345 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.064309    2565 apiserver.go:52] "Watching apiserver"
Jul 24 13:44:53.086568 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.086536    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 13:44:53.086740 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.086660    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 13:44:53.086740 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.086670    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:53.086938 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.086919    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-jrrcp","openshift-network-operator/iptables-alerter-8xn8t","openshift-ovn-kubernetes/ovnkube-node-7qgq7","kube-system/konnectivity-agent-v2vhl","openshift-cluster-node-tuning-operator/tuned-8hdgv","openshift-dns/node-resolver-gb6xn","openshift-image-registry/node-ca-5q8zz","kube-system/global-pull-secret-syncer-j2hpq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj","openshift-multus/multus-additional-cni-plugins-scx8p","openshift-multus/multus-tvw8p","openshift-multus/network-metrics-daemon-l7qzc"]
Jul 24 13:44:53.089740 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.089722    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:44:53.089866 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.089844    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:44:53.092089 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.092074    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8xn8t"
Jul 24 13:44:53.093906 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.093879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prh72\" (UniqueName: \"kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72\") pod \"network-check-target-jrrcp\" (UID: \"6dd4417c-eb39-41e8-bda7-d128fec501c2\") " pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:44:53.096206 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.095237    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 13:44:53.096206 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.095336    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.096206 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.095582    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q6h2c\""
Jul 24 13:44:53.096206 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.095666    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 13:44:53.096510 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.096350    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 13:44:53.098799 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.098777    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v2vhl"
Jul 24 13:44:53.100365 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.100342    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 13:44:53.100477 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.100351    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 13:44:53.101291 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.101272    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.101368 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.101300    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 13:44:53.102542 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.102518    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 13:44:53.102639 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.102556    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 13:44:53.102639 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.102575    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 13:44:53.102639 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.102577    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mhlxc\""
Jul 24 13:44:53.102793 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.102697    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jmhln\""
Jul 24 13:44:53.102844 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.102813    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 13:44:53.102985 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.102959    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 13:44:53.103682 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.103667    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9ppln\""
Jul 24 13:44:53.103784 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.103719    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 13:44:53.103784 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.103772    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 13:44:53.103892 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.103781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gb6xn"
Jul 24 13:44:53.105874 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.105857    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 13:44:53.105968 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.105946    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-200.ec2.internal"
Jul 24 13:44:53.106187 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.106168    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 13:44:53.106467 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.106446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5q8zz"
Jul 24 13:44:53.106542 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.106528    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ddj79\""
Jul 24 13:44:53.106708 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.106596    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 13:44:53.109346 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.109033    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 13:44:53.109346 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.109078    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8ghhj\""
Jul 24 13:44:53.109346 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.109336    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 13:44:53.109507 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.109402    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 13:44:53.109631 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.109614    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.110129 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.110113    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 13:44:53.112125 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.112103    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.112229 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.112146    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 13:44:53.112229 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.112144    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 13:44:53.112229 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.112144    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8j6h7\""
Jul 24 13:44:53.112427 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.112228    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 13:44:53.114516 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.114500    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bxn78\""
Jul 24 13:44:53.114751 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.114738    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 13:44:53.114838 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.114825    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 13:44:53.114981 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.114965    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.115043 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.115024    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 13:44:53.115043 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.115038    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 13:44:53.115153 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.115051    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 13:44:53.116420 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.116398    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 13:44:53.117465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.117447    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:44:53.117465 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.117461    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p49bp\""
Jul 24 13:44:53.117558 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.117534    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:44:53.117822 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.117807    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 13:44:53.119970 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.119952    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal"]
Jul 24 13:44:53.120050 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.119982    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-200.ec2.internal"]
Jul 24 13:44:53.120110 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.120060    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:53.120163 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.120127    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:44:53.120598 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.120567    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 13:39:52 +0000 UTC" deadline="2028-02-13 12:54:32.207395853 +0000 UTC"
Jul 24 13:44:53.120647 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.120602    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13655h9m39.086798661s"
Jul 24 13:44:53.133767 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.133750    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t5whq"
Jul 24 13:44:53.143132 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.143103    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t5whq"
Jul 24 13:44:53.188945 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.188922    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 13:44:53.194034 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194011    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-sysctl-d\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.194157 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194039    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-log-socket\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.194157 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9053ceb1-cc33-4d44-9cca-78cea02094de-ovn-node-metrics-cert\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.194157 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-run-k8s-cni-cncf-io\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.194157 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-run-openvswitch\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.194157 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-run-ovn\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.194157 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-node-log\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.194157 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa8826d0-c493-4bbe-85ad-998e7785fb69-hosts-file\") pod \"node-resolver-gb6xn\" (UID: \"aa8826d0-c493-4bbe-85ad-998e7785fb69\") " pod="openshift-dns/node-resolver-gb6xn"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194174    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-systemd\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194189    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44ada86d-d62a-4661-9469-4a159ceeaa9f-tmp\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-os-release\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-hostroot\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8b4f72f-88c5-4211-a38e-6a5c106c07a9-iptables-alerter-script\") pod \"iptables-alerter-8xn8t\" (UID: \"b8b4f72f-88c5-4211-a38e-6a5c106c07a9\") " pod="openshift-network-operator/iptables-alerter-8xn8t"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-socket-dir\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194327    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-cnibin\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/615bc648-ab8d-4fac-8871-297d0c40c620-multus-daemon-config\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-run-multus-certs\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-registration-dir\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/615bc648-ab8d-4fac-8871-297d0c40c620-cni-binary-copy\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8b4f72f-88c5-4211-a38e-6a5c106c07a9-host-slash\") pod \"iptables-alerter-8xn8t\" (UID: \"b8b4f72f-88c5-4211-a38e-6a5c106c07a9\") " pod="openshift-network-operator/iptables-alerter-8xn8t"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-systemd-units\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.194495 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-run\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-multus-socket-dir-parent\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-kubelet-config\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-run-ovn-kubernetes\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-kubernetes\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-system-cni-dir\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-var-lib-kubelet\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmvd4\" (UniqueName: \"kubernetes.io/projected/44ada86d-d62a-4661-9469-4a159ceeaa9f-kube-api-access-xmvd4\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrb7z\" (UniqueName: \"kubernetes.io/projected/88947adf-11e7-403a-b7aa-f3f8c824aacc-kube-api-access-nrb7z\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194677    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-cnibin\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-var-lib-cni-multus\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf45p\" (UniqueName: \"kubernetes.io/projected/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-kube-api-access-xf45p\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcr8t\" (UniqueName: \"kubernetes.io/projected/b8b4f72f-88c5-4211-a38e-6a5c106c07a9-kube-api-access-tcr8t\") pod \"iptables-alerter-8xn8t\" (UID: \"b8b4f72f-88c5-4211-a38e-6a5c106c07a9\") " pod="openshift-network-operator/iptables-alerter-8xn8t"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-run-netns\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.194993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194815    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-etc-kubernetes\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-etc-openvswitch\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-cni-netd\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-sys-fs\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhss9\" (UniqueName: \"kubernetes.io/projected/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-kube-api-access-dhss9\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-kubelet\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-run-systemd\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.194996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9053ceb1-cc33-4d44-9cca-78cea02094de-ovnkube-script-lib\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eca23889-1269-4438-a4a6-6f6b81b08dbc-agent-certs\") pod \"konnectivity-agent-v2vhl\" (UID: \"eca23889-1269-4438-a4a6-6f6b81b08dbc\") " pod="kube-system/konnectivity-agent-v2vhl"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195029    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8826d0-c493-4bbe-85ad-998e7785fb69-tmp-dir\") pod \"node-resolver-gb6xn\" (UID: \"aa8826d0-c493-4bbe-85ad-998e7785fb69\") " pod="openshift-dns/node-resolver-gb6xn"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195063    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-modprobe-d\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-multus-cni-dir\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-slash\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.195746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-var-lib-openvswitch\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqljb\" (UniqueName: \"kubernetes.io/projected/9053ceb1-cc33-4d44-9cca-78cea02094de-kube-api-access-kqljb\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-tuned\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195275    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-etc-selinux\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-run-netns\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b846200-4036-4055-ad01-f563a8beed2e-host\") pod \"node-ca-5q8zz\" (UID: \"9b846200-4036-4055-ad01-f563a8beed2e\") " pod="openshift-image-registry/node-ca-5q8zz"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-sys\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-lib-modules\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-host\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-os-release\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-var-lib-cni-bin\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-var-lib-kubelet\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195525    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-multus-conf-dir\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prh72\" (UniqueName: \"kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72\") pod \"network-check-target-jrrcp\" (UID: \"6dd4417c-eb39-41e8-bda7-d128fec501c2\") " pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-cni-bin\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9053ceb1-cc33-4d44-9cca-78cea02094de-ovnkube-config\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.196418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eca23889-1269-4438-a4a6-6f6b81b08dbc-konnectivity-ca\") pod \"konnectivity-agent-v2vhl\" (UID: \"eca23889-1269-4438-a4a6-6f6b81b08dbc\") " pod="kube-system/konnectivity-agent-v2vhl"
Jul 24 13:44:53.196999 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-sysctl-conf\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.196999 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-system-cni-dir\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.196999 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-dbus\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:53.196999 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9053ceb1-cc33-4d44-9cca-78cea02094de-env-overrides\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.196999 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhznh\" (UniqueName: \"kubernetes.io/projected/aa8826d0-c493-4bbe-85ad-998e7785fb69-kube-api-access-lhznh\") pod \"node-resolver-gb6xn\" (UID: \"aa8826d0-c493-4bbe-85ad-998e7785fb69\") " pod="openshift-dns/node-resolver-gb6xn"
Jul 24 13:44:53.196999 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b846200-4036-4055-ad01-f563a8beed2e-serviceca\") pod \"node-ca-5q8zz\" (UID: \"9b846200-4036-4055-ad01-f563a8beed2e\") " pod="openshift-image-registry/node-ca-5q8zz"
Jul 24 13:44:53.196999 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195777    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpbjm\" (UniqueName: \"kubernetes.io/projected/9b846200-4036-4055-ad01-f563a8beed2e-kube-api-access-wpbjm\") pod \"node-ca-5q8zz\" (UID: \"9b846200-4036-4055-ad01-f563a8beed2e\") " pod="openshift-image-registry/node-ca-5q8zz"
Jul 24 13:44:53.196999 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-sysconfig\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.196999 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-device-dir\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.196999 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdphq\" (UniqueName: \"kubernetes.io/projected/615bc648-ab8d-4fac-8871-297d0c40c620-kube-api-access-fdphq\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.196999 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.195910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.201555 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.201536    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:44:53.201555 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.201556    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:44:53.201678 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.201567    2565 projected.go:196] Error preparing data for projected volume kube-api-access-prh72 for pod openshift-network-diagnostics/network-check-target-jrrcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:44:53.201678 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.201619    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72 podName:6dd4417c-eb39-41e8-bda7-d128fec501c2 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:53.701603973 +0000 UTC m=+1.936955347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-prh72" (UniqueName: "kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72") pod "network-check-target-jrrcp" (UID: "6dd4417c-eb39-41e8-bda7-d128fec501c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:44:53.296860 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.296821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-kubernetes\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.296860 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.296859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-system-cni-dir\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.297108 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.296883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-var-lib-kubelet\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.297108 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.296960    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-var-lib-kubelet\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.297108 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.296962    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-system-cni-dir\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.297108 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.296963    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-kubernetes\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.297108 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.296961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmvd4\" (UniqueName: \"kubernetes.io/projected/44ada86d-d62a-4661-9469-4a159ceeaa9f-kube-api-access-xmvd4\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.297108 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrb7z\" (UniqueName: \"kubernetes.io/projected/88947adf-11e7-403a-b7aa-f3f8c824aacc-kube-api-access-nrb7z\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.297108 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-cnibin\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.297108 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297094    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-var-lib-cni-multus\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf45p\" (UniqueName: \"kubernetes.io/projected/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-kube-api-access-xf45p\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297199    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-cnibin\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297265    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-var-lib-cni-multus\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297307    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcr8t\" (UniqueName: \"kubernetes.io/projected/b8b4f72f-88c5-4211-a38e-6a5c106c07a9-kube-api-access-tcr8t\") pod \"iptables-alerter-8xn8t\" (UID: \"b8b4f72f-88c5-4211-a38e-6a5c106c07a9\") " pod="openshift-network-operator/iptables-alerter-8xn8t"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-run-netns\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297379    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-etc-kubernetes\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297405    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-etc-openvswitch\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-run-netns\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297467    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-cni-netd\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.297440    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.297491    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297491    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-etc-kubernetes\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-cni-netd\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-sys-fs\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.297534 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-etc-openvswitch\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-sys-fs\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.297564    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret podName:57dfab3c-f8a9-4e6f-b953-6bfd7036ded0 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:53.797542745 +0000 UTC m=+2.032894088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret") pod "global-pull-secret-syncer-j2hpq" (UID: "57dfab3c-f8a9-4e6f-b953-6bfd7036ded0") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.297600    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs podName:6ec1c31e-6c92-4f1d-a9e3-0228915d6893 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:53.79759318 +0000 UTC m=+2.032944521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs") pod "network-metrics-daemon-l7qzc" (UID: "6ec1c31e-6c92-4f1d-a9e3-0228915d6893") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhss9\" (UniqueName: \"kubernetes.io/projected/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-kube-api-access-dhss9\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297667    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-kubelet\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-run-systemd\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9053ceb1-cc33-4d44-9cca-78cea02094de-ovnkube-script-lib\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297736    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-kubelet\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eca23889-1269-4438-a4a6-6f6b81b08dbc-agent-certs\") pod \"konnectivity-agent-v2vhl\" (UID: \"eca23889-1269-4438-a4a6-6f6b81b08dbc\") " pod="kube-system/konnectivity-agent-v2vhl"
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-run-systemd\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8826d0-c493-4bbe-85ad-998e7785fb69-tmp-dir\") pod \"node-resolver-gb6xn\" (UID: \"aa8826d0-c493-4bbe-85ad-998e7785fb69\") " pod="openshift-dns/node-resolver-gb6xn"
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-modprobe-d\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-multus-cni-dir\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.298173 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297880    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-slash\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-var-lib-openvswitch\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.297967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqljb\" (UniqueName: \"kubernetes.io/projected/9053ceb1-cc33-4d44-9cca-78cea02094de-kube-api-access-kqljb\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-tuned\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298019    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-modprobe-d\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-etc-selinux\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-slash\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-run-netns\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298096    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8826d0-c493-4bbe-85ad-998e7785fb69-tmp-dir\") pod \"node-resolver-gb6xn\" (UID: \"aa8826d0-c493-4bbe-85ad-998e7785fb69\") " pod="openshift-dns/node-resolver-gb6xn"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b846200-4036-4055-ad01-f563a8beed2e-host\") pod \"node-ca-5q8zz\" (UID: \"9b846200-4036-4055-ad01-f563a8beed2e\") " pod="openshift-image-registry/node-ca-5q8zz"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298152    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-sys\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-lib-modules\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-host\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-os-release\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.299011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-var-lib-cni-bin\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298333    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-multus-cni-dir\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298338    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-var-lib-kubelet\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-etc-selinux\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298390    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-var-lib-kubelet\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-multus-conf-dir\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-var-lib-openvswitch\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298519    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9053ceb1-cc33-4d44-9cca-78cea02094de-ovnkube-script-lib\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298526    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-cni-bin\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298559    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-os-release\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298571    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-lib-modules\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9053ceb1-cc33-4d44-9cca-78cea02094de-ovnkube-config\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298599    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-host\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-multus-conf-dir\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-cni-bin\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eca23889-1269-4438-a4a6-6f6b81b08dbc-konnectivity-ca\") pod \"konnectivity-agent-v2vhl\" (UID: \"eca23889-1269-4438-a4a6-6f6b81b08dbc\") " pod="kube-system/konnectivity-agent-v2vhl"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298621    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b846200-4036-4055-ad01-f563a8beed2e-host\") pod \"node-ca-5q8zz\" (UID: \"9b846200-4036-4055-ad01-f563a8beed2e\") " pod="openshift-image-registry/node-ca-5q8zz"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298573    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.299899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298627    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-var-lib-cni-bin\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298664    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-sys\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298682    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298803    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-run-netns\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-sysctl-conf\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-system-cni-dir\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-dbus\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298910    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9053ceb1-cc33-4d44-9cca-78cea02094de-env-overrides\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298935    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhznh\" (UniqueName: \"kubernetes.io/projected/aa8826d0-c493-4bbe-85ad-998e7785fb69-kube-api-access-lhznh\") pod \"node-resolver-gb6xn\" (UID: \"aa8826d0-c493-4bbe-85ad-998e7785fb69\") " pod="openshift-dns/node-resolver-gb6xn"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-sysctl-conf\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b846200-4036-4055-ad01-f563a8beed2e-serviceca\") pod \"node-ca-5q8zz\" (UID: \"9b846200-4036-4055-ad01-f563a8beed2e\") " pod="openshift-image-registry/node-ca-5q8zz"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.299013    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-dbus\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.299049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-system-cni-dir\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.299303    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9053ceb1-cc33-4d44-9cca-78cea02094de-ovnkube-config\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.299457    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eca23889-1269-4438-a4a6-6f6b81b08dbc-konnectivity-ca\") pod \"konnectivity-agent-v2vhl\" (UID: \"eca23889-1269-4438-a4a6-6f6b81b08dbc\") " pod="kube-system/konnectivity-agent-v2vhl"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.299647    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9053ceb1-cc33-4d44-9cca-78cea02094de-env-overrides\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.299714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b846200-4036-4055-ad01-f563a8beed2e-serviceca\") pod \"node-ca-5q8zz\" (UID: \"9b846200-4036-4055-ad01-f563a8beed2e\") " pod="openshift-image-registry/node-ca-5q8zz"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.298989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpbjm\" (UniqueName: \"kubernetes.io/projected/9b846200-4036-4055-ad01-f563a8beed2e-kube-api-access-wpbjm\") pod \"node-ca-5q8zz\" (UID: \"9b846200-4036-4055-ad01-f563a8beed2e\") " pod="openshift-image-registry/node-ca-5q8zz"
Jul 24 13:44:53.300920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.299982    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-sysconfig\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.299999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-device-dir\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdphq\" (UniqueName: \"kubernetes.io/projected/615bc648-ab8d-4fac-8871-297d0c40c620-kube-api-access-fdphq\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300062    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-sysctl-d\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-log-socket\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300096    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-device-dir\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-sysconfig\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9053ceb1-cc33-4d44-9cca-78cea02094de-ovn-node-metrics-cert\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300131    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300154    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-log-socket\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-run-k8s-cni-cncf-io\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300191    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-sysctl-d\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-run-openvswitch\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-run-ovn\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300240    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-run-k8s-cni-cncf-io\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-node-log\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.301868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa8826d0-c493-4bbe-85ad-998e7785fb69-hosts-file\") pod \"node-resolver-gb6xn\" (UID: \"aa8826d0-c493-4bbe-85ad-998e7785fb69\") " pod="openshift-dns/node-resolver-gb6xn"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-node-log\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300319    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-run-ovn\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-systemd\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-run-openvswitch\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44ada86d-d62a-4661-9469-4a159ceeaa9f-tmp\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300362    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa8826d0-c493-4bbe-85ad-998e7785fb69-hosts-file\") pod \"node-resolver-gb6xn\" (UID: \"aa8826d0-c493-4bbe-85ad-998e7785fb69\") " pod="openshift-dns/node-resolver-gb6xn"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300379    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-os-release\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-systemd\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-hostroot\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-hostroot\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8b4f72f-88c5-4211-a38e-6a5c106c07a9-iptables-alerter-script\") pod \"iptables-alerter-8xn8t\" (UID: \"b8b4f72f-88c5-4211-a38e-6a5c106c07a9\") " pod="openshift-network-operator/iptables-alerter-8xn8t"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-socket-dir\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-os-release\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-cnibin\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/615bc648-ab8d-4fac-8871-297d0c40c620-multus-daemon-config\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-run-multus-certs\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.302702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-cnibin\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-registration-dir\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300605    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-socket-dir\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300689    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/615bc648-ab8d-4fac-8871-297d0c40c620-cni-binary-copy\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8b4f72f-88c5-4211-a38e-6a5c106c07a9-host-slash\") pod \"iptables-alerter-8xn8t\" (UID: \"b8b4f72f-88c5-4211-a38e-6a5c106c07a9\") " pod="openshift-network-operator/iptables-alerter-8xn8t"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-systemd-units\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-run\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-multus-socket-dir-parent\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-kubelet-config\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300848    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-run-ovn-kubernetes\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-host-run-ovn-kubernetes\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.300970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-host-run-multus-certs\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.301020    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88947adf-11e7-403a-b7aa-f3f8c824aacc-registration-dir\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.301140    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.301203    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44ada86d-d62a-4661-9469-4a159ceeaa9f-run\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.301255    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8b4f72f-88c5-4211-a38e-6a5c106c07a9-iptables-alerter-script\") pod \"iptables-alerter-8xn8t\" (UID: \"b8b4f72f-88c5-4211-a38e-6a5c106c07a9\") " pod="openshift-network-operator/iptables-alerter-8xn8t"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.301240    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8b4f72f-88c5-4211-a38e-6a5c106c07a9-host-slash\") pod \"iptables-alerter-8xn8t\" (UID: \"b8b4f72f-88c5-4211-a38e-6a5c106c07a9\") " pod="openshift-network-operator/iptables-alerter-8xn8t"
Jul 24 13:44:53.303411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.301242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/615bc648-ab8d-4fac-8871-297d0c40c620-multus-daemon-config\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.303912 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.301413    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9053ceb1-cc33-4d44-9cca-78cea02094de-systemd-units\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.303912 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.301490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/615bc648-ab8d-4fac-8871-297d0c40c620-multus-socket-dir-parent\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.303912 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.301542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-kubelet-config\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:53.303912 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.301540    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/615bc648-ab8d-4fac-8871-297d0c40c620-cni-binary-copy\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.303912 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.301855    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44ada86d-d62a-4661-9469-4a159ceeaa9f-etc-tuned\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.303912 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.302431    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eca23889-1269-4438-a4a6-6f6b81b08dbc-agent-certs\") pod \"konnectivity-agent-v2vhl\" (UID: \"eca23889-1269-4438-a4a6-6f6b81b08dbc\") " pod="kube-system/konnectivity-agent-v2vhl"
Jul 24 13:44:53.303912 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.302606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9053ceb1-cc33-4d44-9cca-78cea02094de-ovn-node-metrics-cert\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.303912 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.303281    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44ada86d-d62a-4661-9469-4a159ceeaa9f-tmp\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.307759 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.307733    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmvd4\" (UniqueName: \"kubernetes.io/projected/44ada86d-d62a-4661-9469-4a159ceeaa9f-kube-api-access-xmvd4\") pod \"tuned-8hdgv\" (UID: \"44ada86d-d62a-4661-9469-4a159ceeaa9f\") " pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.307947 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.307923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcr8t\" (UniqueName: \"kubernetes.io/projected/b8b4f72f-88c5-4211-a38e-6a5c106c07a9-kube-api-access-tcr8t\") pod \"iptables-alerter-8xn8t\" (UID: \"b8b4f72f-88c5-4211-a38e-6a5c106c07a9\") " pod="openshift-network-operator/iptables-alerter-8xn8t"
Jul 24 13:44:53.308367 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.308341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf45p\" (UniqueName: \"kubernetes.io/projected/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-kube-api-access-xf45p\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:44:53.310314 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.310286    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrb7z\" (UniqueName: \"kubernetes.io/projected/88947adf-11e7-403a-b7aa-f3f8c824aacc-kube-api-access-nrb7z\") pod \"aws-ebs-csi-driver-node-wdwlj\" (UID: \"88947adf-11e7-403a-b7aa-f3f8c824aacc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.312217 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.312184    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdphq\" (UniqueName: \"kubernetes.io/projected/615bc648-ab8d-4fac-8871-297d0c40c620-kube-api-access-fdphq\") pod \"multus-tvw8p\" (UID: \"615bc648-ab8d-4fac-8871-297d0c40c620\") " pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.313597 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.313568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhznh\" (UniqueName: \"kubernetes.io/projected/aa8826d0-c493-4bbe-85ad-998e7785fb69-kube-api-access-lhznh\") pod \"node-resolver-gb6xn\" (UID: \"aa8826d0-c493-4bbe-85ad-998e7785fb69\") " pod="openshift-dns/node-resolver-gb6xn"
Jul 24 13:44:53.313708 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.313568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqljb\" (UniqueName: \"kubernetes.io/projected/9053ceb1-cc33-4d44-9cca-78cea02094de-kube-api-access-kqljb\") pod \"ovnkube-node-7qgq7\" (UID: \"9053ceb1-cc33-4d44-9cca-78cea02094de\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.313708 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.313624    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhss9\" (UniqueName: \"kubernetes.io/projected/6bf1d1e1-8363-4e34-bf6a-920e175bfd7f-kube-api-access-dhss9\") pod \"multus-additional-cni-plugins-scx8p\" (UID: \"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f\") " pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.313940 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.313917    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpbjm\" (UniqueName: \"kubernetes.io/projected/9b846200-4036-4055-ad01-f563a8beed2e-kube-api-access-wpbjm\") pod \"node-ca-5q8zz\" (UID: \"9b846200-4036-4055-ad01-f563a8beed2e\") " pod="openshift-image-registry/node-ca-5q8zz"
Jul 24 13:44:53.425806 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.425710    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8xn8t"
Jul 24 13:44:53.448542 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.448508    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:44:53.448936 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:53.448907    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b4f72f_88c5_4211_a38e_6a5c106c07a9.slice/crio-928fc7ad8cf970d5ced01426ac2b0db0a743fd22749b7d48427c419536eef497 WatchSource:0}: Error finding container 928fc7ad8cf970d5ced01426ac2b0db0a743fd22749b7d48427c419536eef497: Status 404 returned error can't find the container with id 928fc7ad8cf970d5ced01426ac2b0db0a743fd22749b7d48427c419536eef497
Jul 24 13:44:53.452404 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:53.452378    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e716dbf694181dd98fd7be7ff31819b.slice/crio-c6e5b2d6ef8471956e26f4baf668a9cfc0b502b3e5206a636ca2b10e416d424d WatchSource:0}: Error finding container c6e5b2d6ef8471956e26f4baf668a9cfc0b502b3e5206a636ca2b10e416d424d: Status 404 returned error can't find the container with id c6e5b2d6ef8471956e26f4baf668a9cfc0b502b3e5206a636ca2b10e416d424d
Jul 24 13:44:53.455071 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.455046    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 13:44:53.461448 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:53.461423    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9053ceb1_cc33_4d44_9cca_78cea02094de.slice/crio-46195463e662773a44feba3abdf61a4d2269422b35d6ed7875661e433bbc65cb WatchSource:0}: Error finding container 46195463e662773a44feba3abdf61a4d2269422b35d6ed7875661e433bbc65cb: Status 404 returned error can't find the container with id 46195463e662773a44feba3abdf61a4d2269422b35d6ed7875661e433bbc65cb
Jul 24 13:44:53.462265 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:53.462245    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6442d36812aff0c99a37926bd67de65f.slice/crio-a169705c6b77b8dfd18cc76807be3570963c2590b1bc30c18075e0506a8e8e77 WatchSource:0}: Error finding container a169705c6b77b8dfd18cc76807be3570963c2590b1bc30c18075e0506a8e8e77: Status 404 returned error can't find the container with id a169705c6b77b8dfd18cc76807be3570963c2590b1bc30c18075e0506a8e8e77
Jul 24 13:44:53.464084 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.464065    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v2vhl"
Jul 24 13:44:53.476404 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:53.476377    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca23889_1269_4438_a4a6_6f6b81b08dbc.slice/crio-b8fb7c73578a0842c81448cfa3f3a2729eaef164eb6ef76e76314a7cd22c993f WatchSource:0}: Error finding container b8fb7c73578a0842c81448cfa3f3a2729eaef164eb6ef76e76314a7cd22c993f: Status 404 returned error can't find the container with id b8fb7c73578a0842c81448cfa3f3a2729eaef164eb6ef76e76314a7cd22c993f
Jul 24 13:44:53.481960 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.481936    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8hdgv"
Jul 24 13:44:53.491120 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:53.491090    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ada86d_d62a_4661_9469_4a159ceeaa9f.slice/crio-7f2a43fe986612cea296fbea8132ff7294c86e14a3769af53d916041995e1022 WatchSource:0}: Error finding container 7f2a43fe986612cea296fbea8132ff7294c86e14a3769af53d916041995e1022: Status 404 returned error can't find the container with id 7f2a43fe986612cea296fbea8132ff7294c86e14a3769af53d916041995e1022
Jul 24 13:44:53.503342 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.503318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gb6xn"
Jul 24 13:44:53.513937 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:53.513907    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8826d0_c493_4bbe_85ad_998e7785fb69.slice/crio-59fe94c61fe7c2a80ff4a019db9127b4c7d0c5d6f0c62292615e7d3f799de831 WatchSource:0}: Error finding container 59fe94c61fe7c2a80ff4a019db9127b4c7d0c5d6f0c62292615e7d3f799de831: Status 404 returned error can't find the container with id 59fe94c61fe7c2a80ff4a019db9127b4c7d0c5d6f0c62292615e7d3f799de831
Jul 24 13:44:53.519326 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.519306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5q8zz"
Jul 24 13:44:53.528298 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:53.528267    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b846200_4036_4055_ad01_f563a8beed2e.slice/crio-b281a5b3b7638affe858579125e6de752b654928ae9adbad8059627b9cf01f4f WatchSource:0}: Error finding container b281a5b3b7638affe858579125e6de752b654928ae9adbad8059627b9cf01f4f: Status 404 returned error can't find the container with id b281a5b3b7638affe858579125e6de752b654928ae9adbad8059627b9cf01f4f
Jul 24 13:44:53.533005 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.532986    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:44:53.536347 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.536329    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj"
Jul 24 13:44:53.545718 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:53.545692    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88947adf_11e7_403a_b7aa_f3f8c824aacc.slice/crio-70758ee8243b13bbc2949099263121b5c5bc2f10234def226428e00ff9e3b56f WatchSource:0}: Error finding container 70758ee8243b13bbc2949099263121b5c5bc2f10234def226428e00ff9e3b56f: Status 404 returned error can't find the container with id 70758ee8243b13bbc2949099263121b5c5bc2f10234def226428e00ff9e3b56f
Jul 24 13:44:53.549122 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.549103    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-scx8p"
Jul 24 13:44:53.554330 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.554311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tvw8p"
Jul 24 13:44:53.559276 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:53.559249    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bf1d1e1_8363_4e34_bf6a_920e175bfd7f.slice/crio-96b2317fcb738bec056d3aa72f55f53f372b51195a81eb3c80ac52347693323f WatchSource:0}: Error finding container 96b2317fcb738bec056d3aa72f55f53f372b51195a81eb3c80ac52347693323f: Status 404 returned error can't find the container with id 96b2317fcb738bec056d3aa72f55f53f372b51195a81eb3c80ac52347693323f
Jul 24 13:44:53.564593 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:44:53.564567    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod615bc648_ab8d_4fac_8871_297d0c40c620.slice/crio-77eb248c45842d4641d7022da3098808b88e8ce42b1cea3c92ab96cad0ea78fc WatchSource:0}: Error finding container 77eb248c45842d4641d7022da3098808b88e8ce42b1cea3c92ab96cad0ea78fc: Status 404 returned error can't find the container with id 77eb248c45842d4641d7022da3098808b88e8ce42b1cea3c92ab96cad0ea78fc
Jul 24 13:44:53.566167 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.566144    2565 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-multus start failed in pod multus-tvw8p_openshift-multus(615bc648-ab8d-4fac-8871-297d0c40c620): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 24 13:44:53.566279 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.566178    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-multus/multus-tvw8p" podUID="615bc648-ab8d-4fac-8871-297d0c40c620"
Jul 24 13:44:53.647397 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.647361    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:44:53.703929 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.703842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prh72\" (UniqueName: \"kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72\") pod \"network-check-target-jrrcp\" (UID: \"6dd4417c-eb39-41e8-bda7-d128fec501c2\") " pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:44:53.704063 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.704011    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:44:53.704063 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.704034    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:44:53.704063 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.704044    2565 projected.go:196] Error preparing data for projected volume kube-api-access-prh72 for pod openshift-network-diagnostics/network-check-target-jrrcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:44:53.704244 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.704097    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72 podName:6dd4417c-eb39-41e8-bda7-d128fec501c2 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:54.704082854 +0000 UTC m=+2.939434198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-prh72" (UniqueName: "kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72") pod "network-check-target-jrrcp" (UID: "6dd4417c-eb39-41e8-bda7-d128fec501c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:44:53.804802 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.804711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:53.804990 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.804833    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:44:53.804990 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:53.804829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:44:53.804990 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.804903    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret podName:57dfab3c-f8a9-4e6f-b953-6bfd7036ded0 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:54.804883687 +0000 UTC m=+3.040235053 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret") pod "global-pull-secret-syncer-j2hpq" (UID: "57dfab3c-f8a9-4e6f-b953-6bfd7036ded0") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:44:53.804990 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.804942    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:44:53.804990 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:53.804979    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs podName:6ec1c31e-6c92-4f1d-a9e3-0228915d6893 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:54.804969354 +0000 UTC m=+3.040320700 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs") pod "network-metrics-daemon-l7qzc" (UID: "6ec1c31e-6c92-4f1d-a9e3-0228915d6893") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:44:54.009580 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.009503    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:44:54.146155 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.146074    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 13:39:53 +0000 UTC" deadline="2028-03-01 04:55:14.7433293 +0000 UTC"
Jul 24 13:44:54.146155 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.146144    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14055h10m20.597190159s"
Jul 24 13:44:54.199834 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.199237    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:44:54.199834 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:54.199382    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:44:54.204246 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.204172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scx8p" event={"ID":"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f","Type":"ContainerStarted","Data":"96b2317fcb738bec056d3aa72f55f53f372b51195a81eb3c80ac52347693323f"}
Jul 24 13:44:54.205973 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.205939    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj" event={"ID":"88947adf-11e7-403a-b7aa-f3f8c824aacc","Type":"ContainerStarted","Data":"70758ee8243b13bbc2949099263121b5c5bc2f10234def226428e00ff9e3b56f"}
Jul 24 13:44:54.221710 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.221668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gb6xn" event={"ID":"aa8826d0-c493-4bbe-85ad-998e7785fb69","Type":"ContainerStarted","Data":"59fe94c61fe7c2a80ff4a019db9127b4c7d0c5d6f0c62292615e7d3f799de831"}
Jul 24 13:44:54.230283 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.229896    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v2vhl" event={"ID":"eca23889-1269-4438-a4a6-6f6b81b08dbc","Type":"ContainerStarted","Data":"b8fb7c73578a0842c81448cfa3f3a2729eaef164eb6ef76e76314a7cd22c993f"}
Jul 24 13:44:54.235739 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.235708    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7" event={"ID":"9053ceb1-cc33-4d44-9cca-78cea02094de","Type":"ContainerStarted","Data":"46195463e662773a44feba3abdf61a4d2269422b35d6ed7875661e433bbc65cb"}
Jul 24 13:44:54.250616 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.249872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-200.ec2.internal" event={"ID":"3e716dbf694181dd98fd7be7ff31819b","Type":"ContainerStarted","Data":"c6e5b2d6ef8471956e26f4baf668a9cfc0b502b3e5206a636ca2b10e416d424d"}
Jul 24 13:44:54.261599 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.261509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8xn8t" event={"ID":"b8b4f72f-88c5-4211-a38e-6a5c106c07a9","Type":"ContainerStarted","Data":"928fc7ad8cf970d5ced01426ac2b0db0a743fd22749b7d48427c419536eef497"}
Jul 24 13:44:54.282280 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.270054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5q8zz" event={"ID":"9b846200-4036-4055-ad01-f563a8beed2e","Type":"ContainerStarted","Data":"b281a5b3b7638affe858579125e6de752b654928ae9adbad8059627b9cf01f4f"}
Jul 24 13:44:54.282280 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.273459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8hdgv" event={"ID":"44ada86d-d62a-4661-9469-4a159ceeaa9f","Type":"ContainerStarted","Data":"7f2a43fe986612cea296fbea8132ff7294c86e14a3769af53d916041995e1022"}
Jul 24 13:44:54.282280 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.275828    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal" event={"ID":"6442d36812aff0c99a37926bd67de65f","Type":"ContainerStarted","Data":"a169705c6b77b8dfd18cc76807be3570963c2590b1bc30c18075e0506a8e8e77"}
Jul 24 13:44:54.282280 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.278318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tvw8p" event={"ID":"615bc648-ab8d-4fac-8871-297d0c40c620","Type":"ContainerStarted","Data":"77eb248c45842d4641d7022da3098808b88e8ce42b1cea3c92ab96cad0ea78fc"}
Jul 24 13:44:54.282280 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:54.280705    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-multus/multus-tvw8p" podUID="615bc648-ab8d-4fac-8871-297d0c40c620"
Jul 24 13:44:54.714532 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.714432    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prh72\" (UniqueName: \"kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72\") pod \"network-check-target-jrrcp\" (UID: \"6dd4417c-eb39-41e8-bda7-d128fec501c2\") " pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:44:54.714716 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:54.714631    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:44:54.714716 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:54.714658    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:44:54.714716 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:54.714672    2565 projected.go:196] Error preparing data for projected volume kube-api-access-prh72 for pod openshift-network-diagnostics/network-check-target-jrrcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:44:54.714869 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:54.714737    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72 podName:6dd4417c-eb39-41e8-bda7-d128fec501c2 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:56.714717015 +0000 UTC m=+4.950068365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-prh72" (UniqueName: "kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72") pod "network-check-target-jrrcp" (UID: "6dd4417c-eb39-41e8-bda7-d128fec501c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:44:54.815201 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.815154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:54.815429 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:54.815231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:44:54.815429 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:54.815408    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:44:54.815551 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:54.815478    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs podName:6ec1c31e-6c92-4f1d-a9e3-0228915d6893 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:56.815457188 +0000 UTC m=+5.050808533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs") pod "network-metrics-daemon-l7qzc" (UID: "6ec1c31e-6c92-4f1d-a9e3-0228915d6893") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:44:54.815943 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:54.815916    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:44:54.816063 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:54.815981    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret podName:57dfab3c-f8a9-4e6f-b953-6bfd7036ded0 nodeName:}" failed. No retries permitted until 2026-07-24 13:44:56.815963457 +0000 UTC m=+5.051314802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret") pod "global-pull-secret-syncer-j2hpq" (UID: "57dfab3c-f8a9-4e6f-b953-6bfd7036ded0") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:44:55.037136 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:55.036939    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:44:55.147138 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:55.147071    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 13:39:53 +0000 UTC" deadline="2028-02-04 07:46:53.986607711 +0000 UTC"
Jul 24 13:44:55.147138 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:55.147136    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13434h1m58.839476089s"
Jul 24 13:44:55.189871 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:55.189836    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:55.190064 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:55.189984    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:44:55.190345 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:55.190322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:44:55.190492 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:55.190443    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:44:56.192408 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:56.192115    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:44:56.193035 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:56.192538    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:44:56.733616 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:56.733566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prh72\" (UniqueName: \"kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72\") pod \"network-check-target-jrrcp\" (UID: \"6dd4417c-eb39-41e8-bda7-d128fec501c2\") " pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:44:56.733893 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:56.733834    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:44:56.733893 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:56.733865    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:44:56.733893 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:56.733880    2565 projected.go:196] Error preparing data for projected volume kube-api-access-prh72 for pod openshift-network-diagnostics/network-check-target-jrrcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:44:56.734094 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:56.733949    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72 podName:6dd4417c-eb39-41e8-bda7-d128fec501c2 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:00.733925393 +0000 UTC m=+8.969276742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-prh72" (UniqueName: "kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72") pod "network-check-target-jrrcp" (UID: "6dd4417c-eb39-41e8-bda7-d128fec501c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:44:56.834987 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:56.834942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:56.835195 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:56.835008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:44:56.835195 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:56.835185    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:44:56.835442 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:56.835283    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs podName:6ec1c31e-6c92-4f1d-a9e3-0228915d6893 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:00.835260853 +0000 UTC m=+9.070612218 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs") pod "network-metrics-daemon-l7qzc" (UID: "6ec1c31e-6c92-4f1d-a9e3-0228915d6893") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:44:56.835753 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:56.835728    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:44:56.835843 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:56.835794    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret podName:57dfab3c-f8a9-4e6f-b953-6bfd7036ded0 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:00.835777851 +0000 UTC m=+9.071129220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret") pod "global-pull-secret-syncer-j2hpq" (UID: "57dfab3c-f8a9-4e6f-b953-6bfd7036ded0") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:44:57.188988 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:57.188894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:57.189156 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:57.189029    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:44:57.189156 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:57.189081    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:44:57.189271 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:57.189249    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:44:58.190303 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:58.190271    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:44:58.190859 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:58.190404    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:44:59.189073 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:59.189035    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:44:59.189293 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:59.189186    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:44:59.189558 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:44:59.189530    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:44:59.189665 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:44:59.189646    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:45:00.190694 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:00.190666    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:00.191138 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:00.190787    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:45:00.768814 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:00.768772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prh72\" (UniqueName: \"kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72\") pod \"network-check-target-jrrcp\" (UID: \"6dd4417c-eb39-41e8-bda7-d128fec501c2\") " pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:00.769020 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:00.768970    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:45:00.769020 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:00.768999    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:45:00.769020 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:00.769012    2565 projected.go:196] Error preparing data for projected volume kube-api-access-prh72 for pod openshift-network-diagnostics/network-check-target-jrrcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:00.769201 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:00.769079    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72 podName:6dd4417c-eb39-41e8-bda7-d128fec501c2 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:08.769059734 +0000 UTC m=+17.004411093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-prh72" (UniqueName: "kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72") pod "network-check-target-jrrcp" (UID: "6dd4417c-eb39-41e8-bda7-d128fec501c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:00.869990 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:00.869951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:00.869990 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:00.869997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:00.870271 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:00.870103    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:00.870271 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:00.870107    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:00.870271 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:00.870162    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs podName:6ec1c31e-6c92-4f1d-a9e3-0228915d6893 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:08.87014705 +0000 UTC m=+17.105498409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs") pod "network-metrics-daemon-l7qzc" (UID: "6ec1c31e-6c92-4f1d-a9e3-0228915d6893") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:00.870271 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:00.870199    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret podName:57dfab3c-f8a9-4e6f-b953-6bfd7036ded0 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:08.870187517 +0000 UTC m=+17.105538863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret") pod "global-pull-secret-syncer-j2hpq" (UID: "57dfab3c-f8a9-4e6f-b953-6bfd7036ded0") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:01.189721 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:01.189641    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:01.189873 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:01.189761    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:45:01.190190 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:01.190149    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:01.190335 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:01.190266    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:45:02.191813 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:02.190606    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:02.191813 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:02.190727    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:45:03.189223 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:03.189165    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:03.189414 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:03.189194    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:03.189414 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:03.189307    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:45:03.189501 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:03.189413    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:45:04.189750 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:04.189709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:04.190269 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:04.189844    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:45:05.189357 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:05.189313    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:05.189357 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:05.189366    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:05.189592 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:05.189483    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:45:05.189665 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:05.189634    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:45:06.189330 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:06.189293    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:06.189736 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:06.189437    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:45:07.189694 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:07.189658    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:07.190114 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:07.189702    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:07.190114 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:07.189790    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:45:07.190114 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:07.189930    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:45:08.189051 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:08.189008    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:08.189231 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:08.189134    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:45:08.827109 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:08.826996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prh72\" (UniqueName: \"kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72\") pod \"network-check-target-jrrcp\" (UID: \"6dd4417c-eb39-41e8-bda7-d128fec501c2\") " pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:08.827459 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:08.827217    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:45:08.827459 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:08.827235    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:45:08.827459 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:08.827248    2565 projected.go:196] Error preparing data for projected volume kube-api-access-prh72 for pod openshift-network-diagnostics/network-check-target-jrrcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:08.827459 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:08.827303    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72 podName:6dd4417c-eb39-41e8-bda7-d128fec501c2 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:24.827286489 +0000 UTC m=+33.062637844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-prh72" (UniqueName: "kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72") pod "network-check-target-jrrcp" (UID: "6dd4417c-eb39-41e8-bda7-d128fec501c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:45:08.927886 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:08.927850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:08.927886 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:08.927891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:08.928094 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:08.928005    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:08.928094 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:08.928050    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs podName:6ec1c31e-6c92-4f1d-a9e3-0228915d6893 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:24.928036999 +0000 UTC m=+33.163388341 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs") pod "network-metrics-daemon-l7qzc" (UID: "6ec1c31e-6c92-4f1d-a9e3-0228915d6893") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:45:08.928402 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:08.928386    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:08.928473 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:08.928430    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret podName:57dfab3c-f8a9-4e6f-b953-6bfd7036ded0 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:24.928416576 +0000 UTC m=+33.163767927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret") pod "global-pull-secret-syncer-j2hpq" (UID: "57dfab3c-f8a9-4e6f-b953-6bfd7036ded0") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:45:09.189900 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.189705    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:09.190087 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.189768    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:09.190087 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:09.189974    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:45:09.190087 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:09.190069    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:45:09.316593 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.316563    2565 generic.go:356] "Generic (PLEG): container finished" podID="6bf1d1e1-8363-4e34-bf6a-920e175bfd7f" containerID="263afcac1e3a267dd82f8910d3bd38ad058080ee56b1640a1926d7ab58272f33" exitCode=0
Jul 24 13:45:09.316724 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.316649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scx8p" event={"ID":"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f","Type":"ContainerDied","Data":"263afcac1e3a267dd82f8910d3bd38ad058080ee56b1640a1926d7ab58272f33"}
Jul 24 13:45:09.318732 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.318679    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj" event={"ID":"88947adf-11e7-403a-b7aa-f3f8c824aacc","Type":"ContainerStarted","Data":"051c1b42a5e27543f189f41d2f4491b6e7224c13cbfdef55990061a1247c445f"}
Jul 24 13:45:09.320778 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.320749    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gb6xn" event={"ID":"aa8826d0-c493-4bbe-85ad-998e7785fb69","Type":"ContainerStarted","Data":"f3d7626d538f853fe0b99f9b30a3af01d10b6c1eea2c66c545afda10d5366e7d"}
Jul 24 13:45:09.322467 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.322415    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v2vhl" event={"ID":"eca23889-1269-4438-a4a6-6f6b81b08dbc","Type":"ContainerStarted","Data":"04a290843567a4c693e6a95515bdefe57304fe4c0aabd7284475becfab0ed769"}
Jul 24 13:45:09.326128 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.326100    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7" event={"ID":"9053ceb1-cc33-4d44-9cca-78cea02094de","Type":"ContainerStarted","Data":"23390c381556f97b8f39d6671524e2219dcf1fd34c36599f1e78425dfbec44dd"}
Jul 24 13:45:09.326273 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.326247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7" event={"ID":"9053ceb1-cc33-4d44-9cca-78cea02094de","Type":"ContainerStarted","Data":"2414938fa4d6ec026d6793cf5ddb79a7f3c1b42fd27ac00b3f7663b7af9b2bc7"}
Jul 24 13:45:09.326358 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.326317    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7" event={"ID":"9053ceb1-cc33-4d44-9cca-78cea02094de","Type":"ContainerStarted","Data":"12797573b917c3724f45dc9c7cfd1b2fede799bb98d0c82df64e9cc6f5767229"}
Jul 24 13:45:09.326411 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.326365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7" event={"ID":"9053ceb1-cc33-4d44-9cca-78cea02094de","Type":"ContainerStarted","Data":"f629baa557f4efe30bdcb519b0e02191a2d85c8797d83a393c8de8ce5d31b4c6"}
Jul 24 13:45:09.326461 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.326412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7" event={"ID":"9053ceb1-cc33-4d44-9cca-78cea02094de","Type":"ContainerStarted","Data":"b8daec62317555e74a48053a3738d9254ef5a2b7cd7b552d19947d69d7ba619e"}
Jul 24 13:45:09.328308 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.328279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-200.ec2.internal" event={"ID":"3e716dbf694181dd98fd7be7ff31819b","Type":"ContainerStarted","Data":"053975b3f2772c3b9a35da20c93f5e3ed52c9e0a5e9917cafb6a084f45274ba6"}
Jul 24 13:45:09.330323 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.330298    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5q8zz" event={"ID":"9b846200-4036-4055-ad01-f563a8beed2e","Type":"ContainerStarted","Data":"d5a75656a3238cc8f2f87efa079918d75ae75684ffe5f1ac08a34a98a8a31275"}
Jul 24 13:45:09.332072 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.332048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8hdgv" event={"ID":"44ada86d-d62a-4661-9469-4a159ceeaa9f","Type":"ContainerStarted","Data":"502d7e813ee5c592d8e6de78e2888fef2a3bd287f6e9eff344afda884d8c03e6"}
Jul 24 13:45:09.333803 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.333778    2565 generic.go:356] "Generic (PLEG): container finished" podID="6442d36812aff0c99a37926bd67de65f" containerID="e732b923388db527fdea4a93ed39aceddd8701338e46568f51d8f698934e3878" exitCode=0
Jul 24 13:45:09.333894 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.333818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal" event={"ID":"6442d36812aff0c99a37926bd67de65f","Type":"ContainerDied","Data":"e732b923388db527fdea4a93ed39aceddd8701338e46568f51d8f698934e3878"}
Jul 24 13:45:09.371762 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.371466    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8hdgv" podStartSLOduration=2.255426691 podStartE2EDuration="17.371442761s" totalImagesPullingTime="15.11601607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:09.371098794 +0000 UTC m=+17.606450156" watchObservedRunningTime="2026-07-24 13:45:09.371442761 +0000 UTC m=+17.606794125"
Jul 24 13:45:09.385600 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.385537    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gb6xn" podStartSLOduration=2.326400299 podStartE2EDuration="17.385515454s" totalImagesPullingTime="15.059115155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:09.385060369 +0000 UTC m=+17.620411732" watchObservedRunningTime="2026-07-24 13:45:09.385515454 +0000 UTC m=+17.620866817"
Jul 24 13:45:09.427106 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.427057    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5q8zz" podStartSLOduration=2.382254395 podStartE2EDuration="17.427040362s" totalImagesPullingTime="15.044785967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:09.402934578 +0000 UTC m=+17.638285939" watchObservedRunningTime="2026-07-24 13:45:09.427040362 +0000 UTC m=+17.662391725"
Jul 24 13:45:09.447890 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.447844    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-200.ec2.internal" podStartSLOduration=16.447827629 podStartE2EDuration="16.447827629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:09.427350433 +0000 UTC m=+17.662701794" watchObservedRunningTime="2026-07-24 13:45:09.447827629 +0000 UTC m=+17.683178990"
Jul 24 13:45:09.448484 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:09.448439    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v2vhl" podStartSLOduration=2.351790886 podStartE2EDuration="17.448428422s" totalImagesPullingTime="15.096637536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:09.448408039 +0000 UTC m=+17.683759403" watchObservedRunningTime="2026-07-24 13:45:09.448428422 +0000 UTC m=+17.683779783"
Jul 24 13:45:10.189299 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:10.189270    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:10.189964 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:10.189397    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:45:10.226527 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:10.226507    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 13:45:10.338511 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:10.338472    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8xn8t" event={"ID":"b8b4f72f-88c5-4211-a38e-6a5c106c07a9","Type":"ContainerStarted","Data":"9c1369de59ef3c50a4d374e758dd917a4826034735eaf5dd5473bac9782cc0c7"}
Jul 24 13:45:10.340501 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:10.340472    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal" event={"ID":"6442d36812aff0c99a37926bd67de65f","Type":"ContainerStarted","Data":"0aea855a59b0e3704d5c39129befebdd047aff2a556bba8f33e0ab5d0c16ae02"}
Jul 24 13:45:10.343082 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:10.343052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj" event={"ID":"88947adf-11e7-403a-b7aa-f3f8c824aacc","Type":"ContainerStarted","Data":"eab6477440203e9c0d46e40ec7489b20f49fdca16fc0a1cc85c2bb014c97c11e"}
Jul 24 13:45:10.346526 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:10.346497    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7" event={"ID":"9053ceb1-cc33-4d44-9cca-78cea02094de","Type":"ContainerStarted","Data":"acc44a322f842a2fa3f721a848048ece6b33e59f3cc7c131de53b4a488ee7a2b"}
Jul 24 13:45:10.354354 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:10.353602    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8xn8t" podStartSLOduration=3.578592016 podStartE2EDuration="18.353584554s" totalImagesPullingTime="14.774992538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:10.353116514 +0000 UTC m=+18.588467876" watchObservedRunningTime="2026-07-24 13:45:10.353584554 +0000 UTC m=+18.588935917"
Jul 24 13:45:10.368246 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:10.368131    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-200.ec2.internal" podStartSLOduration=17.368111423 podStartE2EDuration="17.368111423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:10.367207287 +0000 UTC m=+18.602558646" watchObservedRunningTime="2026-07-24 13:45:10.368111423 +0000 UTC m=+18.603462786"
Jul 24 13:45:11.164587 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:11.164465    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T13:45:10.226525618Z","UUID":"6c0dbdd6-8732-4be0-88a8-fac3d3b876b3","Handler":null,"Name":"","Endpoint":""}
Jul 24 13:45:11.166422 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:11.166316    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 13:45:11.166422 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:11.166359    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 13:45:11.188930 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:11.188898    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:11.189113 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:11.189084    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:45:11.189455 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:11.188898    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:11.189882 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:11.189554    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:45:12.193976 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:12.193874    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:12.194663 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:12.194629    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:45:12.353772 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:12.353730    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj" event={"ID":"88947adf-11e7-403a-b7aa-f3f8c824aacc","Type":"ContainerStarted","Data":"ea0afcf8e672da2e1113a9899026c6426d0ab3e5a95090eeee5855db881ea445"}
Jul 24 13:45:12.358448 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:12.358401    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7" event={"ID":"9053ceb1-cc33-4d44-9cca-78cea02094de","Type":"ContainerStarted","Data":"a7f66f60793527f7d938ddffa194c3fae1d3e02a4189da1c0bf489f2a02c4191"}
Jul 24 13:45:12.370876 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:12.370826    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdwlj" podStartSLOduration=3.288240489 podStartE2EDuration="20.370811449s" totalImagesPullingTime="17.08257096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:44:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:12.370613876 +0000 UTC m=+20.605965239" watchObservedRunningTime="2026-07-24 13:45:12.370811449 +0000 UTC m=+20.606162811"
Jul 24 13:45:13.189908 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:13.189395    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:13.189908 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:13.189538    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:45:13.189908 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:13.189590    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:13.189908 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:13.189715    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:45:14.081798 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:14.081764    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v2vhl"
Jul 24 13:45:14.082456 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:14.082416    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v2vhl"
Jul 24 13:45:14.191532 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:14.191494    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:14.191699 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:14.191603    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:45:14.363134 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:14.363016    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v2vhl"
Jul 24 13:45:14.363588 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:14.363566    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v2vhl"
Jul 24 13:45:15.189855 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:15.189611    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:15.190496 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:15.189611    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:15.190496 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:15.189958    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:45:15.190496 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:15.190278    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:45:15.367451 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:15.367413    2565 generic.go:356] "Generic (PLEG): container finished" podID="6bf1d1e1-8363-4e34-bf6a-920e175bfd7f" containerID="1cfecdc6c3d5a8987df6cbbbf7a085780c382817531e4de649320de05a175eb0" exitCode=0
Jul 24 13:45:15.367631 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:15.367497    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scx8p" event={"ID":"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f","Type":"ContainerDied","Data":"1cfecdc6c3d5a8987df6cbbbf7a085780c382817531e4de649320de05a175eb0"}
Jul 24 13:45:15.372120 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:15.371843    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7" event={"ID":"9053ceb1-cc33-4d44-9cca-78cea02094de","Type":"ContainerStarted","Data":"e9c68e9f963f7761ee289440c78157eb9ef4585e663dba004e32a7ab6722305e"}
Jul 24 13:45:15.372797 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:15.372778    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:45:15.374953 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:15.372963    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:45:15.374953 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:15.373034    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:45:15.391365 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:15.391336    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:45:15.391611 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:15.391592    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:45:15.418516 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:15.418462    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7" podStartSLOduration=8.077410856 podStartE2EDuration="23.41843998s" totalImagesPullingTime="15.341029124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:15.417038751 +0000 UTC m=+23.652390113" watchObservedRunningTime="2026-07-24 13:45:15.41843998 +0000 UTC m=+23.653791343"
Jul 24 13:45:16.190288 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:16.190257    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:16.190854 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:16.190394    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:45:16.964167 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:16.964135    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j2hpq"]
Jul 24 13:45:16.964380 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:16.964312    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:16.964459 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:16.964437    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:45:16.967209 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:16.967164    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jrrcp"]
Jul 24 13:45:16.967325 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:16.967266    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:16.967383 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:16.967353    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:45:16.970026 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:16.970005    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l7qzc"]
Jul 24 13:45:16.970136 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:16.970108    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:16.970244 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:16.970225    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:45:18.189917 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:18.189704    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:18.190551 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:18.190026    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:45:19.189123 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:19.189077    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:19.189327 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:19.189089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:19.189327 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:19.189242    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:45:19.189327 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:19.189262    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:45:19.383577 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:19.383530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tvw8p" event={"ID":"615bc648-ab8d-4fac-8871-297d0c40c620","Type":"ContainerStarted","Data":"083db233d3d2a885eaa3f8f60c0878f8b702a87277fc3ec707ebcb8e9bdb11d5"}
Jul 24 13:45:19.404148 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:19.404082    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tvw8p" podStartSLOduration=1.750875366 podStartE2EDuration="27.404057213s" totalImagesPullingTime="25.653181847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-24 13:45:19.402871608 +0000 UTC m=+27.638222970" watchObservedRunningTime="2026-07-24 13:45:19.404057213 +0000 UTC m=+27.639408576"
Jul 24 13:45:20.189888 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:20.189842    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:20.190031 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:20.189976    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2hpq" podUID="57dfab3c-f8a9-4e6f-b953-6bfd7036ded0"
Jul 24 13:45:20.387981 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:20.387948    2565 generic.go:356] "Generic (PLEG): container finished" podID="6bf1d1e1-8363-4e34-bf6a-920e175bfd7f" containerID="a0b962ce3aec1ae37e0329da280a7f60412977b3c4807c3a3e714f612540d48b" exitCode=0
Jul 24 13:45:20.388389 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:20.388033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scx8p" event={"ID":"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f","Type":"ContainerDied","Data":"a0b962ce3aec1ae37e0329da280a7f60412977b3c4807c3a3e714f612540d48b"}
Jul 24 13:45:21.189914 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:21.189718    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:21.190083 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:21.189750    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:21.190083 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:21.190020    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:45:21.190083 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:21.190047    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrrcp" podUID="6dd4417c-eb39-41e8-bda7-d128fec501c2"
Jul 24 13:45:22.058229 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.058198    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-200.ec2.internal" event="NodeReady"
Jul 24 13:45:22.058756 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.058341    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 13:45:22.092758 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.092725    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9959d7b-5fm5d"]
Jul 24 13:45:22.114842 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.114814    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"]
Jul 24 13:45:22.114971 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.114943    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.117260 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.117232    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 13:45:22.117414 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.117382    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 13:45:22.117509 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.117488    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 13:45:22.117626 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.117611    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bz29t\""
Jul 24 13:45:22.122372 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.122346    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 13:45:22.130913 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.130886    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x7w45"]
Jul 24 13:45:22.131059 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.131034    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:45:22.133449 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.133424    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 24 13:45:22.133594 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.133488    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-snr7s\""
Jul 24 13:45:22.133594 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.133574    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 24 13:45:22.148896 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.148867    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qgfbv"]
Jul 24 13:45:22.149031 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.148974    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x7w45"
Jul 24 13:45:22.151431 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.151370    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gc8ks\""
Jul 24 13:45:22.151659 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.151640    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 13:45:22.151778 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.151761    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 13:45:22.151902 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.151885    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 13:45:22.163248 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.163225    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"]
Jul 24 13:45:22.163378 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.163260    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9959d7b-5fm5d"]
Jul 24 13:45:22.163378 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.163279    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qgfbv"]
Jul 24 13:45:22.163378 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.163299    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x7w45"]
Jul 24 13:45:22.163378 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.163325    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:22.165434 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.165410    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7f5lp\""
Jul 24 13:45:22.165535 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.165498    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 13:45:22.165535 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.165502    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 13:45:22.188910 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.188888    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:22.191342 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.191320    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 13:45:22.234371 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.234337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.234371 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.234376    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47045f93-b0db-45f5-801e-6e524c7da5cf-image-registry-private-configuration\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.234607 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.234416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47045f93-b0db-45f5-801e-6e524c7da5cf-trusted-ca\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.234607 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.234434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:45:22.234607 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.234460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-certificates\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.234607 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.234475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47045f93-b0db-45f5-801e-6e524c7da5cf-installation-pull-secrets\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.234607 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.234489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-bound-sa-token\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.234607 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.234504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zzj9\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-kube-api-access-5zzj9\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.234607 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.234519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9xh5\" (UniqueName: \"kubernetes.io/projected/97d637b1-98c3-4f98-9555-08a28bcf744e-kube-api-access-w9xh5\") pod \"ingress-canary-x7w45\" (UID: \"97d637b1-98c3-4f98-9555-08a28bcf744e\") " pod="openshift-ingress-canary/ingress-canary-x7w45"
Jul 24 13:45:22.234607 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.234583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f1fcef7a-6518-4fc3-89c0-201e2d08b506-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:45:22.234884 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.234622    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47045f93-b0db-45f5-801e-6e524c7da5cf-ca-trust-extracted\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.234884 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.234638    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97d637b1-98c3-4f98-9555-08a28bcf744e-cert\") pod \"ingress-canary-x7w45\" (UID: \"97d637b1-98c3-4f98-9555-08a28bcf744e\") " pod="openshift-ingress-canary/ingress-canary-x7w45"
Jul 24 13:45:22.335024 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.334975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.335024 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47045f93-b0db-45f5-801e-6e524c7da5cf-image-registry-private-configuration\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.335316 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47045f93-b0db-45f5-801e-6e524c7da5cf-trusted-ca\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.335316 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:45:22.335316 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:22.335125    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:45:22.335316 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:22.335146    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9959d7b-5fm5d: secret "image-registry-tls" not found
Jul 24 13:45:22.335316 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-certificates\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.335316 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:22.335240    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls podName:47045f93-b0db-45f5-801e-6e524c7da5cf nodeName:}" failed. No retries permitted until 2026-07-24 13:45:22.835217556 +0000 UTC m=+31.070568897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls") pod "image-registry-9959d7b-5fm5d" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf") : secret "image-registry-tls" not found
Jul 24 13:45:22.335316 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:22.335243    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 13:45:22.335316 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47045f93-b0db-45f5-801e-6e524c7da5cf-installation-pull-secrets\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.335316 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-bound-sa-token\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.335747 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:22.335337    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert podName:f1fcef7a-6518-4fc3-89c0-201e2d08b506 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:22.835322591 +0000 UTC m=+31.070673931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mm49r" (UID: "f1fcef7a-6518-4fc3-89c0-201e2d08b506") : secret "networking-console-plugin-cert" not found
Jul 24 13:45:22.335747 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zzj9\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-kube-api-access-5zzj9\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.335747 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9xh5\" (UniqueName: \"kubernetes.io/projected/97d637b1-98c3-4f98-9555-08a28bcf744e-kube-api-access-w9xh5\") pod \"ingress-canary-x7w45\" (UID: \"97d637b1-98c3-4f98-9555-08a28bcf744e\") " pod="openshift-ingress-canary/ingress-canary-x7w45"
Jul 24 13:45:22.335747 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:22.335747 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f1fcef7a-6518-4fc3-89c0-201e2d08b506-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:45:22.335747 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c85b14b-79da-476c-b403-dcf9a30fa473-config-volume\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:22.335747 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47045f93-b0db-45f5-801e-6e524c7da5cf-ca-trust-extracted\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.335747 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97d637b1-98c3-4f98-9555-08a28bcf744e-cert\") pod \"ingress-canary-x7w45\" (UID: \"97d637b1-98c3-4f98-9555-08a28bcf744e\") " pod="openshift-ingress-canary/ingress-canary-x7w45"
Jul 24 13:45:22.335747 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c85b14b-79da-476c-b403-dcf9a30fa473-tmp-dir\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:22.335747 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5llc\" (UniqueName: \"kubernetes.io/projected/8c85b14b-79da-476c-b403-dcf9a30fa473-kube-api-access-l5llc\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:22.336112 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335902    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-certificates\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.336112 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.335928    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47045f93-b0db-45f5-801e-6e524c7da5cf-ca-trust-extracted\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.336251 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.336230    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f1fcef7a-6518-4fc3-89c0-201e2d08b506-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:45:22.336571 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.336548    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47045f93-b0db-45f5-801e-6e524c7da5cf-trusted-ca\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.339771 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.339750    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47045f93-b0db-45f5-801e-6e524c7da5cf-image-registry-private-configuration\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.339883 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.339752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47045f93-b0db-45f5-801e-6e524c7da5cf-installation-pull-secrets\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.339883 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.339805    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97d637b1-98c3-4f98-9555-08a28bcf744e-cert\") pod \"ingress-canary-x7w45\" (UID: \"97d637b1-98c3-4f98-9555-08a28bcf744e\") " pod="openshift-ingress-canary/ingress-canary-x7w45"
Jul 24 13:45:22.345485 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.345455    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9xh5\" (UniqueName: \"kubernetes.io/projected/97d637b1-98c3-4f98-9555-08a28bcf744e-kube-api-access-w9xh5\") pod \"ingress-canary-x7w45\" (UID: \"97d637b1-98c3-4f98-9555-08a28bcf744e\") " pod="openshift-ingress-canary/ingress-canary-x7w45"
Jul 24 13:45:22.346486 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.346463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-bound-sa-token\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.346583 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.346531    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zzj9\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-kube-api-access-5zzj9\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.395541 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.395509    2565 generic.go:356] "Generic (PLEG): container finished" podID="6bf1d1e1-8363-4e34-bf6a-920e175bfd7f" containerID="4df9a6dbaec3cb64580740ec362dba520869ea62245883a2ded523253bcc7981" exitCode=0
Jul 24 13:45:22.395713 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.395552    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scx8p" event={"ID":"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f","Type":"ContainerDied","Data":"4df9a6dbaec3cb64580740ec362dba520869ea62245883a2ded523253bcc7981"}
Jul 24 13:45:22.436488 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.436395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:22.436488 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.436439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c85b14b-79da-476c-b403-dcf9a30fa473-config-volume\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:22.436488 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.436460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c85b14b-79da-476c-b403-dcf9a30fa473-tmp-dir\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:22.436488 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.436475    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5llc\" (UniqueName: \"kubernetes.io/projected/8c85b14b-79da-476c-b403-dcf9a30fa473-kube-api-access-l5llc\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:22.436801 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:22.436545    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:45:22.436801 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:22.436665    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls podName:8c85b14b-79da-476c-b403-dcf9a30fa473 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:22.936644184 +0000 UTC m=+31.171995531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls") pod "dns-default-qgfbv" (UID: "8c85b14b-79da-476c-b403-dcf9a30fa473") : secret "dns-default-metrics-tls" not found
Jul 24 13:45:22.436913 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.436801    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c85b14b-79da-476c-b403-dcf9a30fa473-tmp-dir\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:22.437080 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.437054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c85b14b-79da-476c-b403-dcf9a30fa473-config-volume\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:22.458860 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.458832    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x7w45"
Jul 24 13:45:22.459808 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.459787    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5llc\" (UniqueName: \"kubernetes.io/projected/8c85b14b-79da-476c-b403-dcf9a30fa473-kube-api-access-l5llc\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:22.631470 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.631290    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x7w45"]
Jul 24 13:45:22.634899 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:45:22.634872    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d637b1_98c3_4f98_9555_08a28bcf744e.slice/crio-c67d8aa3c1f8fb02f3605d0383743d67ab65c482249a6932c3476429544c636c WatchSource:0}: Error finding container c67d8aa3c1f8fb02f3605d0383743d67ab65c482249a6932c3476429544c636c: Status 404 returned error can't find the container with id c67d8aa3c1f8fb02f3605d0383743d67ab65c482249a6932c3476429544c636c
Jul 24 13:45:22.839741 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.839705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:22.839903 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.839768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:45:22.839903 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:22.839869    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:45:22.839903 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:22.839885    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 13:45:22.839903 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:22.839888    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9959d7b-5fm5d: secret "image-registry-tls" not found
Jul 24 13:45:22.842874 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:22.840320    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert podName:f1fcef7a-6518-4fc3-89c0-201e2d08b506 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:23.839930199 +0000 UTC m=+32.075281539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mm49r" (UID: "f1fcef7a-6518-4fc3-89c0-201e2d08b506") : secret "networking-console-plugin-cert" not found
Jul 24 13:45:22.842874 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:22.840360    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls podName:47045f93-b0db-45f5-801e-6e524c7da5cf nodeName:}" failed. No retries permitted until 2026-07-24 13:45:23.840341504 +0000 UTC m=+32.075692847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls") pod "image-registry-9959d7b-5fm5d" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf") : secret "image-registry-tls" not found
Jul 24 13:45:22.940388 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:22.940350    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:22.940565 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:22.940507    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:45:22.940609 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:22.940576    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls podName:8c85b14b-79da-476c-b403-dcf9a30fa473 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:23.940560924 +0000 UTC m=+32.175912264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls") pod "dns-default-qgfbv" (UID: "8c85b14b-79da-476c-b403-dcf9a30fa473") : secret "dns-default-metrics-tls" not found
Jul 24 13:45:23.189357 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:23.189266    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:23.189357 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:23.189297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:23.192375 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:23.192354    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 13:45:23.192523 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:23.192402    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 13:45:23.192523 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:23.192478    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qbf75\""
Jul 24 13:45:23.192619 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:23.192586    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h5k24\""
Jul 24 13:45:23.192660 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:23.192586    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 13:45:23.399521 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:23.399479    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x7w45" event={"ID":"97d637b1-98c3-4f98-9555-08a28bcf744e","Type":"ContainerStarted","Data":"c67d8aa3c1f8fb02f3605d0383743d67ab65c482249a6932c3476429544c636c"}
Jul 24 13:45:23.847539 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:23.847507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:23.847730 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:23.847568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:45:23.847730 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:23.847686    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 13:45:23.847730 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:23.847684    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:45:23.847730 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:23.847713    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9959d7b-5fm5d: secret "image-registry-tls" not found
Jul 24 13:45:23.847925 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:23.847753    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert podName:f1fcef7a-6518-4fc3-89c0-201e2d08b506 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:25.847736956 +0000 UTC m=+34.083088297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mm49r" (UID: "f1fcef7a-6518-4fc3-89c0-201e2d08b506") : secret "networking-console-plugin-cert" not found
Jul 24 13:45:23.847925 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:23.847767    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls podName:47045f93-b0db-45f5-801e-6e524c7da5cf nodeName:}" failed. No retries permitted until 2026-07-24 13:45:25.84776114 +0000 UTC m=+34.083112481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls") pod "image-registry-9959d7b-5fm5d" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf") : secret "image-registry-tls" not found
Jul 24 13:45:23.948758 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:23.948710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:23.948946 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:23.948895    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:45:23.948997 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:23.948990    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls podName:8c85b14b-79da-476c-b403-dcf9a30fa473 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:25.948967655 +0000 UTC m=+34.184318997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls") pod "dns-default-qgfbv" (UID: "8c85b14b-79da-476c-b403-dcf9a30fa473") : secret "dns-default-metrics-tls" not found
Jul 24 13:45:24.856733 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:24.856693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prh72\" (UniqueName: \"kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72\") pod \"network-check-target-jrrcp\" (UID: \"6dd4417c-eb39-41e8-bda7-d128fec501c2\") " pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:24.861716 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:24.861671    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prh72\" (UniqueName: \"kubernetes.io/projected/6dd4417c-eb39-41e8-bda7-d128fec501c2-kube-api-access-prh72\") pod \"network-check-target-jrrcp\" (UID: \"6dd4417c-eb39-41e8-bda7-d128fec501c2\") " pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:24.957938 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:24.957897    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:24.958132 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:24.957949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:24.958132 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:24.958089    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 13:45:24.958280 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:24.958152    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs podName:6ec1c31e-6c92-4f1d-a9e3-0228915d6893 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:56.958131415 +0000 UTC m=+65.193482754 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs") pod "network-metrics-daemon-l7qzc" (UID: "6ec1c31e-6c92-4f1d-a9e3-0228915d6893") : secret "metrics-daemon-secret" not found
Jul 24 13:45:24.961520 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:24.961494    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57dfab3c-f8a9-4e6f-b953-6bfd7036ded0-original-pull-secret\") pod \"global-pull-secret-syncer-j2hpq\" (UID: \"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0\") " pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:25.004742 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:25.004708    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:25.199538 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:25.199443    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2hpq"
Jul 24 13:45:25.797849 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:25.797814    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j2hpq"]
Jul 24 13:45:25.800619 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:25.800589    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jrrcp"]
Jul 24 13:45:25.848288 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:45:25.848253    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57dfab3c_f8a9_4e6f_b953_6bfd7036ded0.slice/crio-82edf7373642982b2ea5953ad79581f6cd106903c2dc175e9d764c32cdc66c59 WatchSource:0}: Error finding container 82edf7373642982b2ea5953ad79581f6cd106903c2dc175e9d764c32cdc66c59: Status 404 returned error can't find the container with id 82edf7373642982b2ea5953ad79581f6cd106903c2dc175e9d764c32cdc66c59
Jul 24 13:45:25.848660 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:45:25.848572    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd4417c_eb39_41e8_bda7_d128fec501c2.slice/crio-55e6f6be2641f306f326097b3563b831e343bb3ba0d3635e41580469e30bf016 WatchSource:0}: Error finding container 55e6f6be2641f306f326097b3563b831e343bb3ba0d3635e41580469e30bf016: Status 404 returned error can't find the container with id 55e6f6be2641f306f326097b3563b831e343bb3ba0d3635e41580469e30bf016
Jul 24 13:45:25.864294 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:25.864265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:25.864646 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:25.864344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:45:25.864646 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:25.864395    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:45:25.864646 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:25.864417    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9959d7b-5fm5d: secret "image-registry-tls" not found
Jul 24 13:45:25.864646 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:25.864464    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 13:45:25.864646 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:25.864485    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls podName:47045f93-b0db-45f5-801e-6e524c7da5cf nodeName:}" failed. No retries permitted until 2026-07-24 13:45:29.864459849 +0000 UTC m=+38.099811189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls") pod "image-registry-9959d7b-5fm5d" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf") : secret "image-registry-tls" not found
Jul 24 13:45:25.864646 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:25.864517    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert podName:f1fcef7a-6518-4fc3-89c0-201e2d08b506 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:29.864500081 +0000 UTC m=+38.099851437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mm49r" (UID: "f1fcef7a-6518-4fc3-89c0-201e2d08b506") : secret "networking-console-plugin-cert" not found
Jul 24 13:45:25.965054 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:25.965020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:25.965241 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:25.965137    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:45:25.965241 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:25.965206    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls podName:8c85b14b-79da-476c-b403-dcf9a30fa473 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:29.965191416 +0000 UTC m=+38.200542756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls") pod "dns-default-qgfbv" (UID: "8c85b14b-79da-476c-b403-dcf9a30fa473") : secret "dns-default-metrics-tls" not found
Jul 24 13:45:26.409832 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:26.409591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x7w45" event={"ID":"97d637b1-98c3-4f98-9555-08a28bcf744e","Type":"ContainerStarted","Data":"18f9c562db2f3f77946a76f9c8601a09417b6866266db6ea2b4c068b872e53dc"}
Jul 24 13:45:26.410919 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:26.410891    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j2hpq" event={"ID":"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0","Type":"ContainerStarted","Data":"82edf7373642982b2ea5953ad79581f6cd106903c2dc175e9d764c32cdc66c59"}
Jul 24 13:45:26.412085 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:26.412046    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jrrcp" event={"ID":"6dd4417c-eb39-41e8-bda7-d128fec501c2","Type":"ContainerStarted","Data":"55e6f6be2641f306f326097b3563b831e343bb3ba0d3635e41580469e30bf016"}
Jul 24 13:45:26.428157 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:26.428108    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x7w45" podStartSLOduration=1.199793521 podStartE2EDuration="4.428091563s" totalImagesPullingTime="3.228298042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:45:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:26.426476121 +0000 UTC m=+34.661827482" watchObservedRunningTime="2026-07-24 13:45:26.428091563 +0000 UTC m=+34.663442925"
Jul 24 13:45:26.665666 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:26.665627    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v2vhl_eca23889-1269-4438-a4a6-6f6b81b08dbc/konnectivity-agent/0.log" limit=1024
Jul 24 13:45:26.769744 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:26.769701    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v2vhl_eca23889-1269-4438-a4a6-6f6b81b08dbc/konnectivity-agent/0.log" limit=1024
Jul 24 13:45:26.832731 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:26.832690    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v2vhl_eca23889-1269-4438-a4a6-6f6b81b08dbc/konnectivity-agent/0.log" limit=1024
Jul 24 13:45:27.401794 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:27.401761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v2vhl_eca23889-1269-4438-a4a6-6f6b81b08dbc/konnectivity-agent/0.log" limit=1024
Jul 24 13:45:27.461649 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:27.461597    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v2vhl_eca23889-1269-4438-a4a6-6f6b81b08dbc/konnectivity-agent/0.log" limit=1024
Jul 24 13:45:28.421790 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:28.421211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scx8p" event={"ID":"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f","Type":"ContainerDied","Data":"7f13b75f571c1e323b54fc2be9a9c4df1fc801dc79d1159538c7297d7c7ae417"}
Jul 24 13:45:28.421790 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:28.421150    2565 generic.go:356] "Generic (PLEG): container finished" podID="6bf1d1e1-8363-4e34-bf6a-920e175bfd7f" containerID="7f13b75f571c1e323b54fc2be9a9c4df1fc801dc79d1159538c7297d7c7ae417" exitCode=0
Jul 24 13:45:29.427736 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:29.427689    2565 generic.go:356] "Generic (PLEG): container finished" podID="6bf1d1e1-8363-4e34-bf6a-920e175bfd7f" containerID="cb00b4a50fe52959763e75adeefd4aa72af34fb6bbf0603d271712739fee53b9" exitCode=0
Jul 24 13:45:29.428227 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:29.427770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scx8p" event={"ID":"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f","Type":"ContainerDied","Data":"cb00b4a50fe52959763e75adeefd4aa72af34fb6bbf0603d271712739fee53b9"}
Jul 24 13:45:29.898699 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:29.898664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:45:29.898890 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:29.898770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:29.898890 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:29.898839    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 13:45:29.899020 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:29.898892    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:45:29.899020 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:29.898907    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9959d7b-5fm5d: secret "image-registry-tls" not found
Jul 24 13:45:29.899020 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:29.898922    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert podName:f1fcef7a-6518-4fc3-89c0-201e2d08b506 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:37.898901474 +0000 UTC m=+46.134252830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mm49r" (UID: "f1fcef7a-6518-4fc3-89c0-201e2d08b506") : secret "networking-console-plugin-cert" not found
Jul 24 13:45:29.899020 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:29.898953    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls podName:47045f93-b0db-45f5-801e-6e524c7da5cf nodeName:}" failed. No retries permitted until 2026-07-24 13:45:37.898938139 +0000 UTC m=+46.134289495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls") pod "image-registry-9959d7b-5fm5d" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf") : secret "image-registry-tls" not found
Jul 24 13:45:29.999385 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:29.999344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:29.999586 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:29.999523    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:45:29.999654 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:29.999603    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls podName:8c85b14b-79da-476c-b403-dcf9a30fa473 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:37.999580098 +0000 UTC m=+46.234931443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls") pod "dns-default-qgfbv" (UID: "8c85b14b-79da-476c-b403-dcf9a30fa473") : secret "dns-default-metrics-tls" not found
Jul 24 13:45:30.433683 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:30.433633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scx8p" event={"ID":"6bf1d1e1-8363-4e34-bf6a-920e175bfd7f","Type":"ContainerStarted","Data":"055ba0e8a3b03df9aed2502b7a548eb2fc32ab245877b4164a1a46dfe4c56bbd"}
Jul 24 13:45:30.456829 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:30.456775    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-scx8p" podStartSLOduration=6.444914465 podStartE2EDuration="38.456753984s" totalImagesPullingTime="32.011839519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:44:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:30.455066255 +0000 UTC m=+38.690417619" watchObservedRunningTime="2026-07-24 13:45:30.456753984 +0000 UTC m=+38.692105347"
Jul 24 13:45:30.578957 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:30.578911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v2vhl_eca23889-1269-4438-a4a6-6f6b81b08dbc/konnectivity-agent/0.log" limit=1024
Jul 24 13:45:30.684836 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:30.684751    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v2vhl_eca23889-1269-4438-a4a6-6f6b81b08dbc/konnectivity-agent/0.log" limit=1024
Jul 24 13:45:33.443517 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:33.443480    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j2hpq" event={"ID":"57dfab3c-f8a9-4e6f-b953-6bfd7036ded0","Type":"ContainerStarted","Data":"ecf19745f2dbdc29f1a286c7549b0b17c8463193f8ea0071ac2a4134f41feda2"}
Jul 24 13:45:33.444804 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:33.444778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jrrcp" event={"ID":"6dd4417c-eb39-41e8-bda7-d128fec501c2","Type":"ContainerStarted","Data":"48f0c7e1897274941fdb0abca0cd8cd1e49ca74fe94e186fde877850ea726479"}
Jul 24 13:45:33.444928 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:33.444905    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:45:33.460708 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:33.460647    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j2hpq" podStartSLOduration=33.533053252 podStartE2EDuration="40.460631171s" totalImagesPullingTime="6.927577919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:33.459421624 +0000 UTC m=+41.694772988" watchObservedRunningTime="2026-07-24 13:45:33.460631171 +0000 UTC m=+41.695982532"
Jul 24 13:45:33.475158 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:33.475090    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jrrcp" podStartSLOduration=34.557556101 podStartE2EDuration="41.475076091s" totalImagesPullingTime="6.91751999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:33.474468849 +0000 UTC m=+41.709820212" watchObservedRunningTime="2026-07-24 13:45:33.475076091 +0000 UTC m=+41.710427454"
Jul 24 13:45:36.104060 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:36.104024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v2vhl_eca23889-1269-4438-a4a6-6f6b81b08dbc/konnectivity-agent/0.log" limit=1024
Jul 24 13:45:36.178078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:36.178043    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v2vhl_eca23889-1269-4438-a4a6-6f6b81b08dbc/konnectivity-agent/0.log" limit=1024
Jul 24 13:45:37.960280 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:37.960244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:37.960713 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:37.960296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:45:37.960713 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:37.960398    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 13:45:37.960713 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:37.960436    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:45:37.960713 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:37.960455    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert podName:f1fcef7a-6518-4fc3-89c0-201e2d08b506 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:53.960441777 +0000 UTC m=+62.195793117 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mm49r" (UID: "f1fcef7a-6518-4fc3-89c0-201e2d08b506") : secret "networking-console-plugin-cert" not found
Jul 24 13:45:37.960713 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:37.960460    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9959d7b-5fm5d: secret "image-registry-tls" not found
Jul 24 13:45:37.960713 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:37.960516    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls podName:47045f93-b0db-45f5-801e-6e524c7da5cf nodeName:}" failed. No retries permitted until 2026-07-24 13:45:53.960497763 +0000 UTC m=+62.195849105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls") pod "image-registry-9959d7b-5fm5d" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf") : secret "image-registry-tls" not found
Jul 24 13:45:38.061365 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:38.061328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:38.061545 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:38.061454    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:45:38.061545 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:38.061513    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls podName:8c85b14b-79da-476c-b403-dcf9a30fa473 nodeName:}" failed. No retries permitted until 2026-07-24 13:45:54.06149713 +0000 UTC m=+62.296848469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls") pod "dns-default-qgfbv" (UID: "8c85b14b-79da-476c-b403-dcf9a30fa473") : secret "dns-default-metrics-tls" not found
Jul 24 13:45:47.387846 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:47.387817    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qgq7"
Jul 24 13:45:53.975718 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:53.975676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:45:53.976222 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:53.975725    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:45:53.976222 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:53.975837    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 13:45:53.976222 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:53.975853    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:45:53.976222 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:53.975877    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9959d7b-5fm5d: secret "image-registry-tls" not found
Jul 24 13:45:53.976222 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:53.975899    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert podName:f1fcef7a-6518-4fc3-89c0-201e2d08b506 nodeName:}" failed. No retries permitted until 2026-07-24 13:46:25.975880581 +0000 UTC m=+94.211231921 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mm49r" (UID: "f1fcef7a-6518-4fc3-89c0-201e2d08b506") : secret "networking-console-plugin-cert" not found
Jul 24 13:45:53.976222 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:53.975931    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls podName:47045f93-b0db-45f5-801e-6e524c7da5cf nodeName:}" failed. No retries permitted until 2026-07-24 13:46:25.975912711 +0000 UTC m=+94.211264065 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls") pod "image-registry-9959d7b-5fm5d" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf") : secret "image-registry-tls" not found
Jul 24 13:45:54.076860 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:54.076816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:45:54.077004 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:54.076939    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:45:54.077004 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:54.076989    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls podName:8c85b14b-79da-476c-b403-dcf9a30fa473 nodeName:}" failed. No retries permitted until 2026-07-24 13:46:26.076976414 +0000 UTC m=+94.312327754 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls") pod "dns-default-qgfbv" (UID: "8c85b14b-79da-476c-b403-dcf9a30fa473") : secret "dns-default-metrics-tls" not found
Jul 24 13:45:56.999454 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:45:56.999412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:45:56.999870 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:56.999533    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 13:45:56.999870 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:45:56.999588    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs podName:6ec1c31e-6c92-4f1d-a9e3-0228915d6893 nodeName:}" failed. No retries permitted until 2026-07-24 13:47:00.99957297 +0000 UTC m=+129.234924310 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs") pod "network-metrics-daemon-l7qzc" (UID: "6ec1c31e-6c92-4f1d-a9e3-0228915d6893") : secret "metrics-daemon-secret" not found
Jul 24 13:46:04.449749 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:46:04.449713    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jrrcp"
Jul 24 13:46:26.004121 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:46:26.004077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:46:26.004728 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:46:26.004151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:46:26.004728 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:46:26.004261    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:46:26.004728 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:46:26.004266    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 13:46:26.004728 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:46:26.004273    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9959d7b-5fm5d: secret "image-registry-tls" not found
Jul 24 13:46:26.004728 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:46:26.004363    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert podName:f1fcef7a-6518-4fc3-89c0-201e2d08b506 nodeName:}" failed. No retries permitted until 2026-07-24 13:47:30.004340423 +0000 UTC m=+158.239691762 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mm49r" (UID: "f1fcef7a-6518-4fc3-89c0-201e2d08b506") : secret "networking-console-plugin-cert" not found
Jul 24 13:46:26.004728 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:46:26.004403    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls podName:47045f93-b0db-45f5-801e-6e524c7da5cf nodeName:}" failed. No retries permitted until 2026-07-24 13:47:30.004388747 +0000 UTC m=+158.239740087 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls") pod "image-registry-9959d7b-5fm5d" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf") : secret "image-registry-tls" not found
Jul 24 13:46:26.104781 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:46:26.104736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:46:26.104969 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:46:26.104890    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:46:26.104969 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:46:26.104956    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls podName:8c85b14b-79da-476c-b403-dcf9a30fa473 nodeName:}" failed. No retries permitted until 2026-07-24 13:47:30.104937193 +0000 UTC m=+158.340288532 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls") pod "dns-default-qgfbv" (UID: "8c85b14b-79da-476c-b403-dcf9a30fa473") : secret "dns-default-metrics-tls" not found
Jul 24 13:47:01.056759 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:47:01.056703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:47:01.057430 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:47:01.056873    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 13:47:01.057430 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:47:01.056960    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs podName:6ec1c31e-6c92-4f1d-a9e3-0228915d6893 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:03.056938194 +0000 UTC m=+251.292289536 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs") pod "network-metrics-daemon-l7qzc" (UID: "6ec1c31e-6c92-4f1d-a9e3-0228915d6893") : secret "metrics-daemon-secret" not found
Jul 24 13:47:25.126587 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:47:25.126531    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-9959d7b-5fm5d" podUID="47045f93-b0db-45f5-801e-6e524c7da5cf"
Jul 24 13:47:25.139834 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:47:25.139804    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r" podUID="f1fcef7a-6518-4fc3-89c0-201e2d08b506"
Jul 24 13:47:25.172034 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:47:25.171998    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qgfbv" podUID="8c85b14b-79da-476c-b403-dcf9a30fa473"
Jul 24 13:47:25.715636 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:47:25.715607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:47:25.715807 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:47:25.715607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:47:25.715807 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:47:25.715607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:47:26.199750 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:47:26.199708    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:47:30.070265 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:47:30.070215    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:47:30.070657 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:47:30.070294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:47:30.070657 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:47:30.070373    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 13:47:30.070657 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:47:30.070380    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:47:30.070657 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:47:30.070397    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9959d7b-5fm5d: secret "image-registry-tls" not found
Jul 24 13:47:30.070657 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:47:30.070452    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert podName:f1fcef7a-6518-4fc3-89c0-201e2d08b506 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:32.070436586 +0000 UTC m=+280.305787925 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mm49r" (UID: "f1fcef7a-6518-4fc3-89c0-201e2d08b506") : secret "networking-console-plugin-cert" not found
Jul 24 13:47:30.070657 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:47:30.070467    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls podName:47045f93-b0db-45f5-801e-6e524c7da5cf nodeName:}" failed. No retries permitted until 2026-07-24 13:49:32.070460717 +0000 UTC m=+280.305812057 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls") pod "image-registry-9959d7b-5fm5d" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf") : secret "image-registry-tls" not found
Jul 24 13:47:30.170656 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:47:30.170620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:47:30.170751 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:47:30.170738    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:47:30.170811 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:47:30.170801    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls podName:8c85b14b-79da-476c-b403-dcf9a30fa473 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:32.170787267 +0000 UTC m=+280.406138606 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls") pod "dns-default-qgfbv" (UID: "8c85b14b-79da-476c-b403-dcf9a30fa473") : secret "dns-default-metrics-tls" not found
Jul 24 13:47:39.189515 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:47:39.189476    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:49:03.136019 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:03.135965    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:49:03.136553 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:03.136148    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 13:49:03.136553 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:03.136252    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs podName:6ec1c31e-6c92-4f1d-a9e3-0228915d6893 nodeName:}" failed. No retries permitted until 2026-07-24 13:51:05.136232897 +0000 UTC m=+373.371584236 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs") pod "network-metrics-daemon-l7qzc" (UID: "6ec1c31e-6c92-4f1d-a9e3-0228915d6893") : secret "metrics-daemon-secret" not found
Jul 24 13:49:19.166209 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.166154    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2wphn"]
Jul 24 13:49:19.168979 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.168961    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2wphn"
Jul 24 13:49:19.171482 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.171457    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 24 13:49:19.171874 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.171847    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 24 13:49:19.173096 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.173074    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nkzcb\""
Jul 24 13:49:19.173211 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.173164    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h"]
Jul 24 13:49:19.176014 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.175997    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-tpj42"]
Jul 24 13:49:19.176453 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.176123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h"
Jul 24 13:49:19.179090 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.179073    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 24 13:49:19.179257 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.179235    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-qrsrx"]
Jul 24 13:49:19.179364 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.179347    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:19.179430 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.179363    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 24 13:49:19.179868 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.179852    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 24 13:49:19.179950 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.179885    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 24 13:49:19.180471 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.180455    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-n5vlt\""
Jul 24 13:49:19.181893 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.181877    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.183437 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.183413    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 24 13:49:19.183576 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.183557    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zzwd8\""
Jul 24 13:49:19.183740 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.183428    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 24 13:49:19.184004 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.183961    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 24 13:49:19.184357 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.184337    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 24 13:49:19.184461 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.184412    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 24 13:49:19.184666 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.184648    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 24 13:49:19.184769 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.184708    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mvcq7\""
Jul 24 13:49:19.184987 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.184970    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 13:49:19.185662 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.185644    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 13:49:19.186073 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.186051    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2wphn"]
Jul 24 13:49:19.192289 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.192264    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 24 13:49:19.192789 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.192767    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 24 13:49:19.193871 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.193850    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h"]
Jul 24 13:49:19.195326 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.195308    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-qrsrx"]
Jul 24 13:49:19.198732 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.198710    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-tpj42"]
Jul 24 13:49:19.254072 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.254037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75d9eb42-05d9-4729-9382-85f04774bf0f-service-ca-bundle\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.254072 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.254074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbgj2\" (UniqueName: \"kubernetes.io/projected/8803d13e-5655-4481-941e-fd87cecc876b-kube-api-access-rbgj2\") pod \"service-ca-operator-5d6c75f84f-xxb7h\" (UID: \"8803d13e-5655-4481-941e-fd87cecc876b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h"
Jul 24 13:49:19.254367 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.254102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75d9eb42-05d9-4729-9382-85f04774bf0f-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.254367 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.254166    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vvf5\" (UniqueName: \"kubernetes.io/projected/3418ef40-7177-4cd3-973a-702387be8288-kube-api-access-2vvf5\") pod \"volume-data-source-validator-549c6d54cf-2wphn\" (UID: \"3418ef40-7177-4cd3-973a-702387be8288\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2wphn"
Jul 24 13:49:19.254367 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.254231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/75d9eb42-05d9-4729-9382-85f04774bf0f-snapshots\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.254367 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.254279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8803d13e-5655-4481-941e-fd87cecc876b-serving-cert\") pod \"service-ca-operator-5d6c75f84f-xxb7h\" (UID: \"8803d13e-5655-4481-941e-fd87cecc876b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h"
Jul 24 13:49:19.254367 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.254302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f6021e5-db06-4a65-9008-8515a852ba0f-config\") pod \"console-operator-584dcb6b54-tpj42\" (UID: \"0f6021e5-db06-4a65-9008-8515a852ba0f\") " pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:19.254367 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.254355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f6021e5-db06-4a65-9008-8515a852ba0f-trusted-ca\") pod \"console-operator-584dcb6b54-tpj42\" (UID: \"0f6021e5-db06-4a65-9008-8515a852ba0f\") " pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:19.254595 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.254380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f6021e5-db06-4a65-9008-8515a852ba0f-serving-cert\") pod \"console-operator-584dcb6b54-tpj42\" (UID: \"0f6021e5-db06-4a65-9008-8515a852ba0f\") " pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:19.254595 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.254411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87zcp\" (UniqueName: \"kubernetes.io/projected/75d9eb42-05d9-4729-9382-85f04774bf0f-kube-api-access-87zcp\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.254595 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.254435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75d9eb42-05d9-4729-9382-85f04774bf0f-tmp\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.254595 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.254475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7zqp\" (UniqueName: \"kubernetes.io/projected/0f6021e5-db06-4a65-9008-8515a852ba0f-kube-api-access-r7zqp\") pod \"console-operator-584dcb6b54-tpj42\" (UID: \"0f6021e5-db06-4a65-9008-8515a852ba0f\") " pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:19.254595 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.254525    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75d9eb42-05d9-4729-9382-85f04774bf0f-serving-cert\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.254595 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.254569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8803d13e-5655-4481-941e-fd87cecc876b-config\") pod \"service-ca-operator-5d6c75f84f-xxb7h\" (UID: \"8803d13e-5655-4481-941e-fd87cecc876b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h"
Jul 24 13:49:19.263006 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.262982    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c"]
Jul 24 13:49:19.266000 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.265982    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c"
Jul 24 13:49:19.302871 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.302844    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 24 13:49:19.302871 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.302870    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 24 13:49:19.303083 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.302895    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fzsz8\""
Jul 24 13:49:19.303083 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.302844    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 24 13:49:19.303827 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.303804    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c6777bc7-kmtdh"]
Jul 24 13:49:19.303920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.303880    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 24 13:49:19.306686 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.306666    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.312427 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.312406    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 24 13:49:19.314045 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.314012    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 24 13:49:19.314861 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.314687    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 13:49:19.314956 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.314686    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 13:49:19.315007 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.314689    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 24 13:49:19.321382 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.321363    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 24 13:49:19.326560 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.326546    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9nd5z\""
Jul 24 13:49:19.338942 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.338924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c"]
Jul 24 13:49:19.355292 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvf5\" (UniqueName: \"kubernetes.io/projected/3418ef40-7177-4cd3-973a-702387be8288-kube-api-access-2vvf5\") pod \"volume-data-source-validator-549c6d54cf-2wphn\" (UID: \"3418ef40-7177-4cd3-973a-702387be8288\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2wphn"
Jul 24 13:49:19.355438 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.355438 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c905979c-221e-4583-9394-646302006355-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c\" (UID: \"c905979c-221e-4583-9394-646302006355\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c"
Jul 24 13:49:19.355438 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.355438 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/75d9eb42-05d9-4729-9382-85f04774bf0f-snapshots\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.355438 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8803d13e-5655-4481-941e-fd87cecc876b-serving-cert\") pod \"service-ca-operator-5d6c75f84f-xxb7h\" (UID: \"8803d13e-5655-4481-941e-fd87cecc876b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h"
Jul 24 13:49:19.355632 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f6021e5-db06-4a65-9008-8515a852ba0f-config\") pod \"console-operator-584dcb6b54-tpj42\" (UID: \"0f6021e5-db06-4a65-9008-8515a852ba0f\") " pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:19.355632 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355475    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f6021e5-db06-4a65-9008-8515a852ba0f-trusted-ca\") pod \"console-operator-584dcb6b54-tpj42\" (UID: \"0f6021e5-db06-4a65-9008-8515a852ba0f\") " pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:19.355632 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f6021e5-db06-4a65-9008-8515a852ba0f-serving-cert\") pod \"console-operator-584dcb6b54-tpj42\" (UID: \"0f6021e5-db06-4a65-9008-8515a852ba0f\") " pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:19.355632 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355526    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87zcp\" (UniqueName: \"kubernetes.io/projected/75d9eb42-05d9-4729-9382-85f04774bf0f-kube-api-access-87zcp\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.355632 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75d9eb42-05d9-4729-9382-85f04774bf0f-tmp\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.355632 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c905979c-221e-4583-9394-646302006355-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c\" (UID: \"c905979c-221e-4583-9394-646302006355\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c"
Jul 24 13:49:19.355632 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7zqp\" (UniqueName: \"kubernetes.io/projected/0f6021e5-db06-4a65-9008-8515a852ba0f-kube-api-access-r7zqp\") pod \"console-operator-584dcb6b54-tpj42\" (UID: \"0f6021e5-db06-4a65-9008-8515a852ba0f\") " pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:19.355915 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-stats-auth\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.355915 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75d9eb42-05d9-4729-9382-85f04774bf0f-serving-cert\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.355915 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-default-certificate\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.355915 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fjl6\" (UniqueName: \"kubernetes.io/projected/c905979c-221e-4583-9394-646302006355-kube-api-access-8fjl6\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c\" (UID: \"c905979c-221e-4583-9394-646302006355\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c"
Jul 24 13:49:19.355915 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8803d13e-5655-4481-941e-fd87cecc876b-config\") pod \"service-ca-operator-5d6c75f84f-xxb7h\" (UID: \"8803d13e-5655-4481-941e-fd87cecc876b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h"
Jul 24 13:49:19.355915 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355793    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75d9eb42-05d9-4729-9382-85f04774bf0f-service-ca-bundle\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.355915 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgj2\" (UniqueName: \"kubernetes.io/projected/8803d13e-5655-4481-941e-fd87cecc876b-kube-api-access-rbgj2\") pod \"service-ca-operator-5d6c75f84f-xxb7h\" (UID: \"8803d13e-5655-4481-941e-fd87cecc876b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h"
Jul 24 13:49:19.355915 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75d9eb42-05d9-4729-9382-85f04774bf0f-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.355915 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.355882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z25jb\" (UniqueName: \"kubernetes.io/projected/419e2dcc-9848-46b9-a353-00ff6d78be07-kube-api-access-z25jb\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.356384 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.356106    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/75d9eb42-05d9-4729-9382-85f04774bf0f-snapshots\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.356384 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.356313    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f6021e5-db06-4a65-9008-8515a852ba0f-config\") pod \"console-operator-584dcb6b54-tpj42\" (UID: \"0f6021e5-db06-4a65-9008-8515a852ba0f\") " pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:19.356527 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.356505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f6021e5-db06-4a65-9008-8515a852ba0f-trusted-ca\") pod \"console-operator-584dcb6b54-tpj42\" (UID: \"0f6021e5-db06-4a65-9008-8515a852ba0f\") " pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:19.356621 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.356580    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8803d13e-5655-4481-941e-fd87cecc876b-config\") pod \"service-ca-operator-5d6c75f84f-xxb7h\" (UID: \"8803d13e-5655-4481-941e-fd87cecc876b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h"
Jul 24 13:49:19.356776 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.356747    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75d9eb42-05d9-4729-9382-85f04774bf0f-service-ca-bundle\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.356925 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.356759    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75d9eb42-05d9-4729-9382-85f04774bf0f-tmp\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.357238 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.357220    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75d9eb42-05d9-4729-9382-85f04774bf0f-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.359018 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.358998    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f6021e5-db06-4a65-9008-8515a852ba0f-serving-cert\") pod \"console-operator-584dcb6b54-tpj42\" (UID: \"0f6021e5-db06-4a65-9008-8515a852ba0f\") " pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:19.359136 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.359119    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8803d13e-5655-4481-941e-fd87cecc876b-serving-cert\") pod \"service-ca-operator-5d6c75f84f-xxb7h\" (UID: \"8803d13e-5655-4481-941e-fd87cecc876b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h"
Jul 24 13:49:19.359307 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.359274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75d9eb42-05d9-4729-9382-85f04774bf0f-serving-cert\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.363366 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.363332    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c6777bc7-kmtdh"]
Jul 24 13:49:19.372861 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.372838    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vvf5\" (UniqueName: \"kubernetes.io/projected/3418ef40-7177-4cd3-973a-702387be8288-kube-api-access-2vvf5\") pod \"volume-data-source-validator-549c6d54cf-2wphn\" (UID: \"3418ef40-7177-4cd3-973a-702387be8288\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2wphn"
Jul 24 13:49:19.377967 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.377941    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7zqp\" (UniqueName: \"kubernetes.io/projected/0f6021e5-db06-4a65-9008-8515a852ba0f-kube-api-access-r7zqp\") pod \"console-operator-584dcb6b54-tpj42\" (UID: \"0f6021e5-db06-4a65-9008-8515a852ba0f\") " pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:19.383356 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.383319    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbgj2\" (UniqueName: \"kubernetes.io/projected/8803d13e-5655-4481-941e-fd87cecc876b-kube-api-access-rbgj2\") pod \"service-ca-operator-5d6c75f84f-xxb7h\" (UID: \"8803d13e-5655-4481-941e-fd87cecc876b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h"
Jul 24 13:49:19.383561 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.383545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87zcp\" (UniqueName: \"kubernetes.io/projected/75d9eb42-05d9-4729-9382-85f04774bf0f-kube-api-access-87zcp\") pod \"insights-operator-5885fdb759-qrsrx\" (UID: \"75d9eb42-05d9-4729-9382-85f04774bf0f\") " pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.456547 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.456445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z25jb\" (UniqueName: \"kubernetes.io/projected/419e2dcc-9848-46b9-a353-00ff6d78be07-kube-api-access-z25jb\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.456547 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.456513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.456547 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.456539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c905979c-221e-4583-9394-646302006355-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c\" (UID: \"c905979c-221e-4583-9394-646302006355\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c"
Jul 24 13:49:19.456855 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.456567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.456855 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:19.456658    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 13:49:19.456855 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:19.456698    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle podName:419e2dcc-9848-46b9-a353-00ff6d78be07 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:19.956679738 +0000 UTC m=+268.192031094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle") pod "router-default-7c6777bc7-kmtdh" (UID: "419e2dcc-9848-46b9-a353-00ff6d78be07") : configmap references non-existent config key: service-ca.crt
Jul 24 13:49:19.456855 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:19.456733    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs podName:419e2dcc-9848-46b9-a353-00ff6d78be07 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:19.9567161 +0000 UTC m=+268.192067449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs") pod "router-default-7c6777bc7-kmtdh" (UID: "419e2dcc-9848-46b9-a353-00ff6d78be07") : secret "router-metrics-certs-default" not found
Jul 24 13:49:19.456855 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.456798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c905979c-221e-4583-9394-646302006355-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c\" (UID: \"c905979c-221e-4583-9394-646302006355\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c"
Jul 24 13:49:19.456855 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.456844    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-stats-auth\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.457226 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.456880    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-default-certificate\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.457226 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.456913    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fjl6\" (UniqueName: \"kubernetes.io/projected/c905979c-221e-4583-9394-646302006355-kube-api-access-8fjl6\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c\" (UID: \"c905979c-221e-4583-9394-646302006355\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c"
Jul 24 13:49:19.457325 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.457225    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c905979c-221e-4583-9394-646302006355-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c\" (UID: \"c905979c-221e-4583-9394-646302006355\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c"
Jul 24 13:49:19.459152 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.459121    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c905979c-221e-4583-9394-646302006355-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c\" (UID: \"c905979c-221e-4583-9394-646302006355\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c"
Jul 24 13:49:19.459433 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.459414    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-stats-auth\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.459475 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.459414    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-default-certificate\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.467369 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.467347    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z25jb\" (UniqueName: \"kubernetes.io/projected/419e2dcc-9848-46b9-a353-00ff6d78be07-kube-api-access-z25jb\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.467972 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.467955    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fjl6\" (UniqueName: \"kubernetes.io/projected/c905979c-221e-4583-9394-646302006355-kube-api-access-8fjl6\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c\" (UID: \"c905979c-221e-4583-9394-646302006355\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c"
Jul 24 13:49:19.479302 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.479272    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2wphn"
Jul 24 13:49:19.487629 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.487610    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h"
Jul 24 13:49:19.495690 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.495664    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:19.502517 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.502495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-qrsrx"
Jul 24 13:49:19.574686 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.574470    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c"
Jul 24 13:49:19.652694 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.651079    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2wphn"]
Jul 24 13:49:19.668743 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.667578    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h"]
Jul 24 13:49:19.677589 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:49:19.677553    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8803d13e_5655_4481_941e_fd87cecc876b.slice/crio-21c1ea0931033550a4474b7b69d431700d8b4c81526dfc197ec820dc8f6036ad WatchSource:0}: Error finding container 21c1ea0931033550a4474b7b69d431700d8b4c81526dfc197ec820dc8f6036ad: Status 404 returned error can't find the container with id 21c1ea0931033550a4474b7b69d431700d8b4c81526dfc197ec820dc8f6036ad
Jul 24 13:49:19.696234 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.696204    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-tpj42"]
Jul 24 13:49:19.697296 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.697272    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-qrsrx"]
Jul 24 13:49:19.698997 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:49:19.698972    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d9eb42_05d9_4729_9382_85f04774bf0f.slice/crio-017a9c8a45be5a258ca63453590f167580e3bd89efce118b2064f0cbcf951d4b WatchSource:0}: Error finding container 017a9c8a45be5a258ca63453590f167580e3bd89efce118b2064f0cbcf951d4b: Status 404 returned error can't find the container with id 017a9c8a45be5a258ca63453590f167580e3bd89efce118b2064f0cbcf951d4b
Jul 24 13:49:19.699946 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:49:19.699921    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6021e5_db06_4a65_9008_8515a852ba0f.slice/crio-fca5a4d3e47abec891bb4b36cdfbdd82d5b78ffe676f46e6ac128d1c8772cf6c WatchSource:0}: Error finding container fca5a4d3e47abec891bb4b36cdfbdd82d5b78ffe676f46e6ac128d1c8772cf6c: Status 404 returned error can't find the container with id fca5a4d3e47abec891bb4b36cdfbdd82d5b78ffe676f46e6ac128d1c8772cf6c
Jul 24 13:49:19.742265 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.742237    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c"]
Jul 24 13:49:19.744454 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:49:19.744425    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc905979c_221e_4583_9394_646302006355.slice/crio-1627f2f2462c8f64e1d210a9ef90412f2ad8a307a40a229743f81653fef0ac94 WatchSource:0}: Error finding container 1627f2f2462c8f64e1d210a9ef90412f2ad8a307a40a229743f81653fef0ac94: Status 404 returned error can't find the container with id 1627f2f2462c8f64e1d210a9ef90412f2ad8a307a40a229743f81653fef0ac94
Jul 24 13:49:19.964067 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.964032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.964067 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.964072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:19.964315 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:19.964227    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 13:49:19.964315 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:19.964254    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle podName:419e2dcc-9848-46b9-a353-00ff6d78be07 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:20.964241317 +0000 UTC m=+269.199592657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle") pod "router-default-7c6777bc7-kmtdh" (UID: "419e2dcc-9848-46b9-a353-00ff6d78be07") : configmap references non-existent config key: service-ca.crt
Jul 24 13:49:19.964315 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:19.964284    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs podName:419e2dcc-9848-46b9-a353-00ff6d78be07 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:20.964270222 +0000 UTC m=+269.199621567 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs") pod "router-default-7c6777bc7-kmtdh" (UID: "419e2dcc-9848-46b9-a353-00ff6d78be07") : secret "router-metrics-certs-default" not found
Jul 24 13:49:19.984524 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.984491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-qrsrx" event={"ID":"75d9eb42-05d9-4729-9382-85f04774bf0f","Type":"ContainerStarted","Data":"017a9c8a45be5a258ca63453590f167580e3bd89efce118b2064f0cbcf951d4b"}
Jul 24 13:49:19.985531 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.985504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h" event={"ID":"8803d13e-5655-4481-941e-fd87cecc876b","Type":"ContainerStarted","Data":"21c1ea0931033550a4474b7b69d431700d8b4c81526dfc197ec820dc8f6036ad"}
Jul 24 13:49:19.986580 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.986555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2wphn" event={"ID":"3418ef40-7177-4cd3-973a-702387be8288","Type":"ContainerStarted","Data":"4d484d2e1d3a8ec5c21a3a5317fa5752bb2224cb4cc2fe35b9ee848209f73ee4"}
Jul 24 13:49:19.987502 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.987481    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c" event={"ID":"c905979c-221e-4583-9394-646302006355","Type":"ContainerStarted","Data":"1627f2f2462c8f64e1d210a9ef90412f2ad8a307a40a229743f81653fef0ac94"}
Jul 24 13:49:19.988455 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:19.988435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42" event={"ID":"0f6021e5-db06-4a65-9008-8515a852ba0f","Type":"ContainerStarted","Data":"fca5a4d3e47abec891bb4b36cdfbdd82d5b78ffe676f46e6ac128d1c8772cf6c"}
Jul 24 13:49:20.975143 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:20.975081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:20.975143 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:20.975135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:20.975689 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:20.975260    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 13:49:20.975689 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:20.975313    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle podName:419e2dcc-9848-46b9-a353-00ff6d78be07 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:22.975290196 +0000 UTC m=+271.210641556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle") pod "router-default-7c6777bc7-kmtdh" (UID: "419e2dcc-9848-46b9-a353-00ff6d78be07") : configmap references non-existent config key: service-ca.crt
Jul 24 13:49:20.975689 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:20.975341    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs podName:419e2dcc-9848-46b9-a353-00ff6d78be07 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:22.975330686 +0000 UTC m=+271.210682031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs") pod "router-default-7c6777bc7-kmtdh" (UID: "419e2dcc-9848-46b9-a353-00ff6d78be07") : secret "router-metrics-certs-default" not found
Jul 24 13:49:21.997626 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:21.997558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2wphn" event={"ID":"3418ef40-7177-4cd3-973a-702387be8288","Type":"ContainerStarted","Data":"2ba5e52c27482ce43d3e032758d29bc2a0b45b74c57a39a7ce7caebde60d45ee"}
Jul 24 13:49:22.013191 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:22.012969    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2wphn" podStartSLOduration=1.574733212 podStartE2EDuration="3.012948269s" totalImagesPullingTime="1.438215057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:49:22.01287172 +0000 UTC m=+270.248223083" watchObservedRunningTime="2026-07-24 13:49:22.012948269 +0000 UTC m=+270.248299632"
Jul 24 13:49:22.994128 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:22.994082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:22.994128 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:22.994136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:22.994374 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:22.994266    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 13:49:22.994374 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:22.994301    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle podName:419e2dcc-9848-46b9-a353-00ff6d78be07 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:26.994281656 +0000 UTC m=+275.229633018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle") pod "router-default-7c6777bc7-kmtdh" (UID: "419e2dcc-9848-46b9-a353-00ff6d78be07") : configmap references non-existent config key: service-ca.crt
Jul 24 13:49:22.994374 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:22.994328    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs podName:419e2dcc-9848-46b9-a353-00ff6d78be07 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:26.994311643 +0000 UTC m=+275.229663000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs") pod "router-default-7c6777bc7-kmtdh" (UID: "419e2dcc-9848-46b9-a353-00ff6d78be07") : secret "router-metrics-certs-default" not found
Jul 24 13:49:24.010884 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:24.010786    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c" event={"ID":"c905979c-221e-4583-9394-646302006355","Type":"ContainerStarted","Data":"2a3b5d2ff821c23ff4930af2b241dbd3e45b3b9e059c7463ece50eaa53e64d99"}
Jul 24 13:49:24.012593 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:24.012570    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/0.log"
Jul 24 13:49:24.012736 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:24.012614    2565 generic.go:356] "Generic (PLEG): container finished" podID="0f6021e5-db06-4a65-9008-8515a852ba0f" containerID="bb8401967f8a754387000d0430153dcb8cfef53c076bc4fda6eee7c7b10e9e2e" exitCode=255
Jul 24 13:49:24.012736 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:24.012706    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42" event={"ID":"0f6021e5-db06-4a65-9008-8515a852ba0f","Type":"ContainerDied","Data":"bb8401967f8a754387000d0430153dcb8cfef53c076bc4fda6eee7c7b10e9e2e"}
Jul 24 13:49:24.012912 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:24.012894    2565 scope.go:117] "RemoveContainer" containerID="bb8401967f8a754387000d0430153dcb8cfef53c076bc4fda6eee7c7b10e9e2e"
Jul 24 13:49:24.014374 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:24.014294    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-qrsrx" event={"ID":"75d9eb42-05d9-4729-9382-85f04774bf0f","Type":"ContainerStarted","Data":"bd7dc9f0249b29cace1044bd704b8b658c61911b3b9214949b001a5ee2aa7496"}
Jul 24 13:49:24.017111 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:24.016890    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h" event={"ID":"8803d13e-5655-4481-941e-fd87cecc876b","Type":"ContainerStarted","Data":"c917f82098880a721b44c4727a3fb2983122eec39f30718a432e7a9fc3a8ffca"}
Jul 24 13:49:24.027413 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:24.027245    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c" podStartSLOduration=1.186217371 podStartE2EDuration="5.027227452s" totalImagesPullingTime="3.841010081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:49:24.027020268 +0000 UTC m=+272.262371631" watchObservedRunningTime="2026-07-24 13:49:24.027227452 +0000 UTC m=+272.262578817"
Jul 24 13:49:24.058496 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:24.058445    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-qrsrx" podStartSLOduration=1.175477071 podStartE2EDuration="5.058427038s" totalImagesPullingTime="3.882949967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:49:24.057618484 +0000 UTC m=+272.292969844" watchObservedRunningTime="2026-07-24 13:49:24.058427038 +0000 UTC m=+272.293778379"
Jul 24 13:49:24.073389 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:24.073247    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h" podStartSLOduration=1.1630105020000001 podStartE2EDuration="5.073226098s" totalImagesPullingTime="3.910215596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:49:24.072449826 +0000 UTC m=+272.307801192" watchObservedRunningTime="2026-07-24 13:49:24.073226098 +0000 UTC m=+272.308577463"
Jul 24 13:49:25.022366 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.022331    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/1.log"
Jul 24 13:49:25.022874 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.022854    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/0.log"
Jul 24 13:49:25.022939 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.022901    2565 generic.go:356] "Generic (PLEG): container finished" podID="0f6021e5-db06-4a65-9008-8515a852ba0f" containerID="22944bbbacd80c7a42c01571858ee0f6e79f396e99bfa073000406c7d436cb1e" exitCode=255
Jul 24 13:49:25.023026 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.022998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42" event={"ID":"0f6021e5-db06-4a65-9008-8515a852ba0f","Type":"ContainerDied","Data":"22944bbbacd80c7a42c01571858ee0f6e79f396e99bfa073000406c7d436cb1e"}
Jul 24 13:49:25.023093 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.023068    2565 scope.go:117] "RemoveContainer" containerID="bb8401967f8a754387000d0430153dcb8cfef53c076bc4fda6eee7c7b10e9e2e"
Jul 24 13:49:25.023653 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.023304    2565 scope.go:117] "RemoveContainer" containerID="22944bbbacd80c7a42c01571858ee0f6e79f396e99bfa073000406c7d436cb1e"
Jul 24 13:49:25.023653 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:25.023485    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-tpj42_openshift-console-operator(0f6021e5-db06-4a65-9008-8515a852ba0f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42" podUID="0f6021e5-db06-4a65-9008-8515a852ba0f"
Jul 24 13:49:25.333914 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.333871    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lbwkg"]
Jul 24 13:49:25.338745 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.338711    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:25.341254 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.341229    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 13:49:25.341547 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.341522    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 13:49:25.341812 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.341778    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dqt9s\""
Jul 24 13:49:25.350863 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.350836    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lbwkg"]
Jul 24 13:49:25.417981 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.417949    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/083c3a90-e6e7-4e19-9373-025836eed01a-data-volume\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:25.417981 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.417988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:25.418271 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.418189    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:25.418271 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.418236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/083c3a90-e6e7-4e19-9373-025836eed01a-crio-socket\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:25.418271 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.418264    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvq5g\" (UniqueName: \"kubernetes.io/projected/083c3a90-e6e7-4e19-9373-025836eed01a-kube-api-access-jvq5g\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:25.518781 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.518737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:25.518781 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.518781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/083c3a90-e6e7-4e19-9373-025836eed01a-crio-socket\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:25.518997 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.518801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvq5g\" (UniqueName: \"kubernetes.io/projected/083c3a90-e6e7-4e19-9373-025836eed01a-kube-api-access-jvq5g\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:25.518997 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.518833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/083c3a90-e6e7-4e19-9373-025836eed01a-data-volume\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:25.518997 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.518863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:25.518997 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.518882    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/083c3a90-e6e7-4e19-9373-025836eed01a-crio-socket\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:25.518997 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:25.518924    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:25.518997 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:25.518958    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 13:49:25.519220 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:25.519016    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls podName:083c3a90-e6e7-4e19-9373-025836eed01a nodeName:}" failed. No retries permitted until 2026-07-24 13:49:26.018995024 +0000 UTC m=+274.254346381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lbwkg" (UID: "083c3a90-e6e7-4e19-9373-025836eed01a") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:25.519220 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:25.519036    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm podName:083c3a90-e6e7-4e19-9373-025836eed01a nodeName:}" failed. No retries permitted until 2026-07-24 13:49:26.019026764 +0000 UTC m=+274.254378105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lbwkg" (UID: "083c3a90-e6e7-4e19-9373-025836eed01a") : configmap "kube-rbac-proxy" not found
Jul 24 13:49:25.519299 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.519236    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/083c3a90-e6e7-4e19-9373-025836eed01a-data-volume\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:25.527856 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:25.527828    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvq5g\" (UniqueName: \"kubernetes.io/projected/083c3a90-e6e7-4e19-9373-025836eed01a-kube-api-access-jvq5g\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:26.023605 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:26.023563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:26.024093 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:26.023629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:26.024093 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:26.023704    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:26.024093 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:26.023706    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 13:49:26.024093 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:26.023776    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls podName:083c3a90-e6e7-4e19-9373-025836eed01a nodeName:}" failed. No retries permitted until 2026-07-24 13:49:27.023761304 +0000 UTC m=+275.259112644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lbwkg" (UID: "083c3a90-e6e7-4e19-9373-025836eed01a") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:26.024093 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:26.023790    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm podName:083c3a90-e6e7-4e19-9373-025836eed01a nodeName:}" failed. No retries permitted until 2026-07-24 13:49:27.023783853 +0000 UTC m=+275.259135193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lbwkg" (UID: "083c3a90-e6e7-4e19-9373-025836eed01a") : configmap "kube-rbac-proxy" not found
Jul 24 13:49:26.027130 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:26.027111    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/1.log"
Jul 24 13:49:26.027454 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:26.027440    2565 scope.go:117] "RemoveContainer" containerID="22944bbbacd80c7a42c01571858ee0f6e79f396e99bfa073000406c7d436cb1e"
Jul 24 13:49:26.027608 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:26.027590    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-tpj42_openshift-console-operator(0f6021e5-db06-4a65-9008-8515a852ba0f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42" podUID="0f6021e5-db06-4a65-9008-8515a852ba0f"
Jul 24 13:49:27.032116 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:27.032085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:27.032116 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:27.032119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:27.032596 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:27.032199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:27.032596 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:27.032230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:27.032596 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:27.032253    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 13:49:27.032596 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:27.032299    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 13:49:27.032596 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:27.032310    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:27.032596 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:27.032316    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs podName:419e2dcc-9848-46b9-a353-00ff6d78be07 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:35.032297713 +0000 UTC m=+283.267649053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs") pod "router-default-7c6777bc7-kmtdh" (UID: "419e2dcc-9848-46b9-a353-00ff6d78be07") : secret "router-metrics-certs-default" not found
Jul 24 13:49:27.032596 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:27.032361    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle podName:419e2dcc-9848-46b9-a353-00ff6d78be07 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:35.032349439 +0000 UTC m=+283.267700779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle") pod "router-default-7c6777bc7-kmtdh" (UID: "419e2dcc-9848-46b9-a353-00ff6d78be07") : configmap references non-existent config key: service-ca.crt
Jul 24 13:49:27.032596 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:27.032375    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm podName:083c3a90-e6e7-4e19-9373-025836eed01a nodeName:}" failed. No retries permitted until 2026-07-24 13:49:29.032368562 +0000 UTC m=+277.267719901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lbwkg" (UID: "083c3a90-e6e7-4e19-9373-025836eed01a") : configmap "kube-rbac-proxy" not found
Jul 24 13:49:27.032596 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:27.032385    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls podName:083c3a90-e6e7-4e19-9373-025836eed01a nodeName:}" failed. No retries permitted until 2026-07-24 13:49:29.032379494 +0000 UTC m=+277.267730835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lbwkg" (UID: "083c3a90-e6e7-4e19-9373-025836eed01a") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:27.329568 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:27.329541    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gb6xn_aa8826d0-c493-4bbe-85ad-998e7785fb69/dns-node-resolver/0.log"
Jul 24 13:49:28.130757 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:28.130730    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5q8zz_9b846200-4036-4055-ad01-f563a8beed2e/node-ca/0.log"
Jul 24 13:49:28.716735 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:28.716689    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qgfbv" podUID="8c85b14b-79da-476c-b403-dcf9a30fa473"
Jul 24 13:49:28.716911 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:28.716691    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r" podUID="f1fcef7a-6518-4fc3-89c0-201e2d08b506"
Jul 24 13:49:28.716911 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:28.716688    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-9959d7b-5fm5d" podUID="47045f93-b0db-45f5-801e-6e524c7da5cf"
Jul 24 13:49:29.037058 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:29.036979    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:49:29.037225 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:29.036987    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:49:29.037225 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:29.036987    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:49:29.046762 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:29.046725    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:29.046812 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:29.046779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:29.046884 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:29.046866    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:29.046926 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:29.046914    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 13:49:29.046963 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:29.046942    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls podName:083c3a90-e6e7-4e19-9373-025836eed01a nodeName:}" failed. No retries permitted until 2026-07-24 13:49:33.046925523 +0000 UTC m=+281.282276866 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lbwkg" (UID: "083c3a90-e6e7-4e19-9373-025836eed01a") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:29.046963 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:29.046958    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm podName:083c3a90-e6e7-4e19-9373-025836eed01a nodeName:}" failed. No retries permitted until 2026-07-24 13:49:33.046947814 +0000 UTC m=+281.282299155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lbwkg" (UID: "083c3a90-e6e7-4e19-9373-025836eed01a") : configmap "kube-rbac-proxy" not found
Jul 24 13:49:29.129634 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:29.129609    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x7w45_97d637b1-98c3-4f98-9555-08a28bcf744e/serve-healthcheck-canary/0.log"
Jul 24 13:49:29.496712 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:29.496671    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:29.497097 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:29.496734    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:29.497097 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:29.497052    2565 scope.go:117] "RemoveContainer" containerID="22944bbbacd80c7a42c01571858ee0f6e79f396e99bfa073000406c7d436cb1e"
Jul 24 13:49:29.497235 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:29.497216    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-tpj42_openshift-console-operator(0f6021e5-db06-4a65-9008-8515a852ba0f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42" podUID="0f6021e5-db06-4a65-9008-8515a852ba0f"
Jul 24 13:49:32.073393 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:32.073354    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls\") pod \"image-registry-9959d7b-5fm5d\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") " pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:49:32.073787 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:32.073422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:49:32.073787 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:32.073522    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:49:32.073787 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:32.073540    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9959d7b-5fm5d: secret "image-registry-tls" not found
Jul 24 13:49:32.073787 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:32.073559    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 13:49:32.073787 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:32.073595    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls podName:47045f93-b0db-45f5-801e-6e524c7da5cf nodeName:}" failed. No retries permitted until 2026-07-24 13:51:34.07357935 +0000 UTC m=+402.308930690 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls") pod "image-registry-9959d7b-5fm5d" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf") : secret "image-registry-tls" not found
Jul 24 13:49:32.073787 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:32.073609    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert podName:f1fcef7a-6518-4fc3-89c0-201e2d08b506 nodeName:}" failed. No retries permitted until 2026-07-24 13:51:34.073603483 +0000 UTC m=+402.308954822 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mm49r" (UID: "f1fcef7a-6518-4fc3-89c0-201e2d08b506") : secret "networking-console-plugin-cert" not found
Jul 24 13:49:32.174867 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:32.174832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:49:32.175012 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:32.174983    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:49:32.175080 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:32.175054    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls podName:8c85b14b-79da-476c-b403-dcf9a30fa473 nodeName:}" failed. No retries permitted until 2026-07-24 13:51:34.175031982 +0000 UTC m=+402.410383323 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls") pod "dns-default-qgfbv" (UID: "8c85b14b-79da-476c-b403-dcf9a30fa473") : secret "dns-default-metrics-tls" not found
Jul 24 13:49:33.084193 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:33.084131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:33.084572 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:33.084207    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:33.084572 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:33.084293    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 13:49:33.084572 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:33.084293    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:33.084572 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:33.084354    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls podName:083c3a90-e6e7-4e19-9373-025836eed01a nodeName:}" failed. No retries permitted until 2026-07-24 13:49:41.084338117 +0000 UTC m=+289.319689457 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lbwkg" (UID: "083c3a90-e6e7-4e19-9373-025836eed01a") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:33.084572 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:33.084367    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm podName:083c3a90-e6e7-4e19-9373-025836eed01a nodeName:}" failed. No retries permitted until 2026-07-24 13:49:41.084361298 +0000 UTC m=+289.319712638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lbwkg" (UID: "083c3a90-e6e7-4e19-9373-025836eed01a") : configmap "kube-rbac-proxy" not found
Jul 24 13:49:35.103154 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:35.103110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:35.103154 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:35.103156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:35.103784 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:35.103297    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle podName:419e2dcc-9848-46b9-a353-00ff6d78be07 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:51.103276855 +0000 UTC m=+299.338628219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle") pod "router-default-7c6777bc7-kmtdh" (UID: "419e2dcc-9848-46b9-a353-00ff6d78be07") : configmap references non-existent config key: service-ca.crt
Jul 24 13:49:35.103784 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:35.103291    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 13:49:35.103784 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:35.103370    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs podName:419e2dcc-9848-46b9-a353-00ff6d78be07 nodeName:}" failed. No retries permitted until 2026-07-24 13:49:51.103351542 +0000 UTC m=+299.338702901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs") pod "router-default-7c6777bc7-kmtdh" (UID: "419e2dcc-9848-46b9-a353-00ff6d78be07") : secret "router-metrics-certs-default" not found
Jul 24 13:49:41.149851 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:41.149813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:41.150270 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:41.149864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:41.150270 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:41.149968    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:41.150270 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:41.150034    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls podName:083c3a90-e6e7-4e19-9373-025836eed01a nodeName:}" failed. No retries permitted until 2026-07-24 13:49:57.150017127 +0000 UTC m=+305.385368468 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lbwkg" (UID: "083c3a90-e6e7-4e19-9373-025836eed01a") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:49:41.150384 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:41.150367    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/083c3a90-e6e7-4e19-9373-025836eed01a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:42.190585 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:42.190538    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l7qzc" podUID="6ec1c31e-6c92-4f1d-a9e3-0228915d6893"
Jul 24 13:49:44.189355 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:44.189325    2565 scope.go:117] "RemoveContainer" containerID="22944bbbacd80c7a42c01571858ee0f6e79f396e99bfa073000406c7d436cb1e"
Jul 24 13:49:45.084700 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:45.084666    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 13:49:45.085083 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:45.085066    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/1.log"
Jul 24 13:49:45.085141 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:45.085106    2565 generic.go:356] "Generic (PLEG): container finished" podID="0f6021e5-db06-4a65-9008-8515a852ba0f" containerID="7f38227cd2a455727bf001f53ef742acb8043299e2aa6e693ae0858b62a7245f" exitCode=255
Jul 24 13:49:45.085141 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:45.085134    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42" event={"ID":"0f6021e5-db06-4a65-9008-8515a852ba0f","Type":"ContainerDied","Data":"7f38227cd2a455727bf001f53ef742acb8043299e2aa6e693ae0858b62a7245f"}
Jul 24 13:49:45.085235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:45.085206    2565 scope.go:117] "RemoveContainer" containerID="22944bbbacd80c7a42c01571858ee0f6e79f396e99bfa073000406c7d436cb1e"
Jul 24 13:49:45.085519 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:45.085498    2565 scope.go:117] "RemoveContainer" containerID="7f38227cd2a455727bf001f53ef742acb8043299e2aa6e693ae0858b62a7245f"
Jul 24 13:49:45.085724 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:45.085700    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-tpj42_openshift-console-operator(0f6021e5-db06-4a65-9008-8515a852ba0f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42" podUID="0f6021e5-db06-4a65-9008-8515a852ba0f"
Jul 24 13:49:46.090168 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:46.090142    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 13:49:49.496302 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:49.496251    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:49.496692 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:49.496324    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:49:49.496692 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:49.496628    2565 scope.go:117] "RemoveContainer" containerID="7f38227cd2a455727bf001f53ef742acb8043299e2aa6e693ae0858b62a7245f"
Jul 24 13:49:49.496805 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:49:49.496772    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-tpj42_openshift-console-operator(0f6021e5-db06-4a65-9008-8515a852ba0f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42" podUID="0f6021e5-db06-4a65-9008-8515a852ba0f"
Jul 24 13:49:51.128425 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:51.128384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:51.128425 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:51.128426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:51.129005 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:51.128987    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419e2dcc-9848-46b9-a353-00ff6d78be07-service-ca-bundle\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:51.130803 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:51.130784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419e2dcc-9848-46b9-a353-00ff6d78be07-metrics-certs\") pod \"router-default-7c6777bc7-kmtdh\" (UID: \"419e2dcc-9848-46b9-a353-00ff6d78be07\") " pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:51.417122 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:51.417023    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:51.545856 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:51.545832    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c6777bc7-kmtdh"]
Jul 24 13:49:51.548145 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:49:51.548119    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419e2dcc_9848_46b9_a353_00ff6d78be07.slice/crio-ca48b33a36f0489a7a48e75298112784617a8bb94b44b84966c993b44ee6a512 WatchSource:0}: Error finding container ca48b33a36f0489a7a48e75298112784617a8bb94b44b84966c993b44ee6a512: Status 404 returned error can't find the container with id ca48b33a36f0489a7a48e75298112784617a8bb94b44b84966c993b44ee6a512
Jul 24 13:49:52.093513 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:52.093487    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 13:49:52.095621 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:52.095589    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 13:49:52.105469 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:52.105445    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 13:49:52.108029 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:52.107995    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c6777bc7-kmtdh" event={"ID":"419e2dcc-9848-46b9-a353-00ff6d78be07","Type":"ContainerStarted","Data":"781d35b3e2039ac4745bc750edbd92bee1f74d9a9d5e941261ca470804fe8862"}
Jul 24 13:49:52.108198 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:52.108088    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c6777bc7-kmtdh" event={"ID":"419e2dcc-9848-46b9-a353-00ff6d78be07","Type":"ContainerStarted","Data":"ca48b33a36f0489a7a48e75298112784617a8bb94b44b84966c993b44ee6a512"}
Jul 24 13:49:52.130878 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:52.130825    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7c6777bc7-kmtdh" podStartSLOduration=33.130810151 podStartE2EDuration="33.130810151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:49:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:49:52.129775134 +0000 UTC m=+300.365126496" watchObservedRunningTime="2026-07-24 13:49:52.130810151 +0000 UTC m=+300.366161513"
Jul 24 13:49:52.417480 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:52.417389    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:52.420062 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:52.420040    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:53.110995 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:53.110968    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:53.112268 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:53.112248    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c6777bc7-kmtdh"
Jul 24 13:49:53.696452 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:53.696418    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-wzk5d"]
Jul 24 13:49:53.699389 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:53.699369    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-wzk5d"
Jul 24 13:49:53.701749 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:53.701723    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 24 13:49:53.701851 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:53.701806    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-v6b44\""
Jul 24 13:49:53.709385 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:53.709362    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-wzk5d"]
Jul 24 13:49:53.749524 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:53.749482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/648b234f-3b14-412a-86a6-c53eae54e36f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-wzk5d\" (UID: \"648b234f-3b14-412a-86a6-c53eae54e36f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-wzk5d"
Jul 24 13:49:53.850735 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:53.850691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/648b234f-3b14-412a-86a6-c53eae54e36f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-wzk5d\" (UID: \"648b234f-3b14-412a-86a6-c53eae54e36f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-wzk5d"
Jul 24 13:49:53.853351 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:53.853325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/648b234f-3b14-412a-86a6-c53eae54e36f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-wzk5d\" (UID: \"648b234f-3b14-412a-86a6-c53eae54e36f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-wzk5d"
Jul 24 13:49:54.007995 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:54.007889    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-wzk5d"
Jul 24 13:49:54.135742 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:54.135716    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-wzk5d"]
Jul 24 13:49:54.138027 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:49:54.138001    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648b234f_3b14_412a_86a6_c53eae54e36f.slice/crio-90c6fc6590dcc4d29f42510532ec5e5e902cb1d866ff32a389eb964c371ae461 WatchSource:0}: Error finding container 90c6fc6590dcc4d29f42510532ec5e5e902cb1d866ff32a389eb964c371ae461: Status 404 returned error can't find the container with id 90c6fc6590dcc4d29f42510532ec5e5e902cb1d866ff32a389eb964c371ae461
Jul 24 13:49:54.140492 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:54.140475    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 13:49:55.121569 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:55.121532    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-wzk5d" event={"ID":"648b234f-3b14-412a-86a6-c53eae54e36f","Type":"ContainerStarted","Data":"90c6fc6590dcc4d29f42510532ec5e5e902cb1d866ff32a389eb964c371ae461"}
Jul 24 13:49:56.125724 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.125686    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-wzk5d" event={"ID":"648b234f-3b14-412a-86a6-c53eae54e36f","Type":"ContainerStarted","Data":"dc87ba70aa3243e397be96697b616b9ac48d1815d446b71b309ed70d2d42d6ca"}
Jul 24 13:49:56.126118 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.125875    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-wzk5d"
Jul 24 13:49:56.130484 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.130460    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-wzk5d"
Jul 24 13:49:56.145982 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.145933    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-wzk5d" podStartSLOduration=2.040646338 podStartE2EDuration="3.14591597s" totalImagesPullingTime="1.105269632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:49:56.145053584 +0000 UTC m=+304.380404949" watchObservedRunningTime="2026-07-24 13:49:56.14591597 +0000 UTC m=+304.381267331"
Jul 24 13:49:56.775010 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.774973    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"]
Jul 24 13:49:56.778351 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.778335    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"
Jul 24 13:49:56.780900 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.780874    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 13:49:56.781031 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.780900    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 24 13:49:56.781742 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.781721    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 24 13:49:56.781821 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.781749    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 13:49:56.781945 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.781926    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 13:49:56.782013 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.782000    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fppxd\""
Jul 24 13:49:56.786383 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.786362    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"]
Jul 24 13:49:56.878037 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.877999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d91672-602e-4979-b9a4-73af74fa8820-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-v7dnp\" (UID: \"27d91672-602e-4979-b9a4-73af74fa8820\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"
Jul 24 13:49:56.878285 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.878070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/27d91672-602e-4979-b9a4-73af74fa8820-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-v7dnp\" (UID: \"27d91672-602e-4979-b9a4-73af74fa8820\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"
Jul 24 13:49:56.878285 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.878160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27d91672-602e-4979-b9a4-73af74fa8820-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-v7dnp\" (UID: \"27d91672-602e-4979-b9a4-73af74fa8820\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"
Jul 24 13:49:56.878413 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.878287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w2vx\" (UniqueName: \"kubernetes.io/projected/27d91672-602e-4979-b9a4-73af74fa8820-kube-api-access-4w2vx\") pod \"prometheus-operator-84d69f794d-v7dnp\" (UID: \"27d91672-602e-4979-b9a4-73af74fa8820\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"
Jul 24 13:49:56.979640 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.979603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/27d91672-602e-4979-b9a4-73af74fa8820-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-v7dnp\" (UID: \"27d91672-602e-4979-b9a4-73af74fa8820\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"
Jul 24 13:49:56.979640 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.979647    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27d91672-602e-4979-b9a4-73af74fa8820-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-v7dnp\" (UID: \"27d91672-602e-4979-b9a4-73af74fa8820\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"
Jul 24 13:49:56.979851 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.979708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w2vx\" (UniqueName: \"kubernetes.io/projected/27d91672-602e-4979-b9a4-73af74fa8820-kube-api-access-4w2vx\") pod \"prometheus-operator-84d69f794d-v7dnp\" (UID: \"27d91672-602e-4979-b9a4-73af74fa8820\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"
Jul 24 13:49:56.979937 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.979918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d91672-602e-4979-b9a4-73af74fa8820-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-v7dnp\" (UID: \"27d91672-602e-4979-b9a4-73af74fa8820\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"
Jul 24 13:49:56.980526 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.980506    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d91672-602e-4979-b9a4-73af74fa8820-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-v7dnp\" (UID: \"27d91672-602e-4979-b9a4-73af74fa8820\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"
Jul 24 13:49:56.982185 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.982138    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27d91672-602e-4979-b9a4-73af74fa8820-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-v7dnp\" (UID: \"27d91672-602e-4979-b9a4-73af74fa8820\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"
Jul 24 13:49:56.982281 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.982251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/27d91672-602e-4979-b9a4-73af74fa8820-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-v7dnp\" (UID: \"27d91672-602e-4979-b9a4-73af74fa8820\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"
Jul 24 13:49:56.988828 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:56.988799    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w2vx\" (UniqueName: \"kubernetes.io/projected/27d91672-602e-4979-b9a4-73af74fa8820-kube-api-access-4w2vx\") pod \"prometheus-operator-84d69f794d-v7dnp\" (UID: \"27d91672-602e-4979-b9a4-73af74fa8820\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"
Jul 24 13:49:57.088301 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:57.088267    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"
Jul 24 13:49:57.181735 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:57.181701    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:57.184313 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:57.184287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/083c3a90-e6e7-4e19-9373-025836eed01a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lbwkg\" (UID: \"083c3a90-e6e7-4e19-9373-025836eed01a\") " pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:57.189849 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:57.189821    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:49:57.219956 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:57.219925    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-v7dnp"]
Jul 24 13:49:57.222918 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:49:57.222891    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d91672_602e_4979_b9a4_73af74fa8820.slice/crio-1ad481887b5a176682226a1c0e911484712b6555716a3bd10cfb6ab9e53f17a3 WatchSource:0}: Error finding container 1ad481887b5a176682226a1c0e911484712b6555716a3bd10cfb6ab9e53f17a3: Status 404 returned error can't find the container with id 1ad481887b5a176682226a1c0e911484712b6555716a3bd10cfb6ab9e53f17a3
Jul 24 13:49:57.453079 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:57.452992    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dqt9s\""
Jul 24 13:49:57.461141 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:57.461114    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lbwkg"
Jul 24 13:49:57.596362 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:57.596326    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lbwkg"]
Jul 24 13:49:57.599723 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:49:57.599696    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083c3a90_e6e7_4e19_9373_025836eed01a.slice/crio-b008f53c10662e18329ee1300ef23a9d58f41f918b9ef13b0aeb569a60b76f6f WatchSource:0}: Error finding container b008f53c10662e18329ee1300ef23a9d58f41f918b9ef13b0aeb569a60b76f6f: Status 404 returned error can't find the container with id b008f53c10662e18329ee1300ef23a9d58f41f918b9ef13b0aeb569a60b76f6f
Jul 24 13:49:58.135710 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:58.135587    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lbwkg" event={"ID":"083c3a90-e6e7-4e19-9373-025836eed01a","Type":"ContainerStarted","Data":"b008f53c10662e18329ee1300ef23a9d58f41f918b9ef13b0aeb569a60b76f6f"}
Jul 24 13:49:58.137931 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:58.137483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp" event={"ID":"27d91672-602e-4979-b9a4-73af74fa8820","Type":"ContainerStarted","Data":"1ad481887b5a176682226a1c0e911484712b6555716a3bd10cfb6ab9e53f17a3"}
Jul 24 13:49:59.143774 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:59.143735    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp" event={"ID":"27d91672-602e-4979-b9a4-73af74fa8820","Type":"ContainerStarted","Data":"cee8163e4d39f2768199d22382877acd208e717bdb9ec7caca3fc771edcab792"}
Jul 24 13:49:59.144243 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:59.143811    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp" event={"ID":"27d91672-602e-4979-b9a4-73af74fa8820","Type":"ContainerStarted","Data":"7b7cdcdb25b82b4568ce5314788b0377182bf61b86a7d965a1539c3dc35f64f2"}
Jul 24 13:49:59.164263 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:49:59.164206    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-v7dnp" podStartSLOduration=1.728805556 podStartE2EDuration="3.164165917s" totalImagesPullingTime="1.435360361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:49:59.163591411 +0000 UTC m=+307.398942774" watchObservedRunningTime="2026-07-24 13:49:59.164165917 +0000 UTC m=+307.399517281"
Jul 24 13:50:01.149637 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.149604    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"]
Jul 24 13:50:01.173450 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.173418    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"]
Jul 24 13:50:01.173623 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.173507    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:01.176604 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.176564    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 24 13:50:01.177609 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.177528    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 24 13:50:01.177609 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.177541    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bnclx\""
Jul 24 13:50:01.180751 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.179571    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"]
Jul 24 13:50:01.186503 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.186480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.189116 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.189093    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 24 13:50:01.189335 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.189306    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 24 13:50:01.189477 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.189306    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 24 13:50:01.189477 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.189450    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qckh9\""
Jul 24 13:50:01.198079 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.198056    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"]
Jul 24 13:50:01.215155 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.215123    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fb6fn"]
Jul 24 13:50:01.218839 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.218817    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.221663 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.221630    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 13:50:01.222229 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.222211    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 13:50:01.222345 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.222285    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dgt7z\""
Jul 24 13:50:01.223007 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.222985    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 13:50:01.223106 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.222994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-lrsnt\" (UID: \"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:01.223242 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.223225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-lrsnt\" (UID: \"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:01.223369 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.223349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-lrsnt\" (UID: \"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:01.223538 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.223512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwb84\" (UniqueName: \"kubernetes.io/projected/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-kube-api-access-pwb84\") pod \"openshift-state-metrics-b8f49f5c6-lrsnt\" (UID: \"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:01.324334 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324304    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-lrsnt\" (UID: \"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:01.324334 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-wtmp\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.324570 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-lrsnt\" (UID: \"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:01.324570 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-accelerators-collector-config\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.324570 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.324570 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bf52\" (UniqueName: \"kubernetes.io/projected/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-api-access-2bf52\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.324765 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.324765 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324617    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwb84\" (UniqueName: \"kubernetes.io/projected/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-kube-api-access-pwb84\") pod \"openshift-state-metrics-b8f49f5c6-lrsnt\" (UID: \"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:01.324765 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-tls\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.324765 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6psr6\" (UniqueName: \"kubernetes.io/projected/a1b01660-8f01-48b8-b204-596da3d8c289-kube-api-access-6psr6\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.324765 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1b01660-8f01-48b8-b204-596da3d8c289-sys\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.325062 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-lrsnt\" (UID: \"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:01.325062 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd0443ae-eb84-4f00-b367-10c51e5813fe-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.325062 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd0443ae-eb84-4f00-b367-10c51e5813fe-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.325062 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.324954    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1b01660-8f01-48b8-b204-596da3d8c289-root\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.325062 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:50:01.324967    2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 24 13:50:01.325062 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.325007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1b01660-8f01-48b8-b204-596da3d8c289-metrics-client-ca\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.325062 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:50:01.325031    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-openshift-state-metrics-tls podName:d53546a5-4dd7-4f90-83af-fe0dbc6aeae7 nodeName:}" failed. No retries permitted until 2026-07-24 13:50:01.825013864 +0000 UTC m=+310.060365207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-lrsnt" (UID: "d53546a5-4dd7-4f90-83af-fe0dbc6aeae7") : secret "openshift-state-metrics-tls" not found
Jul 24 13:50:01.325062 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.325060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.325647 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.325083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.325647 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.325088    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-lrsnt\" (UID: \"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:01.325647 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.325112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-textfile\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.327460 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.327437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-lrsnt\" (UID: \"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:01.336350 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.336324    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwb84\" (UniqueName: \"kubernetes.io/projected/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-kube-api-access-pwb84\") pod \"openshift-state-metrics-b8f49f5c6-lrsnt\" (UID: \"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:01.425825 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.425733    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1b01660-8f01-48b8-b204-596da3d8c289-metrics-client-ca\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.425825 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.425770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.425825 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.425796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.426104 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:50:01.425906    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 24 13:50:01.426104 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.425953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-textfile\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.426104 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:50:01.425984    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-state-metrics-tls podName:fd0443ae-eb84-4f00-b367-10c51e5813fe nodeName:}" failed. No retries permitted until 2026-07-24 13:50:01.92596217 +0000 UTC m=+310.161313510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-c65s8" (UID: "fd0443ae-eb84-4f00-b367-10c51e5813fe") : secret "kube-state-metrics-tls" not found
Jul 24 13:50:01.426104 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-wtmp\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.426104 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426060    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-accelerators-collector-config\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.426104 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.426437 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bf52\" (UniqueName: \"kubernetes.io/projected/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-api-access-2bf52\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.426437 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.426437 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426222    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-textfile\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.426437 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-tls\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.426437 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426304    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6psr6\" (UniqueName: \"kubernetes.io/projected/a1b01660-8f01-48b8-b204-596da3d8c289-kube-api-access-6psr6\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.426437 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1b01660-8f01-48b8-b204-596da3d8c289-sys\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.426437 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1b01660-8f01-48b8-b204-596da3d8c289-metrics-client-ca\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.426774 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd0443ae-eb84-4f00-b367-10c51e5813fe-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.426774 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd0443ae-eb84-4f00-b367-10c51e5813fe-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.426774 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1b01660-8f01-48b8-b204-596da3d8c289-root\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.426774 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426620    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1b01660-8f01-48b8-b204-596da3d8c289-root\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.426774 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-wtmp\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.426774 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-accelerators-collector-config\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.427068 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:50:01.426775    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 13:50:01.427068 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:50:01.426830    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-tls podName:a1b01660-8f01-48b8-b204-596da3d8c289 nodeName:}" failed. No retries permitted until 2026-07-24 13:50:01.926810971 +0000 UTC m=+310.162162311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-tls") pod "node-exporter-fb6fn" (UID: "a1b01660-8f01-48b8-b204-596da3d8c289") : secret "node-exporter-tls" not found
Jul 24 13:50:01.427068 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426897    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd0443ae-eb84-4f00-b367-10c51e5813fe-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.427068 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.426954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1b01660-8f01-48b8-b204-596da3d8c289-sys\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.427359 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.427338    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd0443ae-eb84-4f00-b367-10c51e5813fe-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.427450 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.427423    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.428951 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.428928    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.429329 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.429307    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.437195 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.437137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6psr6\" (UniqueName: \"kubernetes.io/projected/a1b01660-8f01-48b8-b204-596da3d8c289-kube-api-access-6psr6\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.437329 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.437309    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bf52\" (UniqueName: \"kubernetes.io/projected/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-api-access-2bf52\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.830491 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.830459    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-lrsnt\" (UID: \"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:01.832939 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.832919    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d53546a5-4dd7-4f90-83af-fe0dbc6aeae7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-lrsnt\" (UID: \"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:01.931587 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.931550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-tls\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.931730 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.931626    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:01.934218 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.934188    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1b01660-8f01-48b8-b204-596da3d8c289-node-exporter-tls\") pod \"node-exporter-fb6fn\" (UID: \"a1b01660-8f01-48b8-b204-596da3d8c289\") " pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:01.934382 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:01.934250    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd0443ae-eb84-4f00-b367-10c51e5813fe-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-c65s8\" (UID: \"fd0443ae-eb84-4f00-b367-10c51e5813fe\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:02.086828 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:02.086697    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"
Jul 24 13:50:02.096710 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:02.096672    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"
Jul 24 13:50:02.128954 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:02.128921    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fb6fn"
Jul 24 13:50:02.573581 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:50:02.573552    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b01660_8f01_48b8_b204_596da3d8c289.slice/crio-92eaf32b815523e9c8d6e097377807e82b23cc305f1ee7cbe8f7d1caf87bec70 WatchSource:0}: Error finding container 92eaf32b815523e9c8d6e097377807e82b23cc305f1ee7cbe8f7d1caf87bec70: Status 404 returned error can't find the container with id 92eaf32b815523e9c8d6e097377807e82b23cc305f1ee7cbe8f7d1caf87bec70
Jul 24 13:50:02.714497 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:02.714468    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8"]
Jul 24 13:50:02.717212 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:50:02.717166    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd0443ae_eb84_4f00_b367_10c51e5813fe.slice/crio-f73522894530e722ebe20396c8322fa39ce8c623b79fb542b2cb0592590c44ce WatchSource:0}: Error finding container f73522894530e722ebe20396c8322fa39ce8c623b79fb542b2cb0592590c44ce: Status 404 returned error can't find the container with id f73522894530e722ebe20396c8322fa39ce8c623b79fb542b2cb0592590c44ce
Jul 24 13:50:02.727515 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:02.727486    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt"]
Jul 24 13:50:02.729282 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:50:02.729249    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53546a5_4dd7_4f90_83af_fe0dbc6aeae7.slice/crio-af609192c74a7ff324c50951432247cc7941a70ba8e93e5782daf4ccecb5da18 WatchSource:0}: Error finding container af609192c74a7ff324c50951432247cc7941a70ba8e93e5782daf4ccecb5da18: Status 404 returned error can't find the container with id af609192c74a7ff324c50951432247cc7941a70ba8e93e5782daf4ccecb5da18
Jul 24 13:50:03.164605 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:03.164505    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8" event={"ID":"fd0443ae-eb84-4f00-b367-10c51e5813fe","Type":"ContainerStarted","Data":"f73522894530e722ebe20396c8322fa39ce8c623b79fb542b2cb0592590c44ce"}
Jul 24 13:50:03.168885 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:03.168853    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt" event={"ID":"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7","Type":"ContainerStarted","Data":"c631b0c4f457bbb1dfc0834e39379d8f58571c6938f2a50fdebea956f4c6066b"}
Jul 24 13:50:03.169065 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:03.168914    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt" event={"ID":"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7","Type":"ContainerStarted","Data":"86b468f8780b5775d0acc575325b8c3cf64d4bbff0974c2cb867680d90187478"}
Jul 24 13:50:03.169065 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:03.168940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt" event={"ID":"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7","Type":"ContainerStarted","Data":"af609192c74a7ff324c50951432247cc7941a70ba8e93e5782daf4ccecb5da18"}
Jul 24 13:50:03.170494 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:03.170470    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lbwkg" event={"ID":"083c3a90-e6e7-4e19-9373-025836eed01a","Type":"ContainerStarted","Data":"d246332da3513414a90f61e2fd44644dbb2c2c8dba2e4b9dc385203568632343"}
Jul 24 13:50:03.171483 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:03.171463    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fb6fn" event={"ID":"a1b01660-8f01-48b8-b204-596da3d8c289","Type":"ContainerStarted","Data":"92eaf32b815523e9c8d6e097377807e82b23cc305f1ee7cbe8f7d1caf87bec70"}
Jul 24 13:50:03.190032 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:03.189999    2565 scope.go:117] "RemoveContainer" containerID="7f38227cd2a455727bf001f53ef742acb8043299e2aa6e693ae0858b62a7245f"
Jul 24 13:50:03.190268 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:50:03.190245    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-tpj42_openshift-console-operator(0f6021e5-db06-4a65-9008-8515a852ba0f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42" podUID="0f6021e5-db06-4a65-9008-8515a852ba0f"
Jul 24 13:50:05.185904 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:05.185866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fb6fn" event={"ID":"a1b01660-8f01-48b8-b204-596da3d8c289","Type":"ContainerStarted","Data":"959159fe0394f6ab4ddcbc00b0df31551fcde8dc8f78940b0ca41ed6297120ac"}
Jul 24 13:50:05.187851 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:05.187815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8" event={"ID":"fd0443ae-eb84-4f00-b367-10c51e5813fe","Type":"ContainerStarted","Data":"1c405c9fbaed8ae17ae5c679f410e23e2268a717efec5a24ce0f49a5f307566c"}
Jul 24 13:50:05.190119 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:05.190087    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt" event={"ID":"d53546a5-4dd7-4f90-83af-fe0dbc6aeae7","Type":"ContainerStarted","Data":"c91b2fe1b16ce182d6142b5082692faaa232b0615d276f94d445b362cd2f8403"}
Jul 24 13:50:05.223361 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:05.223310    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lrsnt" podStartSLOduration=2.386053101 podStartE2EDuration="4.223291421s" totalImagesPullingTime="1.83723832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:05.221833487 +0000 UTC m=+313.457184849" watchObservedRunningTime="2026-07-24 13:50:05.223291421 +0000 UTC m=+313.458642782"
Jul 24 13:50:05.918638 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:05.918600    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2"]
Jul 24 13:50:05.942827 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:05.942792    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2"]
Jul 24 13:50:05.943011 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:05.942915    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2"
Jul 24 13:50:05.946041 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:05.946008    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 24 13:50:05.946213 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:05.946072    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-z5xs5\""
Jul 24 13:50:06.075589 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:06.075544    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf4k8\" (UniqueName: \"kubernetes.io/projected/d62201f7-3c1b-4400-83c0-28878f34dcf5-kube-api-access-zf4k8\") pod \"monitoring-plugin-68b7fc9574-slpb2\" (UID: \"d62201f7-3c1b-4400-83c0-28878f34dcf5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2"
Jul 24 13:50:06.075925 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:06.075879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d62201f7-3c1b-4400-83c0-28878f34dcf5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-slpb2\" (UID: \"d62201f7-3c1b-4400-83c0-28878f34dcf5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2"
Jul 24 13:50:06.176967 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:06.176889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf4k8\" (UniqueName: \"kubernetes.io/projected/d62201f7-3c1b-4400-83c0-28878f34dcf5-kube-api-access-zf4k8\") pod \"monitoring-plugin-68b7fc9574-slpb2\" (UID: \"d62201f7-3c1b-4400-83c0-28878f34dcf5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2"
Jul 24 13:50:06.177232 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:06.177016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d62201f7-3c1b-4400-83c0-28878f34dcf5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-slpb2\" (UID: \"d62201f7-3c1b-4400-83c0-28878f34dcf5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2"
Jul 24 13:50:06.177232 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:50:06.177216    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 24 13:50:06.177344 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:50:06.177301    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62201f7-3c1b-4400-83c0-28878f34dcf5-monitoring-plugin-cert podName:d62201f7-3c1b-4400-83c0-28878f34dcf5 nodeName:}" failed. No retries permitted until 2026-07-24 13:50:06.677278004 +0000 UTC m=+314.912629350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d62201f7-3c1b-4400-83c0-28878f34dcf5-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-slpb2" (UID: "d62201f7-3c1b-4400-83c0-28878f34dcf5") : secret "monitoring-plugin-cert" not found
Jul 24 13:50:06.186207 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:06.186125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf4k8\" (UniqueName: \"kubernetes.io/projected/d62201f7-3c1b-4400-83c0-28878f34dcf5-kube-api-access-zf4k8\") pod \"monitoring-plugin-68b7fc9574-slpb2\" (UID: \"d62201f7-3c1b-4400-83c0-28878f34dcf5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2"
Jul 24 13:50:06.200069 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:06.200031    2565 generic.go:356] "Generic (PLEG): container finished" podID="a1b01660-8f01-48b8-b204-596da3d8c289" containerID="959159fe0394f6ab4ddcbc00b0df31551fcde8dc8f78940b0ca41ed6297120ac" exitCode=0
Jul 24 13:50:06.200288 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:06.200258    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fb6fn" event={"ID":"a1b01660-8f01-48b8-b204-596da3d8c289","Type":"ContainerDied","Data":"959159fe0394f6ab4ddcbc00b0df31551fcde8dc8f78940b0ca41ed6297120ac"}
Jul 24 13:50:06.682781 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:06.682742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d62201f7-3c1b-4400-83c0-28878f34dcf5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-slpb2\" (UID: \"d62201f7-3c1b-4400-83c0-28878f34dcf5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2"
Jul 24 13:50:06.685238 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:06.685211    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d62201f7-3c1b-4400-83c0-28878f34dcf5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-slpb2\" (UID: \"d62201f7-3c1b-4400-83c0-28878f34dcf5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2"
Jul 24 13:50:06.853344 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:06.853144    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2"
Jul 24 13:50:06.997285 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:06.997075    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2"]
Jul 24 13:50:06.999809 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:50:06.999782    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62201f7_3c1b_4400_83c0_28878f34dcf5.slice/crio-470375208c0ad746d33e6b257207d4a0919e6be3b489a00046d0c954d847fe15 WatchSource:0}: Error finding container 470375208c0ad746d33e6b257207d4a0919e6be3b489a00046d0c954d847fe15: Status 404 returned error can't find the container with id 470375208c0ad746d33e6b257207d4a0919e6be3b489a00046d0c954d847fe15
Jul 24 13:50:07.206681 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.206591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2" event={"ID":"d62201f7-3c1b-4400-83c0-28878f34dcf5","Type":"ContainerStarted","Data":"470375208c0ad746d33e6b257207d4a0919e6be3b489a00046d0c954d847fe15"}
Jul 24 13:50:07.208471 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.208443    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lbwkg" event={"ID":"083c3a90-e6e7-4e19-9373-025836eed01a","Type":"ContainerStarted","Data":"c2577823aba9160a6a46e7822002ad25bed067cfb2bdf0b0cc21216bd590c33c"}
Jul 24 13:50:07.210394 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.210368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fb6fn" event={"ID":"a1b01660-8f01-48b8-b204-596da3d8c289","Type":"ContainerStarted","Data":"c7b1cafcaa01b287c5c35b987c7277e054011730e0f42890cf7220769e7f3314"}
Jul 24 13:50:07.210510 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.210416    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fb6fn" event={"ID":"a1b01660-8f01-48b8-b204-596da3d8c289","Type":"ContainerStarted","Data":"32fc58cb3c494d466c7010bd3a41f9da8a12847e0e72e8acf556fb8dcbbc6df4"}
Jul 24 13:50:07.213226 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.212559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8" event={"ID":"fd0443ae-eb84-4f00-b367-10c51e5813fe","Type":"ContainerStarted","Data":"2c6a35c4bb8e65dc7cab6ab865da59abf41cb33eb22a2c74202ac88d5ab44067"}
Jul 24 13:50:07.213226 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.212614    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8" event={"ID":"fd0443ae-eb84-4f00-b367-10c51e5813fe","Type":"ContainerStarted","Data":"fc42d9c1e8d1f19857117c38ba3b2113935ca0bc95850732aedab7d0eae31b60"}
Jul 24 13:50:07.231350 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.231291    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fb6fn" podStartSLOduration=4.022983793 podStartE2EDuration="6.231269984s" totalImagesPullingTime="2.107910563s" totalInitContainerRuntime="100.375628ms" isStatefulPod=true podCreationTimestamp="2026-07-24 13:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:07.229627936 +0000 UTC m=+315.464979316" watchObservedRunningTime="2026-07-24 13:50:07.231269984 +0000 UTC m=+315.466621347"
Jul 24 13:50:07.253822 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.253137    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c65s8" podStartSLOduration=4.28508466 podStartE2EDuration="6.253114006s" totalImagesPullingTime="1.968029346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:07.252631169 +0000 UTC m=+315.487982533" watchObservedRunningTime="2026-07-24 13:50:07.253114006 +0000 UTC m=+315.488465367"
Jul 24 13:50:07.362026 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.361984    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:50:07.366788 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.366757    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.370806 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.370763    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 13:50:07.370976 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.370829    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 13:50:07.371276 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.371251    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 13:50:07.371276 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.371270    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 13:50:07.371445 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.371305    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 13:50:07.372801 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.372502    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 13:50:07.372801 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.372537    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 13:50:07.372801 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.372548    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 13:50:07.373020 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.372863    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xsrbr\""
Jul 24 13:50:07.373020 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.372938    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6e5cjb9o2vfob\""
Jul 24 13:50:07.373321 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.373302    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 13:50:07.374588 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.374331    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 13:50:07.376200 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.376033    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 13:50:07.376586 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.376242    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 13:50:07.376586 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.376303    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 13:50:07.376586 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.376365    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 13:50:07.377808 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.377789    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 13:50:07.387498 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.387406    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:50:07.492308 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.492308 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492259    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.492308 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492281    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.492308 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.492648 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.492648 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/353a9de8-ded1-4c45-913f-fa1693cf3197-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.492648 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/353a9de8-ded1-4c45-913f-fa1693cf3197-config-out\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.492648 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.492648 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.492648 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.492648 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492590    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.492648 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.493101 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-web-config\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.493101 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492708    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.493101 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ht2h\" (UniqueName: \"kubernetes.io/projected/353a9de8-ded1-4c45-913f-fa1693cf3197-kube-api-access-4ht2h\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.493101 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.493101 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492815    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.493101 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.493101 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-config\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.493101 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.492921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.594398 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.594362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.594594 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.594414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.594594 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.594440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.594594 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.594486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-web-config\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.594594 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.594523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.594594 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.594544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ht2h\" (UniqueName: \"kubernetes.io/projected/353a9de8-ded1-4c45-913f-fa1693cf3197-kube-api-access-4ht2h\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595142 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595142 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595522 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595522 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595458    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-config\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595522 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595483    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595674 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595674 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595674 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595674 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595674 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595669    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/353a9de8-ded1-4c45-913f-fa1693cf3197-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595725    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595725    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/353a9de8-ded1-4c45-913f-fa1693cf3197-config-out\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.595920 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.595849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.596235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.596214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.597865 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.597722    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.598310 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.598287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.600043 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.598478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-web-config\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.600043 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.598510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.600043 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.599004    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.600043 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.599130    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.600043 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.599669    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.600663 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.600367    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.600663 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.600554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/353a9de8-ded1-4c45-913f-fa1693cf3197-config-out\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.601949 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.601899    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.602394 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.602345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.603310 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.603133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/353a9de8-ded1-4c45-913f-fa1693cf3197-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.603310 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.603267    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.603878 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.603831    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.604846 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.604784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ht2h\" (UniqueName: \"kubernetes.io/projected/353a9de8-ded1-4c45-913f-fa1693cf3197-kube-api-access-4ht2h\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.605277 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.605228    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.605774 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.605720    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.608267 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.608211    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-config\") pod \"prometheus-k8s-0\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.681461 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.681409    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:07.873196 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:07.870834    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:50:07.902833 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:50:07.897107    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod353a9de8_ded1_4c45_913f_fa1693cf3197.slice/crio-a00c85d7269a1996685a485bcb711589c0840d23b2b07394a2da96e823c40949 WatchSource:0}: Error finding container a00c85d7269a1996685a485bcb711589c0840d23b2b07394a2da96e823c40949: Status 404 returned error can't find the container with id a00c85d7269a1996685a485bcb711589c0840d23b2b07394a2da96e823c40949
Jul 24 13:50:08.219937 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:08.219899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerStarted","Data":"a00c85d7269a1996685a485bcb711589c0840d23b2b07394a2da96e823c40949"}
Jul 24 13:50:11.234024 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:11.233936    2565 generic.go:356] "Generic (PLEG): container finished" podID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerID="8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e" exitCode=0
Jul 24 13:50:11.234493 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:11.234028    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerDied","Data":"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"}
Jul 24 13:50:11.235764 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:11.235632    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2" event={"ID":"d62201f7-3c1b-4400-83c0-28878f34dcf5","Type":"ContainerStarted","Data":"c5d86704a6655e4cd56f27bfc3070d1d61c37448a8f79a803a26c56976055a96"}
Jul 24 13:50:11.235837 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:11.235801    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2"
Jul 24 13:50:11.237829 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:11.237805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lbwkg" event={"ID":"083c3a90-e6e7-4e19-9373-025836eed01a","Type":"ContainerStarted","Data":"afd5a734b151a0e0b5f9de6700357bea8cfbe1ec04140651e030d07d19fab214"}
Jul 24 13:50:11.240941 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:11.240923    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2"
Jul 24 13:50:11.292886 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:11.292460    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-slpb2" podStartSLOduration=2.290090044 podStartE2EDuration="6.292438888s" totalImagesPullingTime="4.002348844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:11.292039665 +0000 UTC m=+319.527391028" watchObservedRunningTime="2026-07-24 13:50:11.292438888 +0000 UTC m=+319.527790251"
Jul 24 13:50:11.293078 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:11.292963    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lbwkg" podStartSLOduration=33.010379342 podStartE2EDuration="46.292949857s" totalImagesPullingTime="13.282570515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:49:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:11.278051085 +0000 UTC m=+319.513402457" watchObservedRunningTime="2026-07-24 13:50:11.292949857 +0000 UTC m=+319.528301223"
Jul 24 13:50:15.257946 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:15.257903    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerStarted","Data":"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"}
Jul 24 13:50:15.258345 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:15.257991    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerStarted","Data":"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"}
Jul 24 13:50:16.197364 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:16.197332    2565 scope.go:117] "RemoveContainer" containerID="7f38227cd2a455727bf001f53ef742acb8043299e2aa6e693ae0858b62a7245f"
Jul 24 13:50:17.270678 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:17.270649    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 13:50:17.271126 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:17.270766    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42" event={"ID":"0f6021e5-db06-4a65-9008-8515a852ba0f","Type":"ContainerStarted","Data":"bd845de188c3414b4165705331a4597295077ab227c14508eb68ffa81774e002"}
Jul 24 13:50:17.271126 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:17.271060    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:50:17.274280 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:17.274258    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerStarted","Data":"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"}
Jul 24 13:50:17.274384 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:17.274315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerStarted","Data":"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"}
Jul 24 13:50:17.274384 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:17.274343    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerStarted","Data":"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"}
Jul 24 13:50:17.274384 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:17.274375    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerStarted","Data":"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"}
Jul 24 13:50:17.276422 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:17.276404    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42"
Jul 24 13:50:17.288717 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:17.288674    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-tpj42" podStartSLOduration=54.406163222 podStartE2EDuration="58.288662221s" totalImagesPullingTime="3.882498999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:17.287902319 +0000 UTC m=+325.523253683" watchObservedRunningTime="2026-07-24 13:50:17.288662221 +0000 UTC m=+325.524013583"
Jul 24 13:50:17.315532 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:17.315454    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.271272669 podStartE2EDuration="10.315437239s" totalImagesPullingTime="8.023840054s" totalInitContainerRuntime="20.324516ms" isStatefulPod=false podCreationTimestamp="2026-07-24 13:50:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:17.313823196 +0000 UTC m=+325.549174558" watchObservedRunningTime="2026-07-24 13:50:17.315437239 +0000 UTC m=+325.550788592"
Jul 24 13:50:17.682559 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:17.682518    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:50:19.653255 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:19.653220    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9959d7b-5fm5d"]
Jul 24 13:50:19.654112 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:50:19.654079    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-9959d7b-5fm5d" podUID="47045f93-b0db-45f5-801e-6e524c7da5cf"
Jul 24 13:50:20.286063 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.286029    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:50:20.293705 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.293676    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:50:20.335224 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.335191    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47045f93-b0db-45f5-801e-6e524c7da5cf-ca-trust-extracted\") pod \"47045f93-b0db-45f5-801e-6e524c7da5cf\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") "
Jul 24 13:50:20.335224 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.335227    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-certificates\") pod \"47045f93-b0db-45f5-801e-6e524c7da5cf\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") "
Jul 24 13:50:20.335427 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.335263    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47045f93-b0db-45f5-801e-6e524c7da5cf-installation-pull-secrets\") pod \"47045f93-b0db-45f5-801e-6e524c7da5cf\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") "
Jul 24 13:50:20.335427 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.335320    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47045f93-b0db-45f5-801e-6e524c7da5cf-trusted-ca\") pod \"47045f93-b0db-45f5-801e-6e524c7da5cf\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") "
Jul 24 13:50:20.335427 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.335376    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-bound-sa-token\") pod \"47045f93-b0db-45f5-801e-6e524c7da5cf\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") "
Jul 24 13:50:20.335427 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.335412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zzj9\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-kube-api-access-5zzj9\") pod \"47045f93-b0db-45f5-801e-6e524c7da5cf\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") "
Jul 24 13:50:20.335641 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.335480    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47045f93-b0db-45f5-801e-6e524c7da5cf-image-registry-private-configuration\") pod \"47045f93-b0db-45f5-801e-6e524c7da5cf\" (UID: \"47045f93-b0db-45f5-801e-6e524c7da5cf\") "
Jul 24 13:50:20.335641 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.335485    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47045f93-b0db-45f5-801e-6e524c7da5cf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "47045f93-b0db-45f5-801e-6e524c7da5cf" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:50:20.335740 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.335693    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "47045f93-b0db-45f5-801e-6e524c7da5cf" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:50:20.335791 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.335742    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47045f93-b0db-45f5-801e-6e524c7da5cf-ca-trust-extracted\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:50:20.335876 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.335851    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47045f93-b0db-45f5-801e-6e524c7da5cf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "47045f93-b0db-45f5-801e-6e524c7da5cf" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:50:20.337852 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.337821    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47045f93-b0db-45f5-801e-6e524c7da5cf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "47045f93-b0db-45f5-801e-6e524c7da5cf" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:50:20.337955 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.337919    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-kube-api-access-5zzj9" (OuterVolumeSpecName: "kube-api-access-5zzj9") pod "47045f93-b0db-45f5-801e-6e524c7da5cf" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf"). InnerVolumeSpecName "kube-api-access-5zzj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:50:20.338093 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.338071    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47045f93-b0db-45f5-801e-6e524c7da5cf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "47045f93-b0db-45f5-801e-6e524c7da5cf" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:50:20.338134 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.338122    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "47045f93-b0db-45f5-801e-6e524c7da5cf" (UID: "47045f93-b0db-45f5-801e-6e524c7da5cf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:50:20.436694 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.436662    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zzj9\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-kube-api-access-5zzj9\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:50:20.436694 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.436692    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47045f93-b0db-45f5-801e-6e524c7da5cf-image-registry-private-configuration\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:50:20.436694 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.436702    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-certificates\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:50:20.436921 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.436711    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47045f93-b0db-45f5-801e-6e524c7da5cf-installation-pull-secrets\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:50:20.436921 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.436720    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47045f93-b0db-45f5-801e-6e524c7da5cf-trusted-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:50:20.436921 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:20.436728    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-bound-sa-token\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:50:21.289376 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:21.289346    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9959d7b-5fm5d"
Jul 24 13:50:21.321605 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:21.321576    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9959d7b-5fm5d"]
Jul 24 13:50:21.325397 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:21.325374    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9959d7b-5fm5d"]
Jul 24 13:50:21.344631 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:21.344599    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47045f93-b0db-45f5-801e-6e524c7da5cf-registry-tls\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:50:22.197274 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:22.197238    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47045f93-b0db-45f5-801e-6e524c7da5cf" path="/var/lib/kubelet/pods/47045f93-b0db-45f5-801e-6e524c7da5cf/volumes"
Jul 24 13:50:30.323443 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:30.323406    2565 generic.go:356] "Generic (PLEG): container finished" podID="8803d13e-5655-4481-941e-fd87cecc876b" containerID="c917f82098880a721b44c4727a3fb2983122eec39f30718a432e7a9fc3a8ffca" exitCode=0
Jul 24 13:50:30.323443 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:30.323448    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h" event={"ID":"8803d13e-5655-4481-941e-fd87cecc876b","Type":"ContainerDied","Data":"c917f82098880a721b44c4727a3fb2983122eec39f30718a432e7a9fc3a8ffca"}
Jul 24 13:50:30.323885 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:30.323735    2565 scope.go:117] "RemoveContainer" containerID="c917f82098880a721b44c4727a3fb2983122eec39f30718a432e7a9fc3a8ffca"
Jul 24 13:50:31.329255 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:31.329221    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xxb7h" event={"ID":"8803d13e-5655-4481-941e-fd87cecc876b","Type":"ContainerStarted","Data":"7a5accd88f72226c0271c3a8f0449d31ce3e485415cb3e378a17f470b7af31f5"}
Jul 24 13:50:34.342307 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:34.342267    2565 generic.go:356] "Generic (PLEG): container finished" podID="75d9eb42-05d9-4729-9382-85f04774bf0f" containerID="bd7dc9f0249b29cace1044bd704b8b658c61911b3b9214949b001a5ee2aa7496" exitCode=0
Jul 24 13:50:34.342741 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:34.342313    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-qrsrx" event={"ID":"75d9eb42-05d9-4729-9382-85f04774bf0f","Type":"ContainerDied","Data":"bd7dc9f0249b29cace1044bd704b8b658c61911b3b9214949b001a5ee2aa7496"}
Jul 24 13:50:34.342741 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:34.342677    2565 scope.go:117] "RemoveContainer" containerID="bd7dc9f0249b29cace1044bd704b8b658c61911b3b9214949b001a5ee2aa7496"
Jul 24 13:50:35.353821 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:35.353783    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-qrsrx" event={"ID":"75d9eb42-05d9-4729-9382-85f04774bf0f","Type":"ContainerStarted","Data":"4a7a633f2e07ab703296b4767ca3ddc5489ff878a83ea16f0b283bbe92126ece"}
Jul 24 13:50:35.452310 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:35.452273    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c6777bc7-kmtdh_419e2dcc-9848-46b9-a353-00ff6d78be07/router/0.log"
Jul 24 13:50:35.465162 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:35.465134    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x7w45_97d637b1-98c3-4f98-9555-08a28bcf744e/serve-healthcheck-canary/0.log"
Jul 24 13:50:54.431792 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:54.431757    2565 generic.go:356] "Generic (PLEG): container finished" podID="c905979c-221e-4583-9394-646302006355" containerID="2a3b5d2ff821c23ff4930af2b241dbd3e45b3b9e059c7463ece50eaa53e64d99" exitCode=0
Jul 24 13:50:54.432194 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:54.431838    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c" event={"ID":"c905979c-221e-4583-9394-646302006355","Type":"ContainerDied","Data":"2a3b5d2ff821c23ff4930af2b241dbd3e45b3b9e059c7463ece50eaa53e64d99"}
Jul 24 13:50:54.432240 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:54.432204    2565 scope.go:117] "RemoveContainer" containerID="2a3b5d2ff821c23ff4930af2b241dbd3e45b3b9e059c7463ece50eaa53e64d99"
Jul 24 13:50:55.437253 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:50:55.437220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c" event={"ID":"c905979c-221e-4583-9394-646302006355","Type":"ContainerStarted","Data":"ae6f0b3062005d55af488e85a1ae601f9d53f6af70306c0a848d05c70d3991fb"}
Jul 24 13:51:05.158813 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:05.158774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:51:05.161356 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:05.161332    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c31e-6c92-4f1d-a9e3-0228915d6893-metrics-certs\") pod \"network-metrics-daemon-l7qzc\" (UID: \"6ec1c31e-6c92-4f1d-a9e3-0228915d6893\") " pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:51:05.293530 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:05.293483    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qbf75\""
Jul 24 13:51:05.301352 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:05.301320    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7qzc"
Jul 24 13:51:05.439035 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:05.439013    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l7qzc"]
Jul 24 13:51:05.441310 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:51:05.441286    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec1c31e_6c92_4f1d_a9e3_0228915d6893.slice/crio-01d2c5639ab35596bb74836050b6f2d1e8931a2837b3417af4b7cebd8cb64f03 WatchSource:0}: Error finding container 01d2c5639ab35596bb74836050b6f2d1e8931a2837b3417af4b7cebd8cb64f03: Status 404 returned error can't find the container with id 01d2c5639ab35596bb74836050b6f2d1e8931a2837b3417af4b7cebd8cb64f03
Jul 24 13:51:05.473918 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:05.473888    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l7qzc" event={"ID":"6ec1c31e-6c92-4f1d-a9e3-0228915d6893","Type":"ContainerStarted","Data":"01d2c5639ab35596bb74836050b6f2d1e8931a2837b3417af4b7cebd8cb64f03"}
Jul 24 13:51:06.479381 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:06.479349    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l7qzc" event={"ID":"6ec1c31e-6c92-4f1d-a9e3-0228915d6893","Type":"ContainerStarted","Data":"e7056a564f09554ba1f17886f43dcf5dd0117f709cbde7f008fdbf93f7f9d7e1"}
Jul 24 13:51:07.485765 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:07.485731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l7qzc" event={"ID":"6ec1c31e-6c92-4f1d-a9e3-0228915d6893","Type":"ContainerStarted","Data":"ebc1facead7742095444814349c661728dc567568b85eb29ca0f78d7e519894b"}
Jul 24 13:51:07.505081 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:07.505029    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l7qzc" podStartSLOduration=374.614019598 podStartE2EDuration="6m15.505012319s" totalImagesPullingTime="890.992721ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:51:07.504629353 +0000 UTC m=+375.739980715" watchObservedRunningTime="2026-07-24 13:51:07.505012319 +0000 UTC m=+375.740363683"
Jul 24 13:51:07.681757 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:07.681713    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:07.698483 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:07.698454    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:08.505958 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:08.505931    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:25.802047 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:25.802009    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:51:25.802500 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:25.802317    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="prometheus" containerID="cri-o://6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25" gracePeriod=600
Jul 24 13:51:25.802500 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:25.802369    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="thanos-sidecar" containerID="cri-o://b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243" gracePeriod=600
Jul 24 13:51:25.802500 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:25.802379    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c" gracePeriod=600
Jul 24 13:51:25.802500 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:25.802343    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="kube-rbac-proxy" containerID="cri-o://005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba" gracePeriod=600
Jul 24 13:51:25.802500 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:25.802408    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="config-reloader" containerID="cri-o://8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005" gracePeriod=600
Jul 24 13:51:25.802500 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:25.802394    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="kube-rbac-proxy-web" containerID="cri-o://b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc" gracePeriod=600
Jul 24 13:51:26.073098 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.073055    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.263929 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.263895    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-web-config\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.264114 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.263944    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-0\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.264114 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.263971    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-metrics-client-certs\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.264114 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.263994    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-kubelet-serving-ca-bundle\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.264114 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.264010    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-thanos-prometheus-http-client-file\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.264114 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.264034    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-metrics-client-ca\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.264114 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.264060    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-serving-certs-ca-bundle\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.264114 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.264098    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/353a9de8-ded1-4c45-913f-fa1693cf3197-tls-assets\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.264499 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.264126    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-grpc-tls\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.264887 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.264579    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:51:26.264887 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.264635    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:51:26.264887 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.264720    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/353a9de8-ded1-4c45-913f-fa1693cf3197-config-out\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.264887 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.264803    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-kube-rbac-proxy\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.265250 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.265096    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-db\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.265250 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.265132    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-trusted-ca-bundle\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.265250 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.265192    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:51:26.265412 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.265327    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.265472 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.265443    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ht2h\" (UniqueName: \"kubernetes.io/projected/353a9de8-ded1-4c45-913f-fa1693cf3197-kube-api-access-4ht2h\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.265527 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.265477    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-tls\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.265589 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.265532    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-config\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.265893 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.265564    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.265893 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.265760    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-1\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.265893 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.265791    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-2\") pod \"353a9de8-ded1-4c45-913f-fa1693cf3197\" (UID: \"353a9de8-ded1-4c45-913f-fa1693cf3197\") "
Jul 24 13:51:26.266645 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.266568    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.266645 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.266611    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-metrics-client-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.266645 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.266628    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.267130 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.267094    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:51:26.267282 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.267248    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:51:26.267388 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.267364    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:51:26.267553 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.267531    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:51:26.267632 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.267610    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:26.268054 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.268029    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:26.268203 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.268159    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:51:26.268536 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.268501    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-config" (OuterVolumeSpecName: "config") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:26.268685 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.268662    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/353a9de8-ded1-4c45-913f-fa1693cf3197-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:51:26.269256 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.269233    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:26.269482 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.269460    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/353a9de8-ded1-4c45-913f-fa1693cf3197-kube-api-access-4ht2h" (OuterVolumeSpecName: "kube-api-access-4ht2h") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "kube-api-access-4ht2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:51:26.269963 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.269937    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/353a9de8-ded1-4c45-913f-fa1693cf3197-config-out" (OuterVolumeSpecName: "config-out") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:51:26.270197 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.270136    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:26.270299 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.270216    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:26.270299 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.270261    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:26.271300 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.271278    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:26.279222 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.279192    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-web-config" (OuterVolumeSpecName: "web-config") pod "353a9de8-ded1-4c45-913f-fa1693cf3197" (UID: "353a9de8-ded1-4c45-913f-fa1693cf3197"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:51:26.367430 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367346    2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-grpc-tls\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367430 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367374    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/353a9de8-ded1-4c45-913f-fa1693cf3197-config-out\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367430 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367384    2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-kube-rbac-proxy\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367430 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367393    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-db\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367430 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367402    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367430 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367413    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367430 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367423    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ht2h\" (UniqueName: \"kubernetes.io/projected/353a9de8-ded1-4c45-913f-fa1693cf3197-kube-api-access-4ht2h\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367430 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367431    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367430 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367440    2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-config\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367796 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367450    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367796 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367458    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367796 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367470    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367796 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367478    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-web-config\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367796 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367485    2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-secret-metrics-client-certs\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367796 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367493    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a9de8-ded1-4c45-913f-fa1693cf3197-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367796 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367502    2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/353a9de8-ded1-4c45-913f-fa1693cf3197-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.367796 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.367511    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/353a9de8-ded1-4c45-913f-fa1693cf3197-tls-assets\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:51:26.568706 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.568669    2565 generic.go:356] "Generic (PLEG): container finished" podID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerID="e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c" exitCode=0
Jul 24 13:51:26.568706 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.568696    2565 generic.go:356] "Generic (PLEG): container finished" podID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerID="005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba" exitCode=0
Jul 24 13:51:26.568706 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.568703    2565 generic.go:356] "Generic (PLEG): container finished" podID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerID="b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc" exitCode=0
Jul 24 13:51:26.568706 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.568709    2565 generic.go:356] "Generic (PLEG): container finished" podID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerID="b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243" exitCode=0
Jul 24 13:51:26.568706 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.568714    2565 generic.go:356] "Generic (PLEG): container finished" podID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerID="8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005" exitCode=0
Jul 24 13:51:26.568983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.568721    2565 generic.go:356] "Generic (PLEG): container finished" podID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerID="6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25" exitCode=0
Jul 24 13:51:26.568983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.568748    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.568983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.568746    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerDied","Data":"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"}
Jul 24 13:51:26.568983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.568883    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerDied","Data":"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"}
Jul 24 13:51:26.568983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.568910    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerDied","Data":"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"}
Jul 24 13:51:26.568983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.568935    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerDied","Data":"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"}
Jul 24 13:51:26.568983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.568956    2565 scope.go:117] "RemoveContainer" containerID="e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"
Jul 24 13:51:26.568983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.568964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerDied","Data":"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"}
Jul 24 13:51:26.569324 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.568995    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerDied","Data":"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"}
Jul 24 13:51:26.569324 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.569020    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"353a9de8-ded1-4c45-913f-fa1693cf3197","Type":"ContainerDied","Data":"a00c85d7269a1996685a485bcb711589c0840d23b2b07394a2da96e823c40949"}
Jul 24 13:51:26.577989 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.577969    2565 scope.go:117] "RemoveContainer" containerID="005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"
Jul 24 13:51:26.585782 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.585762    2565 scope.go:117] "RemoveContainer" containerID="b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"
Jul 24 13:51:26.594009 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.593978    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:51:26.594547 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.594531    2565 scope.go:117] "RemoveContainer" containerID="b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"
Jul 24 13:51:26.598401 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.598376    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:51:26.602610 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.602591    2565 scope.go:117] "RemoveContainer" containerID="8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"
Jul 24 13:51:26.609952 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.609931    2565 scope.go:117] "RemoveContainer" containerID="6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"
Jul 24 13:51:26.617746 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.617725    2565 scope.go:117] "RemoveContainer" containerID="8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"
Jul 24 13:51:26.626956 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.626936    2565 scope.go:117] "RemoveContainer" containerID="e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"
Jul 24 13:51:26.627545 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:51:26.627387    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c\": container with ID starting with e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c not found: ID does not exist" containerID="e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"
Jul 24 13:51:26.627545 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.627431    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"} err="failed to get container status \"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c\": rpc error: code = NotFound desc = could not find container \"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c\": container with ID starting with e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c not found: ID does not exist"
Jul 24 13:51:26.627545 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.627478    2565 scope.go:117] "RemoveContainer" containerID="005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"
Jul 24 13:51:26.628018 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:51:26.627992    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba\": container with ID starting with 005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba not found: ID does not exist" containerID="005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"
Jul 24 13:51:26.628149 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.628030    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"} err="failed to get container status \"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba\": rpc error: code = NotFound desc = could not find container \"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba\": container with ID starting with 005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba not found: ID does not exist"
Jul 24 13:51:26.628149 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.628055    2565 scope.go:117] "RemoveContainer" containerID="b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"
Jul 24 13:51:26.628484 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:51:26.628364    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc\": container with ID starting with b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc not found: ID does not exist" containerID="b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"
Jul 24 13:51:26.628484 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.628392    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"} err="failed to get container status \"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc\": rpc error: code = NotFound desc = could not find container \"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc\": container with ID starting with b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc not found: ID does not exist"
Jul 24 13:51:26.628484 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.628415    2565 scope.go:117] "RemoveContainer" containerID="b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"
Jul 24 13:51:26.628732 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:51:26.628704    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243\": container with ID starting with b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243 not found: ID does not exist" containerID="b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"
Jul 24 13:51:26.628812 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.628736    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"} err="failed to get container status \"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243\": rpc error: code = NotFound desc = could not find container \"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243\": container with ID starting with b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243 not found: ID does not exist"
Jul 24 13:51:26.628812 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.628750    2565 scope.go:117] "RemoveContainer" containerID="8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"
Jul 24 13:51:26.629032 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:51:26.629011    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005\": container with ID starting with 8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005 not found: ID does not exist" containerID="8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"
Jul 24 13:51:26.629082 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.629042    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"} err="failed to get container status \"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005\": rpc error: code = NotFound desc = could not find container \"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005\": container with ID starting with 8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005 not found: ID does not exist"
Jul 24 13:51:26.629082 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.629064    2565 scope.go:117] "RemoveContainer" containerID="6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"
Jul 24 13:51:26.629389 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:51:26.629368    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25\": container with ID starting with 6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25 not found: ID does not exist" containerID="6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"
Jul 24 13:51:26.629498 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.629394    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"} err="failed to get container status \"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25\": rpc error: code = NotFound desc = could not find container \"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25\": container with ID starting with 6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25 not found: ID does not exist"
Jul 24 13:51:26.629498 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.629408    2565 scope.go:117] "RemoveContainer" containerID="8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"
Jul 24 13:51:26.629663 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:51:26.629646    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e\": container with ID starting with 8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e not found: ID does not exist" containerID="8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"
Jul 24 13:51:26.629699 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.629668    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"} err="failed to get container status \"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e\": rpc error: code = NotFound desc = could not find container \"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e\": container with ID starting with 8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e not found: ID does not exist"
Jul 24 13:51:26.629699 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.629681    2565 scope.go:117] "RemoveContainer" containerID="e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"
Jul 24 13:51:26.629816 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.629797    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:51:26.629885 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.629870    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"} err="failed to get container status \"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c\": rpc error: code = NotFound desc = could not find container \"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c\": container with ID starting with e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c not found: ID does not exist"
Jul 24 13:51:26.629923 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.629896    2565 scope.go:117] "RemoveContainer" containerID="005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"
Jul 24 13:51:26.630127 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630112    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="kube-rbac-proxy-web"
Jul 24 13:51:26.630164 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630130    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="kube-rbac-proxy-web"
Jul 24 13:51:26.630164 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630145    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="kube-rbac-proxy-thanos"
Jul 24 13:51:26.630164 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630153    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="kube-rbac-proxy-thanos"
Jul 24 13:51:26.630292 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630142    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"} err="failed to get container status \"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba\": rpc error: code = NotFound desc = could not find container \"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba\": container with ID starting with 005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba not found: ID does not exist"
Jul 24 13:51:26.630292 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630205    2565 scope.go:117] "RemoveContainer" containerID="b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"
Jul 24 13:51:26.630292 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630187    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="config-reloader"
Jul 24 13:51:26.630292 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630252    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="config-reloader"
Jul 24 13:51:26.630292 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630262    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="init-config-reloader"
Jul 24 13:51:26.630292 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630269    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="init-config-reloader"
Jul 24 13:51:26.630292 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630280    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="thanos-sidecar"
Jul 24 13:51:26.630292 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630286    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="thanos-sidecar"
Jul 24 13:51:26.630292 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630298    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="prometheus"
Jul 24 13:51:26.630593 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630303    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="prometheus"
Jul 24 13:51:26.630593 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630316    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="kube-rbac-proxy"
Jul 24 13:51:26.630593 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630322    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="kube-rbac-proxy"
Jul 24 13:51:26.630593 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630392    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="thanos-sidecar"
Jul 24 13:51:26.630593 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630400    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="config-reloader"
Jul 24 13:51:26.630593 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630407    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="kube-rbac-proxy"
Jul 24 13:51:26.630593 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630416    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="kube-rbac-proxy-web"
Jul 24 13:51:26.630593 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630422    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="kube-rbac-proxy-thanos"
Jul 24 13:51:26.630593 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630429    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" containerName="prometheus"
Jul 24 13:51:26.630593 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630436    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"} err="failed to get container status \"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc\": rpc error: code = NotFound desc = could not find container \"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc\": container with ID starting with b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc not found: ID does not exist"
Jul 24 13:51:26.630593 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630452    2565 scope.go:117] "RemoveContainer" containerID="b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"
Jul 24 13:51:26.630942 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630678    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"} err="failed to get container status \"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243\": rpc error: code = NotFound desc = could not find container \"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243\": container with ID starting with b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243 not found: ID does not exist"
Jul 24 13:51:26.630942 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630692    2565 scope.go:117] "RemoveContainer" containerID="8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"
Jul 24 13:51:26.630942 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630895    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"} err="failed to get container status \"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005\": rpc error: code = NotFound desc = could not find container \"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005\": container with ID starting with 8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005 not found: ID does not exist"
Jul 24 13:51:26.630942 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.630916    2565 scope.go:117] "RemoveContainer" containerID="6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"
Jul 24 13:51:26.631158 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.631142    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"} err="failed to get container status \"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25\": rpc error: code = NotFound desc = could not find container \"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25\": container with ID starting with 6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25 not found: ID does not exist"
Jul 24 13:51:26.631218 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.631158    2565 scope.go:117] "RemoveContainer" containerID="8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"
Jul 24 13:51:26.631379 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.631364    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"} err="failed to get container status \"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e\": rpc error: code = NotFound desc = could not find container \"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e\": container with ID starting with 8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e not found: ID does not exist"
Jul 24 13:51:26.631437 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.631379    2565 scope.go:117] "RemoveContainer" containerID="e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"
Jul 24 13:51:26.631581 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.631562    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"} err="failed to get container status \"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c\": rpc error: code = NotFound desc = could not find container \"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c\": container with ID starting with e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c not found: ID does not exist"
Jul 24 13:51:26.631581 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.631579    2565 scope.go:117] "RemoveContainer" containerID="005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"
Jul 24 13:51:26.631778 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.631756    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"} err="failed to get container status \"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba\": rpc error: code = NotFound desc = could not find container \"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba\": container with ID starting with 005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba not found: ID does not exist"
Jul 24 13:51:26.631838 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.631780    2565 scope.go:117] "RemoveContainer" containerID="b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"
Jul 24 13:51:26.631967 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.631950    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"} err="failed to get container status \"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc\": rpc error: code = NotFound desc = could not find container \"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc\": container with ID starting with b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc not found: ID does not exist"
Jul 24 13:51:26.632006 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.631968    2565 scope.go:117] "RemoveContainer" containerID="b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"
Jul 24 13:51:26.632166 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.632151    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"} err="failed to get container status \"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243\": rpc error: code = NotFound desc = could not find container \"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243\": container with ID starting with b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243 not found: ID does not exist"
Jul 24 13:51:26.632166 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.632166    2565 scope.go:117] "RemoveContainer" containerID="8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"
Jul 24 13:51:26.632364 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.632347    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"} err="failed to get container status \"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005\": rpc error: code = NotFound desc = could not find container \"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005\": container with ID starting with 8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005 not found: ID does not exist"
Jul 24 13:51:26.632414 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.632365    2565 scope.go:117] "RemoveContainer" containerID="6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"
Jul 24 13:51:26.632537 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.632520    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"} err="failed to get container status \"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25\": rpc error: code = NotFound desc = could not find container \"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25\": container with ID starting with 6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25 not found: ID does not exist"
Jul 24 13:51:26.632577 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.632537    2565 scope.go:117] "RemoveContainer" containerID="8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"
Jul 24 13:51:26.632685 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.632669    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"} err="failed to get container status \"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e\": rpc error: code = NotFound desc = could not find container \"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e\": container with ID starting with 8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e not found: ID does not exist"
Jul 24 13:51:26.632722 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.632684    2565 scope.go:117] "RemoveContainer" containerID="e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"
Jul 24 13:51:26.632841 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.632822    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"} err="failed to get container status \"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c\": rpc error: code = NotFound desc = could not find container \"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c\": container with ID starting with e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c not found: ID does not exist"
Jul 24 13:51:26.632889 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.632842    2565 scope.go:117] "RemoveContainer" containerID="005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"
Jul 24 13:51:26.633024 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.633008    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"} err="failed to get container status \"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba\": rpc error: code = NotFound desc = could not find container \"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba\": container with ID starting with 005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba not found: ID does not exist"
Jul 24 13:51:26.633080 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.633023    2565 scope.go:117] "RemoveContainer" containerID="b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"
Jul 24 13:51:26.633234 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.633216    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"} err="failed to get container status \"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc\": rpc error: code = NotFound desc = could not find container \"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc\": container with ID starting with b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc not found: ID does not exist"
Jul 24 13:51:26.633304 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.633235    2565 scope.go:117] "RemoveContainer" containerID="b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"
Jul 24 13:51:26.633440 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.633418    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"} err="failed to get container status \"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243\": rpc error: code = NotFound desc = could not find container \"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243\": container with ID starting with b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243 not found: ID does not exist"
Jul 24 13:51:26.633481 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.633442    2565 scope.go:117] "RemoveContainer" containerID="8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"
Jul 24 13:51:26.633616 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.633597    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"} err="failed to get container status \"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005\": rpc error: code = NotFound desc = could not find container \"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005\": container with ID starting with 8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005 not found: ID does not exist"
Jul 24 13:51:26.633653 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.633620    2565 scope.go:117] "RemoveContainer" containerID="6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"
Jul 24 13:51:26.633829 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.633815    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"} err="failed to get container status \"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25\": rpc error: code = NotFound desc = could not find container \"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25\": container with ID starting with 6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25 not found: ID does not exist"
Jul 24 13:51:26.633866 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.633831    2565 scope.go:117] "RemoveContainer" containerID="8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"
Jul 24 13:51:26.634027 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.634007    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"} err="failed to get container status \"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e\": rpc error: code = NotFound desc = could not find container \"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e\": container with ID starting with 8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e not found: ID does not exist"
Jul 24 13:51:26.634063 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.634029    2565 scope.go:117] "RemoveContainer" containerID="e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"
Jul 24 13:51:26.634242 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.634219    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"} err="failed to get container status \"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c\": rpc error: code = NotFound desc = could not find container \"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c\": container with ID starting with e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c not found: ID does not exist"
Jul 24 13:51:26.634242 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.634245    2565 scope.go:117] "RemoveContainer" containerID="005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"
Jul 24 13:51:26.634441 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.634425    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"} err="failed to get container status \"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba\": rpc error: code = NotFound desc = could not find container \"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba\": container with ID starting with 005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba not found: ID does not exist"
Jul 24 13:51:26.634485 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.634441    2565 scope.go:117] "RemoveContainer" containerID="b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"
Jul 24 13:51:26.634634 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.634616    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"} err="failed to get container status \"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc\": rpc error: code = NotFound desc = could not find container \"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc\": container with ID starting with b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc not found: ID does not exist"
Jul 24 13:51:26.634676 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.634635    2565 scope.go:117] "RemoveContainer" containerID="b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"
Jul 24 13:51:26.634863 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.634840    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"} err="failed to get container status \"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243\": rpc error: code = NotFound desc = could not find container \"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243\": container with ID starting with b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243 not found: ID does not exist"
Jul 24 13:51:26.634935 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.634863    2565 scope.go:117] "RemoveContainer" containerID="8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"
Jul 24 13:51:26.635151 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.635102    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"} err="failed to get container status \"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005\": rpc error: code = NotFound desc = could not find container \"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005\": container with ID starting with 8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005 not found: ID does not exist"
Jul 24 13:51:26.635151 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.635144    2565 scope.go:117] "RemoveContainer" containerID="6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"
Jul 24 13:51:26.635971 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.635946    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"} err="failed to get container status \"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25\": rpc error: code = NotFound desc = could not find container \"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25\": container with ID starting with 6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25 not found: ID does not exist"
Jul 24 13:51:26.635971 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.635971    2565 scope.go:117] "RemoveContainer" containerID="8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"
Jul 24 13:51:26.636254 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.636228    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"} err="failed to get container status \"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e\": rpc error: code = NotFound desc = could not find container \"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e\": container with ID starting with 8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e not found: ID does not exist"
Jul 24 13:51:26.636317 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.636257    2565 scope.go:117] "RemoveContainer" containerID="e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"
Jul 24 13:51:26.636317 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.636298    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.636961 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.636906    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c"} err="failed to get container status \"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c\": rpc error: code = NotFound desc = could not find container \"e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c\": container with ID starting with e628df6838f4843088861c508daef49e62ce7fee0e02545eaa370d4e0a698d8c not found: ID does not exist"
Jul 24 13:51:26.636961 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.636939    2565 scope.go:117] "RemoveContainer" containerID="005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"
Jul 24 13:51:26.637267 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.637248    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba"} err="failed to get container status \"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba\": rpc error: code = NotFound desc = could not find container \"005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba\": container with ID starting with 005896a2157578305c822a4acb50cc9991cc91ef19943904a70df434bcd77eba not found: ID does not exist"
Jul 24 13:51:26.637331 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.637270    2565 scope.go:117] "RemoveContainer" containerID="b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"
Jul 24 13:51:26.637524 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.637507    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc"} err="failed to get container status \"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc\": rpc error: code = NotFound desc = could not find container \"b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc\": container with ID starting with b840a0d54866bc96d799358f247667acfe94926bc4f535b14d781765ad36fbdc not found: ID does not exist"
Jul 24 13:51:26.637581 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.637524    2565 scope.go:117] "RemoveContainer" containerID="b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"
Jul 24 13:51:26.637753 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.637725    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243"} err="failed to get container status \"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243\": rpc error: code = NotFound desc = could not find container \"b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243\": container with ID starting with b7e3e4a785c0e318a2e3a0197fbe81dd53ffa6f5dab63ccbf2e2a948d89ab243 not found: ID does not exist"
Jul 24 13:51:26.637753 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.637753    2565 scope.go:117] "RemoveContainer" containerID="8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"
Jul 24 13:51:26.637972 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.637956    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005"} err="failed to get container status \"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005\": rpc error: code = NotFound desc = could not find container \"8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005\": container with ID starting with 8823b4e7d912b2f5ea34ca5f20b568ba982b5703ab0537be1e1cc7006ba73005 not found: ID does not exist"
Jul 24 13:51:26.638020 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.637973    2565 scope.go:117] "RemoveContainer" containerID="6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"
Jul 24 13:51:26.638223 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.638205    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25"} err="failed to get container status \"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25\": rpc error: code = NotFound desc = could not find container \"6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25\": container with ID starting with 6b5ea8455889a35013d2337dee75c5ae69506e9f8e461853897459808c990d25 not found: ID does not exist"
Jul 24 13:51:26.638278 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.638224    2565 scope.go:117] "RemoveContainer" containerID="8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"
Jul 24 13:51:26.638451 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.638436    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e"} err="failed to get container status \"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e\": rpc error: code = NotFound desc = could not find container \"8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e\": container with ID starting with 8b9c9b2630089c702e291b7d9339bc5e3acb434210db70221a81ff7145c7f92e not found: ID does not exist"
Jul 24 13:51:26.639839 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.639805    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 13:51:26.639839 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.639826    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 13:51:26.639993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.639814    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 13:51:26.639993 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.639808    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 13:51:26.640445 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.640194    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 13:51:26.640445 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.640227    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 13:51:26.640445 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.640227    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 13:51:26.640445 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.640292    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 13:51:26.640445 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.640300    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xsrbr\""
Jul 24 13:51:26.640445 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.640276    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 13:51:26.640899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.640881    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 13:51:26.640983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.640922    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 13:51:26.640983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.640886    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 13:51:26.640983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.640964    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 13:51:26.640983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.640888    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6e5cjb9o2vfob\""
Jul 24 13:51:26.642627 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.642608    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 13:51:26.645790 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.645769    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 13:51:26.663558 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.663526    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:51:26.770949 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.770912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.770949 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.770955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771244 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.770974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-config\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771244 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.770992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771244 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771244 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771244 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771448 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771448 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771448 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-config-out\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771448 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771336    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771448 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771448 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771400    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771448 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771430    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771646 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n7vn\" (UniqueName: \"kubernetes.io/projected/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-kube-api-access-5n7vn\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771646 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771646 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771507    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-web-config\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771646 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771646 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.771646 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.771620    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.872361 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.872265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.872361 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.872311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.872361 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.872344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-config-out\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.872361 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.872359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.872946 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.872390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.872946 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.872406    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.872946 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.872441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.872946 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.872463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n7vn\" (UniqueName: \"kubernetes.io/projected/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-kube-api-access-5n7vn\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.872946 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.872491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.873296 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.873237    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.873513 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.873398    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.873513 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.873453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-web-config\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.873513 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.873487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.873672 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.873524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.873672 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.873596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.873672 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.873634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.873826 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.873678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.873826 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.873708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-config\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.873826 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.873734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.873826 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.873764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.873826 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.873796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.874076 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.873835    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.874575 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.874550    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.875678 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.875654    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.875824 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.875684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.875914 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.875827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.876458 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.876102    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.876458 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.876246    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.876458 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.876452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-config-out\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.876654 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.876491    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.876741 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.876714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.877045 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.877017    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.877356 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.877282    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.878194 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.878157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.878444 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.878423    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-web-config\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.878577 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.878553    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.878908 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.878884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.879513 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.879494    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.879590 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.879538    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-config\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.882385 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.882369    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n7vn\" (UniqueName: \"kubernetes.io/projected/0cfe2328-3765-459e-b3e3-5a4ccf1f4332-kube-api-access-5n7vn\") pod \"prometheus-k8s-0\" (UID: \"0cfe2328-3765-459e-b3e3-5a4ccf1f4332\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:26.947594 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:26.947543    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:27.100461 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:27.100435    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:51:27.102129 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:51:27.102100    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cfe2328_3765_459e_b3e3_5a4ccf1f4332.slice/crio-440d32b42a8f9684c9fb88217d5fb4b44b33fa945a02e124c252ae2950e68008 WatchSource:0}: Error finding container 440d32b42a8f9684c9fb88217d5fb4b44b33fa945a02e124c252ae2950e68008: Status 404 returned error can't find the container with id 440d32b42a8f9684c9fb88217d5fb4b44b33fa945a02e124c252ae2950e68008
Jul 24 13:51:27.574132 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:27.574096    2565 generic.go:356] "Generic (PLEG): container finished" podID="0cfe2328-3765-459e-b3e3-5a4ccf1f4332" containerID="87ee40963a5a771fb1022716131f9d268ed1d08f26c8957f454e511bedac2329" exitCode=0
Jul 24 13:51:27.574345 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:27.574205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cfe2328-3765-459e-b3e3-5a4ccf1f4332","Type":"ContainerDied","Data":"87ee40963a5a771fb1022716131f9d268ed1d08f26c8957f454e511bedac2329"}
Jul 24 13:51:27.574345 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:27.574281    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cfe2328-3765-459e-b3e3-5a4ccf1f4332","Type":"ContainerStarted","Data":"440d32b42a8f9684c9fb88217d5fb4b44b33fa945a02e124c252ae2950e68008"}
Jul 24 13:51:28.195066 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:28.194986    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="353a9de8-ded1-4c45-913f-fa1693cf3197" path="/var/lib/kubelet/pods/353a9de8-ded1-4c45-913f-fa1693cf3197/volumes"
Jul 24 13:51:28.583137 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:28.583084    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cfe2328-3765-459e-b3e3-5a4ccf1f4332","Type":"ContainerStarted","Data":"9fe7fd4cf7e7b41c10d0aabe4f522f31c5863cb58735ad0db0d6268cc6bdaa97"}
Jul 24 13:51:28.583362 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:28.583215    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cfe2328-3765-459e-b3e3-5a4ccf1f4332","Type":"ContainerStarted","Data":"4c9e9222145db461a74e8c4d83b44b277a1bcc23e458434ee4ec241d3578f1fa"}
Jul 24 13:51:28.583362 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:28.583264    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cfe2328-3765-459e-b3e3-5a4ccf1f4332","Type":"ContainerStarted","Data":"d11611fccebd5ae0107b02e0a1370e201b320756ef8955f02ea262e952a2845b"}
Jul 24 13:51:28.583362 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:28.583303    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cfe2328-3765-459e-b3e3-5a4ccf1f4332","Type":"ContainerStarted","Data":"309bd9abb75ee9fd570f5489e3812d94068d87f56bf4ab68359b1ebfdd128a95"}
Jul 24 13:51:28.583362 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:28.583342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cfe2328-3765-459e-b3e3-5a4ccf1f4332","Type":"ContainerStarted","Data":"0395cc1279887bc03a1fd64ae28dc4977a60c8b7a5ab817614268c9793bb37fe"}
Jul 24 13:51:28.583545 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:28.583382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cfe2328-3765-459e-b3e3-5a4ccf1f4332","Type":"ContainerStarted","Data":"3a2fa30e2d4329b2e1a88e994057b56405aeecffd11c7b27743811d460d800c6"}
Jul 24 13:51:28.621999 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:28.621925    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.6027159539999998 podStartE2EDuration="2.621894173s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.178219ms" isStatefulPod=false podCreationTimestamp="2026-07-24 13:51:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:51:28.62116627 +0000 UTC m=+396.856517664" watchObservedRunningTime="2026-07-24 13:51:28.621894173 +0000 UTC m=+396.857245535"
Jul 24 13:51:31.948682 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:31.948635    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:51:32.037683 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:51:32.037639    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qgfbv" podUID="8c85b14b-79da-476c-b403-dcf9a30fa473"
Jul 24 13:51:32.037683 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:51:32.037639    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r" podUID="f1fcef7a-6518-4fc3-89c0-201e2d08b506"
Jul 24 13:51:32.600036 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:32.600008    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:51:32.600210 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:32.600008    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:51:34.144145 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:34.144101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:51:34.146690 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:34.146655    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1fcef7a-6518-4fc3-89c0-201e2d08b506-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mm49r\" (UID: \"f1fcef7a-6518-4fc3-89c0-201e2d08b506\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:51:34.244983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:34.244949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:51:34.247509 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:34.247489    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c85b14b-79da-476c-b403-dcf9a30fa473-metrics-tls\") pod \"dns-default-qgfbv\" (UID: \"8c85b14b-79da-476c-b403-dcf9a30fa473\") " pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:51:34.403569 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:34.403491    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7f5lp\""
Jul 24 13:51:34.404423 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:34.404406    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-snr7s\""
Jul 24 13:51:34.411198 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:34.411159    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:51:34.411254 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:34.411236    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"
Jul 24 13:51:34.580606 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:34.578952    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qgfbv"]
Jul 24 13:51:34.582990 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:51:34.582960    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c85b14b_79da_476c_b403_dcf9a30fa473.slice/crio-77ae00e5024123bfc8d82311269de2b8f72d9141f97a81f8227a20e9c6381feb WatchSource:0}: Error finding container 77ae00e5024123bfc8d82311269de2b8f72d9141f97a81f8227a20e9c6381feb: Status 404 returned error can't find the container with id 77ae00e5024123bfc8d82311269de2b8f72d9141f97a81f8227a20e9c6381feb
Jul 24 13:51:34.591996 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:34.591974    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-mm49r"]
Jul 24 13:51:34.593468 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:51:34.593445    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1fcef7a_6518_4fc3_89c0_201e2d08b506.slice/crio-d54eb37d7a0f537c6f446b85ccd4a6e47efcb67df174aea501c842aab126bde5 WatchSource:0}: Error finding container d54eb37d7a0f537c6f446b85ccd4a6e47efcb67df174aea501c842aab126bde5: Status 404 returned error can't find the container with id d54eb37d7a0f537c6f446b85ccd4a6e47efcb67df174aea501c842aab126bde5
Jul 24 13:51:34.609205 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:34.609154    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgfbv" event={"ID":"8c85b14b-79da-476c-b403-dcf9a30fa473","Type":"ContainerStarted","Data":"77ae00e5024123bfc8d82311269de2b8f72d9141f97a81f8227a20e9c6381feb"}
Jul 24 13:51:34.610401 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:34.610381    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r" event={"ID":"f1fcef7a-6518-4fc3-89c0-201e2d08b506","Type":"ContainerStarted","Data":"d54eb37d7a0f537c6f446b85ccd4a6e47efcb67df174aea501c842aab126bde5"}
Jul 24 13:51:36.622282 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:36.622226    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgfbv" event={"ID":"8c85b14b-79da-476c-b403-dcf9a30fa473","Type":"ContainerStarted","Data":"d0858c3ace20c9576371926a9dcfa73275fb4c98fb3748c2c53a84f8cd6ef08a"}
Jul 24 13:51:36.622759 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:36.622306    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgfbv" event={"ID":"8c85b14b-79da-476c-b403-dcf9a30fa473","Type":"ContainerStarted","Data":"b3ea5446ae0059cb351c542d19ffa0c58c6bedaaeef5b942531111be0c671600"}
Jul 24 13:51:36.622759 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:36.622338    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:51:36.623725 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:36.623699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r" event={"ID":"f1fcef7a-6518-4fc3-89c0-201e2d08b506","Type":"ContainerStarted","Data":"525f81ea80e62eb94a1e2b205dd22ba3e0c1dd26f6a323d456eb3926ae6f4fbe"}
Jul 24 13:51:36.642574 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:36.642472    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qgfbv" podStartSLOduration=372.831059357 podStartE2EDuration="6m14.642456328s" totalImagesPullingTime="1.811396971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:45:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:51:36.641209991 +0000 UTC m=+404.876561357" watchObservedRunningTime="2026-07-24 13:51:36.642456328 +0000 UTC m=+404.877807690"
Jul 24 13:51:36.657370 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:36.657315    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mm49r" podStartSLOduration=377.861725873 podStartE2EDuration="6m19.657293397s" totalImagesPullingTime="1.795567524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:51:36.657126788 +0000 UTC m=+404.892478151" watchObservedRunningTime="2026-07-24 13:51:36.657293397 +0000 UTC m=+404.892644766"
Jul 24 13:51:46.629853 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:51:46.629819    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qgfbv"
Jul 24 13:52:26.948664 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:52:26.948624    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:52:26.965712 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:52:26.965671    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:52:27.845856 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:52:27.845827    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:54:23.562145 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.562107    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"]
Jul 24 13:54:23.567938 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.567904    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.571004 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.570977    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 13:54:23.571004 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.570978    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 13:54:23.571309 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.571054    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 13:54:23.571309 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.571077    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 13:54:23.571309 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.571204    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ft8zn\""
Jul 24 13:54:23.582942 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.582914    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"]
Jul 24 13:54:23.719847 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.719814    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.719847 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.719857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.720073 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.719881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6sxd\" (UniqueName: \"kubernetes.io/projected/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-kube-api-access-v6sxd\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.720073 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.719903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-tmp\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.720073 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.719982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-manifests\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.820741 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.820654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.820741 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.820696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.820741 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.820716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6sxd\" (UniqueName: \"kubernetes.io/projected/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-kube-api-access-v6sxd\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.820741 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.820739    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-tmp\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.821009 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.820865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-manifests\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.821249 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.821221    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-manifests\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.823112 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.823092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-tmp\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.823371 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.823353    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.823500 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.823480    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.830513 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.830490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6sxd\" (UniqueName: \"kubernetes.io/projected/e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6-kube-api-access-v6sxd\") pod \"opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c\" (UID: \"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:23.879462 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:23.879421    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:24.032726 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:24.032566    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"]
Jul 24 13:54:24.035716 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:54:24.035682    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode69d2ad6_b925_4f06_b4e0_ab4a84bc65a6.slice/crio-6432315660b877149e030363cf2640046ae0ea2fbce9cfb987a9c6f847dca3ff WatchSource:0}: Error finding container 6432315660b877149e030363cf2640046ae0ea2fbce9cfb987a9c6f847dca3ff: Status 404 returned error can't find the container with id 6432315660b877149e030363cf2640046ae0ea2fbce9cfb987a9c6f847dca3ff
Jul 24 13:54:24.290592 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:24.290506    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c" event={"ID":"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6","Type":"ContainerStarted","Data":"6432315660b877149e030363cf2640046ae0ea2fbce9cfb987a9c6f847dca3ff"}
Jul 24 13:54:27.308152 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:27.308113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c" event={"ID":"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6","Type":"ContainerStarted","Data":"6c84c609ddbccf5767b359fab294b2a4e0942bc1f808ce2f3e7190898d3d86e6"}
Jul 24 13:54:28.313743 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:28.313709    2565 generic.go:356] "Generic (PLEG): container finished" podID="e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6" containerID="6c84c609ddbccf5767b359fab294b2a4e0942bc1f808ce2f3e7190898d3d86e6" exitCode=0
Jul 24 13:54:28.314129 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:28.313793    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c" event={"ID":"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6","Type":"ContainerDied","Data":"6c84c609ddbccf5767b359fab294b2a4e0942bc1f808ce2f3e7190898d3d86e6"}
Jul 24 13:54:29.319983 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:29.319950    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c" event={"ID":"e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6","Type":"ContainerStarted","Data":"ca00173ca1cb1323ee3245fc66daadbbe61a09a10d71e1174e36d9ba7e4b2c2b"}
Jul 24 13:54:29.320389 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:29.320062    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:29.343213 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:29.343125    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c" podStartSLOduration=1.9125091520000002 podStartE2EDuration="6.343100376s" totalImagesPullingTime="3.395907728s" totalInitContainerRuntime="1.034683496s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:54:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:54:29.341087556 +0000 UTC m=+577.576438921" watchObservedRunningTime="2026-07-24 13:54:29.343100376 +0000 UTC m=+577.578451739"
Jul 24 13:54:40.326725 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:40.326693    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c"
Jul 24 13:54:50.522348 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.522313    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"]
Jul 24 13:54:50.525713 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.525689    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:50.532300 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.528781    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 13:54:50.532300 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.529978    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 13:54:50.532300 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.530196    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fpjcj\""
Jul 24 13:54:50.532300 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.530227    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 13:54:50.532300 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.529978    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 13:54:50.534722 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.534703    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 13:54:50.537936 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.537909    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"]
Jul 24 13:54:50.540153 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.540131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/54249ca6-3227-4c9d-9f08-38a5d0ea089b-manager-config\") pod \"lws-controller-manager-84df8c9cc-64xh6\" (UID: \"54249ca6-3227-4c9d-9f08-38a5d0ea089b\") " pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:50.540269 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.540161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54249ca6-3227-4c9d-9f08-38a5d0ea089b-cert\") pod \"lws-controller-manager-84df8c9cc-64xh6\" (UID: \"54249ca6-3227-4c9d-9f08-38a5d0ea089b\") " pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:50.540269 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.540240    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj9qs\" (UniqueName: \"kubernetes.io/projected/54249ca6-3227-4c9d-9f08-38a5d0ea089b-kube-api-access-vj9qs\") pod \"lws-controller-manager-84df8c9cc-64xh6\" (UID: \"54249ca6-3227-4c9d-9f08-38a5d0ea089b\") " pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:50.540341 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.540276    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/54249ca6-3227-4c9d-9f08-38a5d0ea089b-metrics-cert\") pod \"lws-controller-manager-84df8c9cc-64xh6\" (UID: \"54249ca6-3227-4c9d-9f08-38a5d0ea089b\") " pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:50.641147 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.641110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj9qs\" (UniqueName: \"kubernetes.io/projected/54249ca6-3227-4c9d-9f08-38a5d0ea089b-kube-api-access-vj9qs\") pod \"lws-controller-manager-84df8c9cc-64xh6\" (UID: \"54249ca6-3227-4c9d-9f08-38a5d0ea089b\") " pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:50.641394 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.641196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/54249ca6-3227-4c9d-9f08-38a5d0ea089b-metrics-cert\") pod \"lws-controller-manager-84df8c9cc-64xh6\" (UID: \"54249ca6-3227-4c9d-9f08-38a5d0ea089b\") " pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:50.641394 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.641280    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/54249ca6-3227-4c9d-9f08-38a5d0ea089b-manager-config\") pod \"lws-controller-manager-84df8c9cc-64xh6\" (UID: \"54249ca6-3227-4c9d-9f08-38a5d0ea089b\") " pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:50.641394 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.641309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54249ca6-3227-4c9d-9f08-38a5d0ea089b-cert\") pod \"lws-controller-manager-84df8c9cc-64xh6\" (UID: \"54249ca6-3227-4c9d-9f08-38a5d0ea089b\") " pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:50.642154 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.642108    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/54249ca6-3227-4c9d-9f08-38a5d0ea089b-manager-config\") pod \"lws-controller-manager-84df8c9cc-64xh6\" (UID: \"54249ca6-3227-4c9d-9f08-38a5d0ea089b\") " pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:50.644061 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.644030    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54249ca6-3227-4c9d-9f08-38a5d0ea089b-cert\") pod \"lws-controller-manager-84df8c9cc-64xh6\" (UID: \"54249ca6-3227-4c9d-9f08-38a5d0ea089b\") " pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:50.644225 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.644097    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/54249ca6-3227-4c9d-9f08-38a5d0ea089b-metrics-cert\") pod \"lws-controller-manager-84df8c9cc-64xh6\" (UID: \"54249ca6-3227-4c9d-9f08-38a5d0ea089b\") " pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:50.652578 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.652540    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj9qs\" (UniqueName: \"kubernetes.io/projected/54249ca6-3227-4c9d-9f08-38a5d0ea089b-kube-api-access-vj9qs\") pod \"lws-controller-manager-84df8c9cc-64xh6\" (UID: \"54249ca6-3227-4c9d-9f08-38a5d0ea089b\") " pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:50.837792 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.837757    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:50.974885 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:50.974857    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"]
Jul 24 13:54:50.977749 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:54:50.977718    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54249ca6_3227_4c9d_9f08_38a5d0ea089b.slice/crio-77620819a5de0840dfbdec4b7eca2cc3e5fd9b409fdd8fb71a6d3b7de1cf24df WatchSource:0}: Error finding container 77620819a5de0840dfbdec4b7eca2cc3e5fd9b409fdd8fb71a6d3b7de1cf24df: Status 404 returned error can't find the container with id 77620819a5de0840dfbdec4b7eca2cc3e5fd9b409fdd8fb71a6d3b7de1cf24df
Jul 24 13:54:51.420702 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:51.420667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6" event={"ID":"54249ca6-3227-4c9d-9f08-38a5d0ea089b","Type":"ContainerStarted","Data":"77620819a5de0840dfbdec4b7eca2cc3e5fd9b409fdd8fb71a6d3b7de1cf24df"}
Jul 24 13:54:52.144653 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:52.144625    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 13:54:52.145133 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:52.144906    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 13:54:53.765831 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.765738    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf"]
Jul 24 13:54:53.769545 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.769521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf"
Jul 24 13:54:53.772332 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.772304    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 13:54:53.772473 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.772369    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 13:54:53.772473 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.772433    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-s924h\""
Jul 24 13:54:53.777631 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.777610    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9ph9\" (UniqueName: \"kubernetes.io/projected/f9c9e5a1-9bc4-45bb-9780-bfef75c77f88-kube-api-access-r9ph9\") pod \"kube-auth-proxy-7dc46bdfb5-94swf\" (UID: \"f9c9e5a1-9bc4-45bb-9780-bfef75c77f88\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf"
Jul 24 13:54:53.777751 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.777648    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9c9e5a1-9bc4-45bb-9780-bfef75c77f88-tmp\") pod \"kube-auth-proxy-7dc46bdfb5-94swf\" (UID: \"f9c9e5a1-9bc4-45bb-9780-bfef75c77f88\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf"
Jul 24 13:54:53.777751 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.777679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c9e5a1-9bc4-45bb-9780-bfef75c77f88-tls-certs\") pod \"kube-auth-proxy-7dc46bdfb5-94swf\" (UID: \"f9c9e5a1-9bc4-45bb-9780-bfef75c77f88\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf"
Jul 24 13:54:53.783853 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.783826    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf"]
Jul 24 13:54:53.878528 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.878491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ph9\" (UniqueName: \"kubernetes.io/projected/f9c9e5a1-9bc4-45bb-9780-bfef75c77f88-kube-api-access-r9ph9\") pod \"kube-auth-proxy-7dc46bdfb5-94swf\" (UID: \"f9c9e5a1-9bc4-45bb-9780-bfef75c77f88\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf"
Jul 24 13:54:53.878528 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.878534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9c9e5a1-9bc4-45bb-9780-bfef75c77f88-tmp\") pod \"kube-auth-proxy-7dc46bdfb5-94swf\" (UID: \"f9c9e5a1-9bc4-45bb-9780-bfef75c77f88\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf"
Jul 24 13:54:53.878736 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.878552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c9e5a1-9bc4-45bb-9780-bfef75c77f88-tls-certs\") pod \"kube-auth-proxy-7dc46bdfb5-94swf\" (UID: \"f9c9e5a1-9bc4-45bb-9780-bfef75c77f88\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf"
Jul 24 13:54:53.881045 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.881010    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9c9e5a1-9bc4-45bb-9780-bfef75c77f88-tmp\") pod \"kube-auth-proxy-7dc46bdfb5-94swf\" (UID: \"f9c9e5a1-9bc4-45bb-9780-bfef75c77f88\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf"
Jul 24 13:54:53.881242 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.881221    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9c9e5a1-9bc4-45bb-9780-bfef75c77f88-tls-certs\") pod \"kube-auth-proxy-7dc46bdfb5-94swf\" (UID: \"f9c9e5a1-9bc4-45bb-9780-bfef75c77f88\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf"
Jul 24 13:54:53.888195 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:53.888144    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9ph9\" (UniqueName: \"kubernetes.io/projected/f9c9e5a1-9bc4-45bb-9780-bfef75c77f88-kube-api-access-r9ph9\") pod \"kube-auth-proxy-7dc46bdfb5-94swf\" (UID: \"f9c9e5a1-9bc4-45bb-9780-bfef75c77f88\") " pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf"
Jul 24 13:54:54.079929 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:54.079894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf"
Jul 24 13:54:54.220895 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:54.220868    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf"]
Jul 24 13:54:54.223237 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:54:54.223212    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9c9e5a1_9bc4_45bb_9780_bfef75c77f88.slice/crio-f3111945683cf402c6d7213ee19d3cb2c74865d83dd09ee07692fed3180c5efe WatchSource:0}: Error finding container f3111945683cf402c6d7213ee19d3cb2c74865d83dd09ee07692fed3180c5efe: Status 404 returned error can't find the container with id f3111945683cf402c6d7213ee19d3cb2c74865d83dd09ee07692fed3180c5efe
Jul 24 13:54:54.225097 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:54.225083    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 13:54:54.436424 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:54.436325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6" event={"ID":"54249ca6-3227-4c9d-9f08-38a5d0ea089b","Type":"ContainerStarted","Data":"c4f2a99ab36cb257b7d270f111edf15d8875264f3176091bb278d6e2cb8220c6"}
Jul 24 13:54:54.436713 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:54.436424    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:54:54.437613 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:54.437589    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf" event={"ID":"f9c9e5a1-9bc4-45bb-9780-bfef75c77f88","Type":"ContainerStarted","Data":"f3111945683cf402c6d7213ee19d3cb2c74865d83dd09ee07692fed3180c5efe"}
Jul 24 13:54:54.455405 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:54.455341    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6" podStartSLOduration=1.9334247599999999 podStartE2EDuration="4.455323718s" totalImagesPullingTime="2.521898958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:54:54.453972535 +0000 UTC m=+602.689323922" watchObservedRunningTime="2026-07-24 13:54:54.455323718 +0000 UTC m=+602.690675080"
Jul 24 13:54:57.454359 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:57.454325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf" event={"ID":"f9c9e5a1-9bc4-45bb-9780-bfef75c77f88","Type":"ContainerStarted","Data":"2561a9122b377362ee5f255caf0c22660f75a24ad92f47bcc28adeb2d4ee5c54"}
Jul 24 13:54:57.473857 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:54:57.473800    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7dc46bdfb5-94swf" podStartSLOduration=1.922541164 podStartE2EDuration="4.47378074s" totalImagesPullingTime="2.551239576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:54:57.472055528 +0000 UTC m=+605.707406920" watchObservedRunningTime="2026-07-24 13:54:57.47378074 +0000 UTC m=+605.709132101"
Jul 24 13:55:05.446090 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:55:05.446061    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-84df8c9cc-64xh6"
Jul 24 13:56:22.440948 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:22.440913    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"]
Jul 24 13:56:22.444359 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:22.444341    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"
Jul 24 13:56:22.450916 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:22.450893    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 13:56:22.451292 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:22.451276    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5v9vx\""
Jul 24 13:56:22.451382 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:22.451314    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 13:56:22.464280 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:22.464244    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"]
Jul 24 13:56:22.498137 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:22.498078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb9pm\" (UniqueName: \"kubernetes.io/projected/99056aae-01ee-41a5-b958-681c8b0e1c6e-kube-api-access-nb9pm\") pod \"limitador-operator-controller-manager-859d7b78bd-pkrd6\" (UID: \"99056aae-01ee-41a5-b958-681c8b0e1c6e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"
Jul 24 13:56:22.598646 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:22.598594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb9pm\" (UniqueName: \"kubernetes.io/projected/99056aae-01ee-41a5-b958-681c8b0e1c6e-kube-api-access-nb9pm\") pod \"limitador-operator-controller-manager-859d7b78bd-pkrd6\" (UID: \"99056aae-01ee-41a5-b958-681c8b0e1c6e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"
Jul 24 13:56:22.609636 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:22.609603    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb9pm\" (UniqueName: \"kubernetes.io/projected/99056aae-01ee-41a5-b958-681c8b0e1c6e-kube-api-access-nb9pm\") pod \"limitador-operator-controller-manager-859d7b78bd-pkrd6\" (UID: \"99056aae-01ee-41a5-b958-681c8b0e1c6e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"
Jul 24 13:56:22.755047 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:22.754967    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"
Jul 24 13:56:22.919479 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:22.919434    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"]
Jul 24 13:56:22.922765 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:56:22.922731    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99056aae_01ee_41a5_b958_681c8b0e1c6e.slice/crio-c3e604721f363d2163035cb037414dd43452774ab06204d1bf80aed1ee683302 WatchSource:0}: Error finding container c3e604721f363d2163035cb037414dd43452774ab06204d1bf80aed1ee683302: Status 404 returned error can't find the container with id c3e604721f363d2163035cb037414dd43452774ab06204d1bf80aed1ee683302
Jul 24 13:56:23.846190 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:23.846138    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6" event={"ID":"99056aae-01ee-41a5-b958-681c8b0e1c6e","Type":"ContainerStarted","Data":"c3e604721f363d2163035cb037414dd43452774ab06204d1bf80aed1ee683302"}
Jul 24 13:56:24.851957 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:24.851920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6" event={"ID":"99056aae-01ee-41a5-b958-681c8b0e1c6e","Type":"ContainerStarted","Data":"55a2b9007107574335e41b461377b9adc2b2e0fe2df42dffb07a02deae097e54"}
Jul 24 13:56:24.852419 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:24.852113    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"
Jul 24 13:56:24.878649 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:24.878582    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6" podStartSLOduration=1.160469974 podStartE2EDuration="2.878563192s" totalImagesPullingTime="1.718093218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:56:24.878230289 +0000 UTC m=+693.113581654" watchObservedRunningTime="2026-07-24 13:56:24.878563192 +0000 UTC m=+693.113914555"
Jul 24 13:56:35.860409 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:35.860379    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"
Jul 24 13:56:37.030582 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.030530    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"]
Jul 24 13:56:37.031116 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.030779    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6" podUID="99056aae-01ee-41a5-b958-681c8b0e1c6e" containerName="manager" containerID="cri-o://55a2b9007107574335e41b461377b9adc2b2e0fe2df42dffb07a02deae097e54" gracePeriod=2
Jul 24 13:56:37.037937 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.037913    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"]
Jul 24 13:56:37.054969 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.054939    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-px5lk"]
Jul 24 13:56:37.055354 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.055335    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99056aae-01ee-41a5-b958-681c8b0e1c6e" containerName="manager"
Jul 24 13:56:37.055354 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.055353    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="99056aae-01ee-41a5-b958-681c8b0e1c6e" containerName="manager"
Jul 24 13:56:37.055530 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.055402    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="99056aae-01ee-41a5-b958-681c8b0e1c6e" containerName="manager"
Jul 24 13:56:37.058486 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.058465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-px5lk"
Jul 24 13:56:37.073345 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.073316    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-px5lk"]
Jul 24 13:56:37.097405 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:56:37.097367    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pkrd6\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="99056aae-01ee-41a5-b958-681c8b0e1c6e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"
Jul 24 13:56:37.138280 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.138219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klhzs\" (UniqueName: \"kubernetes.io/projected/75b1c394-47cb-4b23-99c9-0ee39f528949-kube-api-access-klhzs\") pod \"limitador-operator-controller-manager-859d7b78bd-px5lk\" (UID: \"75b1c394-47cb-4b23-99c9-0ee39f528949\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-px5lk"
Jul 24 13:56:37.239276 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.239233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klhzs\" (UniqueName: \"kubernetes.io/projected/75b1c394-47cb-4b23-99c9-0ee39f528949-kube-api-access-klhzs\") pod \"limitador-operator-controller-manager-859d7b78bd-px5lk\" (UID: \"75b1c394-47cb-4b23-99c9-0ee39f528949\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-px5lk"
Jul 24 13:56:37.247903 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.247873    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klhzs\" (UniqueName: \"kubernetes.io/projected/75b1c394-47cb-4b23-99c9-0ee39f528949-kube-api-access-klhzs\") pod \"limitador-operator-controller-manager-859d7b78bd-px5lk\" (UID: \"75b1c394-47cb-4b23-99c9-0ee39f528949\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-px5lk"
Jul 24 13:56:37.280617 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.280559    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"
Jul 24 13:56:37.282756 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:56:37.282729    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pkrd6\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="99056aae-01ee-41a5-b958-681c8b0e1c6e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"
Jul 24 13:56:37.339753 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.339714    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb9pm\" (UniqueName: \"kubernetes.io/projected/99056aae-01ee-41a5-b958-681c8b0e1c6e-kube-api-access-nb9pm\") pod \"99056aae-01ee-41a5-b958-681c8b0e1c6e\" (UID: \"99056aae-01ee-41a5-b958-681c8b0e1c6e\") "
Jul 24 13:56:37.342135 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.342101    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99056aae-01ee-41a5-b958-681c8b0e1c6e-kube-api-access-nb9pm" (OuterVolumeSpecName: "kube-api-access-nb9pm") pod "99056aae-01ee-41a5-b958-681c8b0e1c6e" (UID: "99056aae-01ee-41a5-b958-681c8b0e1c6e"). InnerVolumeSpecName "kube-api-access-nb9pm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:56:37.414898 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.414865    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-px5lk"
Jul 24 13:56:37.441061 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.441024    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb9pm\" (UniqueName: \"kubernetes.io/projected/99056aae-01ee-41a5-b958-681c8b0e1c6e-kube-api-access-nb9pm\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:56:37.573053 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.573029    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-px5lk"]
Jul 24 13:56:37.575263 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:56:37.575239    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b1c394_47cb_4b23_99c9_0ee39f528949.slice/crio-434950768e17583970faccebdc9c2f0c13bf93d511d16ae3cda39c57c40e4165 WatchSource:0}: Error finding container 434950768e17583970faccebdc9c2f0c13bf93d511d16ae3cda39c57c40e4165: Status 404 returned error can't find the container with id 434950768e17583970faccebdc9c2f0c13bf93d511d16ae3cda39c57c40e4165
Jul 24 13:56:37.919306 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.919207    2565 generic.go:356] "Generic (PLEG): container finished" podID="99056aae-01ee-41a5-b958-681c8b0e1c6e" containerID="55a2b9007107574335e41b461377b9adc2b2e0fe2df42dffb07a02deae097e54" exitCode=0
Jul 24 13:56:37.919474 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.919327    2565 scope.go:117] "RemoveContainer" containerID="55a2b9007107574335e41b461377b9adc2b2e0fe2df42dffb07a02deae097e54"
Jul 24 13:56:37.919474 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.919331    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"
Jul 24 13:56:37.921276 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.921236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-px5lk" event={"ID":"75b1c394-47cb-4b23-99c9-0ee39f528949","Type":"ContainerStarted","Data":"dd1d4901643743bb090b49b4ab6e7ac6f2bb0518c72ca7a7064131bcb72e3903"}
Jul 24 13:56:37.921418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.921315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-px5lk" event={"ID":"75b1c394-47cb-4b23-99c9-0ee39f528949","Type":"ContainerStarted","Data":"434950768e17583970faccebdc9c2f0c13bf93d511d16ae3cda39c57c40e4165"}
Jul 24 13:56:37.921418 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.921346    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-px5lk"
Jul 24 13:56:37.921819 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:56:37.921798    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pkrd6\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="99056aae-01ee-41a5-b958-681c8b0e1c6e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"
Jul 24 13:56:37.928901 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.928883    2565 scope.go:117] "RemoveContainer" containerID="55a2b9007107574335e41b461377b9adc2b2e0fe2df42dffb07a02deae097e54"
Jul 24 13:56:37.929157 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:56:37.929138    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55a2b9007107574335e41b461377b9adc2b2e0fe2df42dffb07a02deae097e54\": container with ID starting with 55a2b9007107574335e41b461377b9adc2b2e0fe2df42dffb07a02deae097e54 not found: ID does not exist" containerID="55a2b9007107574335e41b461377b9adc2b2e0fe2df42dffb07a02deae097e54"
Jul 24 13:56:37.929222 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.929167    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55a2b9007107574335e41b461377b9adc2b2e0fe2df42dffb07a02deae097e54"} err="failed to get container status \"55a2b9007107574335e41b461377b9adc2b2e0fe2df42dffb07a02deae097e54\": rpc error: code = NotFound desc = could not find container \"55a2b9007107574335e41b461377b9adc2b2e0fe2df42dffb07a02deae097e54\": container with ID starting with 55a2b9007107574335e41b461377b9adc2b2e0fe2df42dffb07a02deae097e54 not found: ID does not exist"
Jul 24 13:56:37.941362 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:37.941316    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-px5lk" podStartSLOduration=0.941302679 podStartE2EDuration="941.302679ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:56:37.939525257 +0000 UTC m=+706.174876623" watchObservedRunningTime="2026-07-24 13:56:37.941302679 +0000 UTC m=+706.176654040"
Jul 24 13:56:37.942002 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:56:37.941978    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pkrd6\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="99056aae-01ee-41a5-b958-681c8b0e1c6e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"
Jul 24 13:56:37.944153 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:56:37.944123    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pkrd6\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="99056aae-01ee-41a5-b958-681c8b0e1c6e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pkrd6"
Jul 24 13:56:38.195726 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:38.195646    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99056aae-01ee-41a5-b958-681c8b0e1c6e" path="/var/lib/kubelet/pods/99056aae-01ee-41a5-b958-681c8b0e1c6e/volumes"
Jul 24 13:56:48.929208 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:56:48.929107    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-px5lk"
Jul 24 13:57:17.564313 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:17.564277    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 13:57:17.568113 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:17.568083    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"
Jul 24 13:57:17.570642 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:17.570610    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x5xxb\""
Jul 24 13:57:17.570778 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:17.570610    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 13:57:17.577794 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:17.577761    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 13:57:17.649796 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:17.649749    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 13:57:17.687708 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:17.687663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fvsm\" (UniqueName: \"kubernetes.io/projected/09c12881-7166-4bf5-a0fb-ccdf74441675-kube-api-access-4fvsm\") pod \"limitador-limitador-54d6d988d5-m8mw6\" (UID: \"09c12881-7166-4bf5-a0fb-ccdf74441675\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"
Jul 24 13:57:17.687899 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:17.687778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/09c12881-7166-4bf5-a0fb-ccdf74441675-config-file\") pod \"limitador-limitador-54d6d988d5-m8mw6\" (UID: \"09c12881-7166-4bf5-a0fb-ccdf74441675\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"
Jul 24 13:57:17.789032 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:17.788993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/09c12881-7166-4bf5-a0fb-ccdf74441675-config-file\") pod \"limitador-limitador-54d6d988d5-m8mw6\" (UID: \"09c12881-7166-4bf5-a0fb-ccdf74441675\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"
Jul 24 13:57:17.789269 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:17.789064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fvsm\" (UniqueName: \"kubernetes.io/projected/09c12881-7166-4bf5-a0fb-ccdf74441675-kube-api-access-4fvsm\") pod \"limitador-limitador-54d6d988d5-m8mw6\" (UID: \"09c12881-7166-4bf5-a0fb-ccdf74441675\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"
Jul 24 13:57:17.789753 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:17.789726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/09c12881-7166-4bf5-a0fb-ccdf74441675-config-file\") pod \"limitador-limitador-54d6d988d5-m8mw6\" (UID: \"09c12881-7166-4bf5-a0fb-ccdf74441675\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"
Jul 24 13:57:17.798963 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:17.798938    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fvsm\" (UniqueName: \"kubernetes.io/projected/09c12881-7166-4bf5-a0fb-ccdf74441675-kube-api-access-4fvsm\") pod \"limitador-limitador-54d6d988d5-m8mw6\" (UID: \"09c12881-7166-4bf5-a0fb-ccdf74441675\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"
Jul 24 13:57:17.880764 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:17.880659    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"
Jul 24 13:57:18.024662 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:18.024626    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 13:57:18.027980 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:57:18.027953    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c12881_7166_4bf5_a0fb_ccdf74441675.slice/crio-04baeafa721f8fcbbac56491ab2252623370ae200ab4fa54b860414b72c0481f WatchSource:0}: Error finding container 04baeafa721f8fcbbac56491ab2252623370ae200ab4fa54b860414b72c0481f: Status 404 returned error can't find the container with id 04baeafa721f8fcbbac56491ab2252623370ae200ab4fa54b860414b72c0481f
Jul 24 13:57:18.108075 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:18.108039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8mw6" event={"ID":"09c12881-7166-4bf5-a0fb-ccdf74441675","Type":"ContainerStarted","Data":"04baeafa721f8fcbbac56491ab2252623370ae200ab4fa54b860414b72c0481f"}
Jul 24 13:57:21.124502 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:21.124467    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8mw6" event={"ID":"09c12881-7166-4bf5-a0fb-ccdf74441675","Type":"ContainerStarted","Data":"8e5468434cf4d0cb09a63c16745ee312e5d0f6c18f7487612f5e04b2fc3fbe98"}
Jul 24 13:57:21.124881 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:21.124545    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"
Jul 24 13:57:21.148355 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:21.148305    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8mw6" podStartSLOduration=1.602290216 podStartE2EDuration="4.148288464s" totalImagesPullingTime="2.545998248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:57:21.146278139 +0000 UTC m=+749.381629704" watchObservedRunningTime="2026-07-24 13:57:21.148288464 +0000 UTC m=+749.383639826"
Jul 24 13:57:32.129840 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:32.129808    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"
Jul 24 13:57:46.797159 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:46.797125    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-jg84x"]
Jul 24 13:57:46.803823 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:46.803804    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-jg84x"
Jul 24 13:57:46.806442 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:46.806421    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 24 13:57:46.806548 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:46.806419    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cdggs\""
Jul 24 13:57:46.807157 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:46.807137    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-jg84x"]
Jul 24 13:57:46.847629 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:46.847595    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-jg84x"]
Jul 24 13:57:46.847893 ip-10-0-132-200 kubenswrapper[2565]: E0724 13:57:46.847872    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-794cc tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-794cc tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-jg84x" podUID="99c50011-12a3-4185-b3c3-ce5f3299a697"
Jul 24 13:57:46.954358 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:46.954326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99c50011-12a3-4185-b3c3-ce5f3299a697-tls-cert\") pod \"authorino-76877994-jg84x\" (UID: \"99c50011-12a3-4185-b3c3-ce5f3299a697\") " pod="kuadrant-system/authorino-76877994-jg84x"
Jul 24 13:57:46.954513 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:46.954370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-794cc\" (UniqueName: \"kubernetes.io/projected/99c50011-12a3-4185-b3c3-ce5f3299a697-kube-api-access-794cc\") pod \"authorino-76877994-jg84x\" (UID: \"99c50011-12a3-4185-b3c3-ce5f3299a697\") " pod="kuadrant-system/authorino-76877994-jg84x"
Jul 24 13:57:47.055545 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:47.055510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99c50011-12a3-4185-b3c3-ce5f3299a697-tls-cert\") pod \"authorino-76877994-jg84x\" (UID: \"99c50011-12a3-4185-b3c3-ce5f3299a697\") " pod="kuadrant-system/authorino-76877994-jg84x"
Jul 24 13:57:47.055703 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:47.055549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-794cc\" (UniqueName: \"kubernetes.io/projected/99c50011-12a3-4185-b3c3-ce5f3299a697-kube-api-access-794cc\") pod \"authorino-76877994-jg84x\" (UID: \"99c50011-12a3-4185-b3c3-ce5f3299a697\") " pod="kuadrant-system/authorino-76877994-jg84x"
Jul 24 13:57:47.058080 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:47.058050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99c50011-12a3-4185-b3c3-ce5f3299a697-tls-cert\") pod \"authorino-76877994-jg84x\" (UID: \"99c50011-12a3-4185-b3c3-ce5f3299a697\") " pod="kuadrant-system/authorino-76877994-jg84x"
Jul 24 13:57:47.068184 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:47.068153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-794cc\" (UniqueName: \"kubernetes.io/projected/99c50011-12a3-4185-b3c3-ce5f3299a697-kube-api-access-794cc\") pod \"authorino-76877994-jg84x\" (UID: \"99c50011-12a3-4185-b3c3-ce5f3299a697\") " pod="kuadrant-system/authorino-76877994-jg84x"
Jul 24 13:57:47.238682 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:47.238650    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-jg84x"
Jul 24 13:57:47.246966 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:47.246933    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-jg84x"
Jul 24 13:57:47.358345 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:47.358247    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99c50011-12a3-4185-b3c3-ce5f3299a697-tls-cert\") pod \"99c50011-12a3-4185-b3c3-ce5f3299a697\" (UID: \"99c50011-12a3-4185-b3c3-ce5f3299a697\") "
Jul 24 13:57:47.358345 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:47.358300    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-794cc\" (UniqueName: \"kubernetes.io/projected/99c50011-12a3-4185-b3c3-ce5f3299a697-kube-api-access-794cc\") pod \"99c50011-12a3-4185-b3c3-ce5f3299a697\" (UID: \"99c50011-12a3-4185-b3c3-ce5f3299a697\") "
Jul 24 13:57:47.360586 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:47.360555    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99c50011-12a3-4185-b3c3-ce5f3299a697-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "99c50011-12a3-4185-b3c3-ce5f3299a697" (UID: "99c50011-12a3-4185-b3c3-ce5f3299a697"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:57:47.360705 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:47.360605    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99c50011-12a3-4185-b3c3-ce5f3299a697-kube-api-access-794cc" (OuterVolumeSpecName: "kube-api-access-794cc") pod "99c50011-12a3-4185-b3c3-ce5f3299a697" (UID: "99c50011-12a3-4185-b3c3-ce5f3299a697"). InnerVolumeSpecName "kube-api-access-794cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:57:47.460139 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:47.460103    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99c50011-12a3-4185-b3c3-ce5f3299a697-tls-cert\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:57:47.460139 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:47.460133    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-794cc\" (UniqueName: \"kubernetes.io/projected/99c50011-12a3-4185-b3c3-ce5f3299a697-kube-api-access-794cc\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 13:57:48.243797 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:48.243755    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-jg84x"
Jul 24 13:57:48.270422 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:48.270391    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-jg84x"]
Jul 24 13:57:48.274050 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:48.274026    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-jg84x"]
Jul 24 13:57:50.194506 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:57:50.194472    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99c50011-12a3-4185-b3c3-ce5f3299a697" path="/var/lib/kubelet/pods/99c50011-12a3-4185-b3c3-ce5f3299a697/volumes"
Jul 24 13:58:29.842345 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:58:29.842306    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 13:58:54.049600 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:58:54.049564    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 13:59:06.141284 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:06.141246    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 13:59:25.937953 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:25.937920    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 13:59:37.040030 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:37.039991    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 13:59:38.040478 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.040445    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"]
Jul 24 13:59:38.044006 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.043984    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.046701 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.046674    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xl92g\""
Jul 24 13:59:38.046821 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.046781    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 13:59:38.047641 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.047624    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 13:59:38.047735 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.047717    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 24 13:59:38.054754 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.054731    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"]
Jul 24 13:59:38.152930 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.152890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef9828da-317a-4cfb-9312-cacb9b5f6867-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.152930 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.152927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef9828da-317a-4cfb-9312-cacb9b5f6867-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.153138 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.152991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef9828da-317a-4cfb-9312-cacb9b5f6867-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.153138 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.153071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef9828da-317a-4cfb-9312-cacb9b5f6867-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.153138 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.153089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm6w8\" (UniqueName: \"kubernetes.io/projected/ef9828da-317a-4cfb-9312-cacb9b5f6867-kube-api-access-bm6w8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.153267 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.153152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef9828da-317a-4cfb-9312-cacb9b5f6867-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.253988 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.253949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef9828da-317a-4cfb-9312-cacb9b5f6867-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.253988 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.253989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm6w8\" (UniqueName: \"kubernetes.io/projected/ef9828da-317a-4cfb-9312-cacb9b5f6867-kube-api-access-bm6w8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.254235 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.254131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef9828da-317a-4cfb-9312-cacb9b5f6867-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.254280 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.254239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef9828da-317a-4cfb-9312-cacb9b5f6867-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.254280 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.254272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef9828da-317a-4cfb-9312-cacb9b5f6867-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.254352 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.254326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef9828da-317a-4cfb-9312-cacb9b5f6867-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.254486 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.254465    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef9828da-317a-4cfb-9312-cacb9b5f6867-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.254565 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.254496    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef9828da-317a-4cfb-9312-cacb9b5f6867-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.254692 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.254669    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef9828da-317a-4cfb-9312-cacb9b5f6867-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.256521 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.256502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef9828da-317a-4cfb-9312-cacb9b5f6867-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.256679 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.256662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef9828da-317a-4cfb-9312-cacb9b5f6867-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.262037 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.262015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm6w8\" (UniqueName: \"kubernetes.io/projected/ef9828da-317a-4cfb-9312-cacb9b5f6867-kube-api-access-bm6w8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mqrv4\" (UID: \"ef9828da-317a-4cfb-9312-cacb9b5f6867\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.377090 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.377049    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:38.513580 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.513551    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"]
Jul 24 13:59:38.515981 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:59:38.515936    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9828da_317a_4cfb_9312_cacb9b5f6867.slice/crio-abaaf21461c21ae95059abac7c46460d21f7f7d30bb31b7810d1d7246dbfcbb9 WatchSource:0}: Error finding container abaaf21461c21ae95059abac7c46460d21f7f7d30bb31b7810d1d7246dbfcbb9: Status 404 returned error can't find the container with id abaaf21461c21ae95059abac7c46460d21f7f7d30bb31b7810d1d7246dbfcbb9
Jul 24 13:59:38.744045 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:38.743970    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4" event={"ID":"ef9828da-317a-4cfb-9312-cacb9b5f6867","Type":"ContainerStarted","Data":"abaaf21461c21ae95059abac7c46460d21f7f7d30bb31b7810d1d7246dbfcbb9"}
Jul 24 13:59:39.750562 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:39.750516    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4" event={"ID":"ef9828da-317a-4cfb-9312-cacb9b5f6867","Type":"ContainerStarted","Data":"d9bf69fe7a8fae4dc0920a8545e79abc15651ab01911c94ae97a3ca74c7c2948"}
Jul 24 13:59:39.771142 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:39.771089    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4" podStartSLOduration=0.723782148 podStartE2EDuration="1.771073747s" totalImagesPullingTime="1.047291599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:59:39.76894854 +0000 UTC m=+888.004299903" watchObservedRunningTime="2026-07-24 13:59:39.771073747 +0000 UTC m=+888.006425153"
Jul 24 13:59:45.639143 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:45.639056    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 13:59:48.378131 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:48.378098    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:48.378550 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:48.378428    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:48.390665 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:48.390640    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:48.802107 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:48.802085    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mqrv4"
Jul 24 13:59:52.187506 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:52.187475    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 13:59:52.189434 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:52.189406    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 13:59:55.956607 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:55.956575    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"]
Jul 24 13:59:55.959825 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:55.959809    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:55.962387 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:55.962369    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 24 13:59:55.974430 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:55.974402    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"]
Jul 24 13:59:56.114723 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.114686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.114723 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.114730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vknfd\" (UniqueName: \"kubernetes.io/projected/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-kube-api-access-vknfd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.115005 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.114779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.115005 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.114848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.115005 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.114927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.115141 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.115034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.215692 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.215608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.215692 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.215652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.215692 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.215673    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.215958 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.215714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.215958 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.215736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.215958 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.215757    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vknfd\" (UniqueName: \"kubernetes.io/projected/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-kube-api-access-vknfd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.216125 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.216086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.216211 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.216140    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.216257 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.216212    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.218148 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.218127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.218373 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.218357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.225076 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.225053    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vknfd\" (UniqueName: \"kubernetes.io/projected/7c8d8313-d5e9-48c3-a9c8-d7db668a05d1-kube-api-access-vknfd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2\" (UID: \"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.276793 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.276754    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 13:59:56.413058 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.413032    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"]
Jul 24 13:59:56.415337 ip-10-0-132-200 kubenswrapper[2565]: W0724 13:59:56.415310    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c8d8313_d5e9_48c3_a9c8_d7db668a05d1.slice/crio-825caf662503e422555306019d6bfe3526635539e82292c05fa862ac13475849 WatchSource:0}: Error finding container 825caf662503e422555306019d6bfe3526635539e82292c05fa862ac13475849: Status 404 returned error can't find the container with id 825caf662503e422555306019d6bfe3526635539e82292c05fa862ac13475849
Jul 24 13:59:56.416904 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.416881    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 13:59:56.829057 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.829024    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2" event={"ID":"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1","Type":"ContainerStarted","Data":"a76774328c27c17692b9083d7bc0680aac5c03864e914554d397509c0dd3ad2b"}
Jul 24 13:59:56.829261 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.829067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2" event={"ID":"7c8d8313-d5e9-48c3-a9c8-d7db668a05d1","Type":"ContainerStarted","Data":"825caf662503e422555306019d6bfe3526635539e82292c05fa862ac13475849"}
Jul 24 13:59:56.845022 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:56.844974    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2" podStartSLOduration=1.626334551 podStartE2EDuration="1.84495231s" totalImagesPullingTime="218.617759ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:59:56.84459962 +0000 UTC m=+905.079950984" watchObservedRunningTime="2026-07-24 13:59:56.84495231 +0000 UTC m=+905.080303673"
Jul 24 13:59:58.946139 ip-10-0-132-200 kubenswrapper[2565]: I0724 13:59:58.946104    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:00:06.277692 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:00:06.277652    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 14:00:06.278106 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:00:06.277801    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 14:00:06.290195 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:00:06.290144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 14:00:06.887086 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:00:06.887056    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2"
Jul 24 14:01:22.448234 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:01:22.448199    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:01:32.944363 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:01:32.944326    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:01:43.346694 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:01:43.346654    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:03:24.076282 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:03:24.076244    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:03:33.540415 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:03:33.540369    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:04:03.841731 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:04:03.841695    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:04:12.944046 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:04:12.943960    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:04:21.547294 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:04:21.547253    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:04:33.242711 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:04:33.242672    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:04:44.455405 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:04:44.455368    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:04:52.216817 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:04:52.216790    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:04:52.219947 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:04:52.219924    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:04:56.754918 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:04:56.754879    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:05:07.938096 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:05:07.938062    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:05:17.757263 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:05:17.757229    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:05:39.757306 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:05:39.757271    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:05:51.645567 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:05:51.645480    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:06:14.351144 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:06:14.351105    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:06:27.748872 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:06:27.748823    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:06:42.348081 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:06:42.348047    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:06:54.250351 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:06:54.250311    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:07:08.256020 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:07:08.255982    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:09:10.844508 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:09:10.844428    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:09:23.040329 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:09:23.040288    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:09:31.852655 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:09:31.852609    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:09:46.054627 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:09:46.054586    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:09:52.247766 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:09:52.247726    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:09:52.251837 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:09:52.251818    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:09:55.641322 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:09:55.641290    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:10:06.752775 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:10:06.752741    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:10:14.951306 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:10:14.951038    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:10:26.150654 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:10:26.150613    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:10:37.045135 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:10:37.045089    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:10:46.153522 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:10:46.153483    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:10:56.946399 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:10:56.946357    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:11:21.446852 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:21.446812    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:11:28.750081 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:28.750030    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:11:31.371083 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.371035    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"]
Jul 24 14:11:31.374695 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.374672    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.379573 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.379548    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-ed376eca-kserve-self-signed-certs\""
Jul 24 14:11:31.406578 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.406547    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"]
Jul 24 14:11:31.539152 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.539113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh2jj\" (UniqueName: \"kubernetes.io/projected/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-kube-api-access-nh2jj\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.539152 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.539154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-home\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.539419 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.539204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-tmp-dir\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.539419 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.539244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-tls-certs\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.539419 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.539305    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-model-cache\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.539419 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.539408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-dshm\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.640459 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.640358    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-dshm\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.640459 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.640415    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh2jj\" (UniqueName: \"kubernetes.io/projected/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-kube-api-access-nh2jj\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.640459 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.640442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-home\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.640740 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.640473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-tmp-dir\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.640740 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.640495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-tls-certs\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.640740 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.640528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-model-cache\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.640944 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.640920    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-home\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.641007 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.640954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-tmp-dir\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.641007 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.640966    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-model-cache\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.642873 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.642851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-dshm\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.643146 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.643128    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-tls-certs\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.649571 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.649546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh2jj\" (UniqueName: \"kubernetes.io/projected/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-kube-api-access-nh2jj\") pod \"e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") " pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.683667 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.683635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:31.825751 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:31.825723    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"]
Jul 24 14:11:31.828363 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:11:31.828336    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf0ad9d6_faa4_4374_890f_7dc4c95ac6c1.slice/crio-cd97a0a70e9286dcb3fa0a4c6c0c656a088d37c08affbfd809ea4fbfda405081 WatchSource:0}: Error finding container cd97a0a70e9286dcb3fa0a4c6c0c656a088d37c08affbfd809ea4fbfda405081: Status 404 returned error can't find the container with id cd97a0a70e9286dcb3fa0a4c6c0c656a088d37c08affbfd809ea4fbfda405081
Jul 24 14:11:32.040374 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:32.040331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg" event={"ID":"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1","Type":"ContainerStarted","Data":"eab6f8996f224143e51118c8cae7b693c5e3e1b8625583d07948eb7a3acbf458"}
Jul 24 14:11:32.040579 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:32.040384    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg" event={"ID":"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1","Type":"ContainerStarted","Data":"cd97a0a70e9286dcb3fa0a4c6c0c656a088d37c08affbfd809ea4fbfda405081"}
Jul 24 14:11:32.068133 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:32.068073    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg" podStartSLOduration=1.068056813 podStartE2EDuration="1.068056813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:11:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:11:32.066877961 +0000 UTC m=+1600.302229322" watchObservedRunningTime="2026-07-24 14:11:32.068056813 +0000 UTC m=+1600.303408152"
Jul 24 14:11:35.640551 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.640511    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"]
Jul 24 14:11:35.644192 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.644152    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.650197 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.650154    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-ed376eca-kserve-self-signed-certs\""
Jul 24 14:11:35.660926 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.660902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"]
Jul 24 14:11:35.776217 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.776150    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5nwg\" (UniqueName: \"kubernetes.io/projected/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-kube-api-access-c5nwg\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.776420 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.776263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-tls-certs\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.776420 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.776312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-dshm\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.776420 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.776329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-tmp-dir\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.776420 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.776347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-model-cache\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.776575 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.776468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-home\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.877163 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.877121    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-model-cache\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.877360 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.877244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-home\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.877360 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.877291    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5nwg\" (UniqueName: \"kubernetes.io/projected/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-kube-api-access-c5nwg\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.877360 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.877327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-tls-certs\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.877515 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.877368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-dshm\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.877515 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.877394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-tmp-dir\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.877615 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.877571    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-model-cache\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.877665 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.877633    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-home\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.877665 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.877658    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-tmp-dir\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.879800 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.879780    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-dshm\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.880107 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.880085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-tls-certs\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.886362 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.886337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5nwg\" (UniqueName: \"kubernetes.io/projected/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-kube-api-access-c5nwg\") pod \"e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") " pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:35.953613 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:35.953524    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:36.096805 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:36.096616    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"]
Jul 24 14:11:36.099096 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:11:36.099070    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53cf5bb1_e6e4_47b6_9bd5_9e0eda73331e.slice/crio-58be74b4e10463c899af75f57aade9dbb2ddc5f96b821d2a00b21e37acf99098 WatchSource:0}: Error finding container 58be74b4e10463c899af75f57aade9dbb2ddc5f96b821d2a00b21e37acf99098: Status 404 returned error can't find the container with id 58be74b4e10463c899af75f57aade9dbb2ddc5f96b821d2a00b21e37acf99098
Jul 24 14:11:37.068599 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:37.068568    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q" event={"ID":"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e","Type":"ContainerStarted","Data":"6e41c3d2848cf70471623f6be887132b40df42489b59bc49429ef2d50b9967c5"}
Jul 24 14:11:37.068975 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:37.068608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q" event={"ID":"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e","Type":"ContainerStarted","Data":"58be74b4e10463c899af75f57aade9dbb2ddc5f96b821d2a00b21e37acf99098"}
Jul 24 14:11:37.090355 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:37.090301    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q" podStartSLOduration=2.090285015 podStartE2EDuration="2.090285015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:11:37.088202878 +0000 UTC m=+1605.323554231" watchObservedRunningTime="2026-07-24 14:11:37.090285015 +0000 UTC m=+1605.325636377"
Jul 24 14:11:41.683961 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:41.683862    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:41.683961 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:41.683932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:41.697013 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:41.696982    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:42.102870 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:42.102841    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:11:43.447868 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:43.447830    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:11:45.954610 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:45.954552    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:45.954610 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:45.954624    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:45.967261 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:45.967237    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:11:46.121504 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:11:46.121475    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:12:24.420308 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:24.420275    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"]
Jul 24 14:12:25.589786 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:25.589746    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"]
Jul 24 14:12:28.453481 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:28.453443    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:12:39.440221 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.440152    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg" podUID="bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1" containerName="main" containerID="cri-o://eab6f8996f224143e51118c8cae7b693c5e3e1b8625583d07948eb7a3acbf458" gracePeriod=45
Jul 24 14:12:39.691445 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.691377    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:12:39.775887 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.775854    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-tls-certs\") pod \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") "
Jul 24 14:12:39.775887 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.775890    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-dshm\") pod \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") "
Jul 24 14:12:39.776157 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.775946    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-model-cache\") pod \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") "
Jul 24 14:12:39.776157 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.776059    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-tmp-dir\") pod \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") "
Jul 24 14:12:39.776312 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.776161    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nh2jj\" (UniqueName: \"kubernetes.io/projected/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-kube-api-access-nh2jj\") pod \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") "
Jul 24 14:12:39.776312 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.776262    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-home\") pod \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\" (UID: \"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1\") "
Jul 24 14:12:39.776409 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.776261    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-model-cache" (OuterVolumeSpecName: "model-cache") pod "bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1" (UID: "bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:12:39.776450 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.776344    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1" (UID: "bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:12:39.776450 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.776442    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-home" (OuterVolumeSpecName: "home") pod "bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1" (UID: "bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:12:39.776613 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.776597    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-model-cache\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:12:39.776650 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.776619    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-tmp-dir\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:12:39.776650 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.776630    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-home\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:12:39.778622 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.778596    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1" (UID: "bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:12:39.778622 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.778608    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-dshm" (OuterVolumeSpecName: "dshm") pod "bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1" (UID: "bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:12:39.778769 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.778635    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-kube-api-access-nh2jj" (OuterVolumeSpecName: "kube-api-access-nh2jj") pod "bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1" (UID: "bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1"). InnerVolumeSpecName "kube-api-access-nh2jj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:12:39.877284 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.877238    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nh2jj\" (UniqueName: \"kubernetes.io/projected/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-kube-api-access-nh2jj\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:12:39.877284 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.877277    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-tls-certs\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:12:39.877284 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:39.877289    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1-dshm\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:12:40.366392 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.366356    2565 generic.go:356] "Generic (PLEG): container finished" podID="bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1" containerID="eab6f8996f224143e51118c8cae7b693c5e3e1b8625583d07948eb7a3acbf458" exitCode=0
Jul 24 14:12:40.366584 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.366418    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"
Jul 24 14:12:40.366584 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.366430    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg" event={"ID":"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1","Type":"ContainerDied","Data":"eab6f8996f224143e51118c8cae7b693c5e3e1b8625583d07948eb7a3acbf458"}
Jul 24 14:12:40.366584 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.366472    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg" event={"ID":"bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1","Type":"ContainerDied","Data":"cd97a0a70e9286dcb3fa0a4c6c0c656a088d37c08affbfd809ea4fbfda405081"}
Jul 24 14:12:40.366584 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.366493    2565 scope.go:117] "RemoveContainer" containerID="eab6f8996f224143e51118c8cae7b693c5e3e1b8625583d07948eb7a3acbf458"
Jul 24 14:12:40.377547 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.377520    2565 scope.go:117] "RemoveContainer" containerID="eab6f8996f224143e51118c8cae7b693c5e3e1b8625583d07948eb7a3acbf458"
Jul 24 14:12:40.378025 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:12:40.378000    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab6f8996f224143e51118c8cae7b693c5e3e1b8625583d07948eb7a3acbf458\": container with ID starting with eab6f8996f224143e51118c8cae7b693c5e3e1b8625583d07948eb7a3acbf458 not found: ID does not exist" containerID="eab6f8996f224143e51118c8cae7b693c5e3e1b8625583d07948eb7a3acbf458"
Jul 24 14:12:40.378073 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.378038    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab6f8996f224143e51118c8cae7b693c5e3e1b8625583d07948eb7a3acbf458"} err="failed to get container status \"eab6f8996f224143e51118c8cae7b693c5e3e1b8625583d07948eb7a3acbf458\": rpc error: code = NotFound desc = could not find container \"eab6f8996f224143e51118c8cae7b693c5e3e1b8625583d07948eb7a3acbf458\": container with ID starting with eab6f8996f224143e51118c8cae7b693c5e3e1b8625583d07948eb7a3acbf458 not found: ID does not exist"
Jul 24 14:12:40.401157 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.401127    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"]
Jul 24 14:12:40.413449 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.413413    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-ed376eca-kserve-6d67d97c59-4tkqg"]
Jul 24 14:12:40.609637 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.609587    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q" podUID="53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e" containerName="main" containerID="cri-o://6e41c3d2848cf70471623f6be887132b40df42489b59bc49429ef2d50b9967c5" gracePeriod=45
Jul 24 14:12:40.864263 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.864200    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:12:40.987488 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.987451    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5nwg\" (UniqueName: \"kubernetes.io/projected/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-kube-api-access-c5nwg\") pod \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") "
Jul 24 14:12:40.987488 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.987488    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-tls-certs\") pod \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") "
Jul 24 14:12:40.987710 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.987585    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-home\") pod \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") "
Jul 24 14:12:40.987710 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.987635    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-tmp-dir\") pod \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") "
Jul 24 14:12:40.987710 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.987665    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-dshm\") pod \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") "
Jul 24 14:12:40.987710 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.987702    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-model-cache\") pod \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\" (UID: \"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e\") "
Jul 24 14:12:40.987963 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.987923    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-home" (OuterVolumeSpecName: "home") pod "53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e" (UID: "53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:12:40.987963 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.987951    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e" (UID: "53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:12:40.988147 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.988028    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-model-cache" (OuterVolumeSpecName: "model-cache") pod "53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e" (UID: "53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:12:40.989836 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.989805    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-dshm" (OuterVolumeSpecName: "dshm") pod "53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e" (UID: "53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:12:40.989906 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.989853    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e" (UID: "53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:12:40.989906 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:40.989872    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-kube-api-access-c5nwg" (OuterVolumeSpecName: "kube-api-access-c5nwg") pod "53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e" (UID: "53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e"). InnerVolumeSpecName "kube-api-access-c5nwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:12:41.088577 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.088539    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-home\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:12:41.088746 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.088590    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-tmp-dir\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:12:41.088746 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.088601    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-dshm\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:12:41.088746 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.088609    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-model-cache\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:12:41.088746 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.088618    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5nwg\" (UniqueName: \"kubernetes.io/projected/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-kube-api-access-c5nwg\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:12:41.088746 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.088627    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e-tls-certs\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:12:41.372074 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.372043    2565 generic.go:356] "Generic (PLEG): container finished" podID="53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e" containerID="6e41c3d2848cf70471623f6be887132b40df42489b59bc49429ef2d50b9967c5" exitCode=0
Jul 24 14:12:41.372300 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.372088    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"
Jul 24 14:12:41.372300 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.372139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q" event={"ID":"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e","Type":"ContainerDied","Data":"6e41c3d2848cf70471623f6be887132b40df42489b59bc49429ef2d50b9967c5"}
Jul 24 14:12:41.372300 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.372211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q" event={"ID":"53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e","Type":"ContainerDied","Data":"58be74b4e10463c899af75f57aade9dbb2ddc5f96b821d2a00b21e37acf99098"}
Jul 24 14:12:41.372300 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.372236    2565 scope.go:117] "RemoveContainer" containerID="6e41c3d2848cf70471623f6be887132b40df42489b59bc49429ef2d50b9967c5"
Jul 24 14:12:41.381978 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.381955    2565 scope.go:117] "RemoveContainer" containerID="6e41c3d2848cf70471623f6be887132b40df42489b59bc49429ef2d50b9967c5"
Jul 24 14:12:41.382304 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:12:41.382280    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e41c3d2848cf70471623f6be887132b40df42489b59bc49429ef2d50b9967c5\": container with ID starting with 6e41c3d2848cf70471623f6be887132b40df42489b59bc49429ef2d50b9967c5 not found: ID does not exist" containerID="6e41c3d2848cf70471623f6be887132b40df42489b59bc49429ef2d50b9967c5"
Jul 24 14:12:41.382381 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.382314    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e41c3d2848cf70471623f6be887132b40df42489b59bc49429ef2d50b9967c5"} err="failed to get container status \"6e41c3d2848cf70471623f6be887132b40df42489b59bc49429ef2d50b9967c5\": rpc error: code = NotFound desc = could not find container \"6e41c3d2848cf70471623f6be887132b40df42489b59bc49429ef2d50b9967c5\": container with ID starting with 6e41c3d2848cf70471623f6be887132b40df42489b59bc49429ef2d50b9967c5 not found: ID does not exist"
Jul 24 14:12:41.399099 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.399056    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"]
Jul 24 14:12:41.404464 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:41.404436    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-ed376eca-kserve-65979df79-jsm8q"]
Jul 24 14:12:42.195130 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:42.195094    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e" path="/var/lib/kubelet/pods/53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e/volumes"
Jul 24 14:12:42.195520 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:42.195506    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1" path="/var/lib/kubelet/pods/bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1/volumes"
Jul 24 14:12:43.006913 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:43.006877    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:12:50.169254 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:12:50.169203    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:13:06.166770 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:13:06.166732    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:13:17.052977 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:13:17.052899    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:13:26.641084 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:13:26.641050    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:13:34.448236 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:13:34.448191    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:13:45.347583 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:13:45.347537    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:13:55.250772 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:13:55.250730    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:14:09.044967 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:14:09.044924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:14:18.147285 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:14:18.147247    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:14:28.859073 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:14:28.859036    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:14:39.044959 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:14:39.044914    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:14:52.274489 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:14:52.274459    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:14:52.280873 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:14:52.280848    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:14:52.444733 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:14:52.444700    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:15:00.560092 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:15:00.560044    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:15:12.955900 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:15:12.955867    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:15:23.949650 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:15:23.949612    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:15:36.667003 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:15:36.666951    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:15:45.951776 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:15:45.951735    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:15:57.143150 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:15:57.143109    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:16:06.667371 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:06.667335    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:16:23.946588 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:23.946493    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:16:42.275502 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.275463    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg"]
Jul 24 14:16:42.275982 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.275862    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e" containerName="main"
Jul 24 14:16:42.275982 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.275874    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e" containerName="main"
Jul 24 14:16:42.275982 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.275892    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1" containerName="main"
Jul 24 14:16:42.275982 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.275898    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1" containerName="main"
Jul 24 14:16:42.275982 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.275951    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="53cf5bb1-e6e4-47b6-9bd5-9e0eda73331e" containerName="main"
Jul 24 14:16:42.275982 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.275961    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf0ad9d6-faa4-4374-890f-7dc4c95ac6c1" containerName="main"
Jul 24 14:16:42.278999 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.278981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg"
Jul 24 14:16:42.281669 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.281645    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 14:16:42.281801 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.281646    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:16:42.286907 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.286881    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg"]
Jul 24 14:16:42.361164 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.361121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-600fea54-4nfxg\" (UID: \"4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg"
Jul 24 14:16:42.462272 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.462234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-600fea54-4nfxg\" (UID: \"4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg"
Jul 24 14:16:42.462875 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.462852    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-600fea54-4nfxg\" (UID: \"4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg"
Jul 24 14:16:42.591281 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.591234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg"
Jul 24 14:16:42.733857 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.733826    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg"]
Jul 24 14:16:42.736776 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:16:42.736740    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef08a6f_edc4_4dc2_a5b8_f32feab69bfa.slice/crio-63db72c93ef8e05e6ec40d5eeae00eaf0ab659c082b92361ca04d7f823bb8068 WatchSource:0}: Error finding container 63db72c93ef8e05e6ec40d5eeae00eaf0ab659c082b92361ca04d7f823bb8068: Status 404 returned error can't find the container with id 63db72c93ef8e05e6ec40d5eeae00eaf0ab659c082b92361ca04d7f823bb8068
Jul 24 14:16:42.738973 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:42.738952    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:16:43.485987 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:43.485951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg" event={"ID":"4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa","Type":"ContainerStarted","Data":"63db72c93ef8e05e6ec40d5eeae00eaf0ab659c082b92361ca04d7f823bb8068"}
Jul 24 14:16:46.503760 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:46.503722    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg" event={"ID":"4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa","Type":"ContainerStarted","Data":"458f4213fe485fabea45ea3215a308ade3f77a7f461a66e89ebcd3162d806c80"}
Jul 24 14:16:46.521414 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:46.521362    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg" podStartSLOduration=1.5004672449999998 podStartE2EDuration="4.521345462s" totalImagesPullingTime="3.020878217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:16:46.519456373 +0000 UTC m=+1914.754807736" watchObservedRunningTime="2026-07-24 14:16:46.521345462 +0000 UTC m=+1914.756696823"
Jul 24 14:16:47.510904 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:47.510873    2565 generic.go:356] "Generic (PLEG): container finished" podID="4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa" containerID="458f4213fe485fabea45ea3215a308ade3f77a7f461a66e89ebcd3162d806c80" exitCode=0
Jul 24 14:16:47.511320 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:47.510939    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg" event={"ID":"4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa","Type":"ContainerDied","Data":"458f4213fe485fabea45ea3215a308ade3f77a7f461a66e89ebcd3162d806c80"}
Jul 24 14:16:48.649302 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:48.649275    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg"
Jul 24 14:16:48.824808 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:48.824770    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa-maas-api-service-ca\") pod \"4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa\" (UID: \"4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa\") "
Jul 24 14:16:48.825212 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:48.825152    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa" (UID: "4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:16:48.926320 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:48.926278    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa-maas-api-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:16:49.521302 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:49.521273    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg"
Jul 24 14:16:49.521458 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:49.521268    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg" event={"ID":"4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa","Type":"ContainerDied","Data":"63db72c93ef8e05e6ec40d5eeae00eaf0ab659c082b92361ca04d7f823bb8068"}
Jul 24 14:16:49.521458 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:49.521417    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63db72c93ef8e05e6ec40d5eeae00eaf0ab659c082b92361ca04d7f823bb8068"
Jul 24 14:16:55.744289 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:55.744244    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:16:57.348545 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:57.348508    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg"]
Jul 24 14:16:57.350979 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:57.350943    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-600fea54-4nfxg"]
Jul 24 14:16:58.195236 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:16:58.195201    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa" path="/var/lib/kubelet/pods/4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa/volumes"
Jul 24 14:17:09.143310 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:09.143278    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:17:25.869785 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:25.869749    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq"]
Jul 24 14:17:25.870348 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:25.870329    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa" containerName="revoke-keys"
Jul 24 14:17:25.870426 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:25.870352    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa" containerName="revoke-keys"
Jul 24 14:17:25.870480 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:25.870463    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef08a6f-edc4-4dc2-a5b8-f32feab69bfa" containerName="revoke-keys"
Jul 24 14:17:25.873388 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:25.873368    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq"
Jul 24 14:17:25.876290 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:25.876262    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:17:25.876413 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:25.876342    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 14:17:25.881941 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:25.881912    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq"]
Jul 24 14:17:25.960551 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:25.960513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq\" (UID: \"0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq"
Jul 24 14:17:26.061288 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:26.061241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq\" (UID: \"0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq"
Jul 24 14:17:26.061889 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:26.061868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq\" (UID: \"0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq"
Jul 24 14:17:26.185610 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:26.185522    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq"
Jul 24 14:17:26.331158 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:26.331122    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq"]
Jul 24 14:17:26.333844 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:17:26.333814    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a96e1f0_16c5_48ce_b78d_ae88ebe88c0d.slice/crio-31b385f0315f4d830d9fa3ec0c89cf9a5e6197ba1655f45e089fdfc7a84b0305 WatchSource:0}: Error finding container 31b385f0315f4d830d9fa3ec0c89cf9a5e6197ba1655f45e089fdfc7a84b0305: Status 404 returned error can't find the container with id 31b385f0315f4d830d9fa3ec0c89cf9a5e6197ba1655f45e089fdfc7a84b0305
Jul 24 14:17:26.700003 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:26.699967    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq" event={"ID":"0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d","Type":"ContainerStarted","Data":"699b53b6881da8e12ec11786b518df26724bbf59cab2cc4ee619d2354ed12fce"}
Jul 24 14:17:26.700203 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:26.700047    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq" event={"ID":"0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d","Type":"ContainerStarted","Data":"31b385f0315f4d830d9fa3ec0c89cf9a5e6197ba1655f45e089fdfc7a84b0305"}
Jul 24 14:17:26.717406 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:26.717335    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq" podStartSLOduration=1.717317199 podStartE2EDuration="1.717317199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:17:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:17:26.716165785 +0000 UTC m=+1954.951517149" watchObservedRunningTime="2026-07-24 14:17:26.717317199 +0000 UTC m=+1954.952668561"
Jul 24 14:17:27.706293 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:27.706254    2565 generic.go:356] "Generic (PLEG): container finished" podID="0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d" containerID="699b53b6881da8e12ec11786b518df26724bbf59cab2cc4ee619d2354ed12fce" exitCode=0
Jul 24 14:17:27.706682 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:27.706357    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq" event={"ID":"0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d","Type":"ContainerDied","Data":"699b53b6881da8e12ec11786b518df26724bbf59cab2cc4ee619d2354ed12fce"}
Jul 24 14:17:28.844520 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:28.844492    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq"
Jul 24 14:17:28.990345 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:28.990244    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d-maas-api-service-ca\") pod \"0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d\" (UID: \"0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d\") "
Jul 24 14:17:28.990642 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:28.990616    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d" (UID: "0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:17:29.091800 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:29.091749    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d-maas-api-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:17:29.716914 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:29.716888    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq"
Jul 24 14:17:29.717096 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:29.716883    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq" event={"ID":"0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d","Type":"ContainerDied","Data":"31b385f0315f4d830d9fa3ec0c89cf9a5e6197ba1655f45e089fdfc7a84b0305"}
Jul 24 14:17:29.717096 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:29.717019    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31b385f0315f4d830d9fa3ec0c89cf9a5e6197ba1655f45e089fdfc7a84b0305"
Jul 24 14:17:39.439865 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:39.439827    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:17:40.948072 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:40.948032    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq"]
Jul 24 14:17:40.949546 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:40.949521    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a7e2221a-7knrq"]
Jul 24 14:17:42.195234 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:42.195201    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d" path="/var/lib/kubelet/pods/0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d/volumes"
Jul 24 14:17:51.945387 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:17:51.945351    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:18:09.755900 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:09.755864    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn"]
Jul 24 14:18:09.756534 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:09.756405    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d" containerName="revoke-keys"
Jul 24 14:18:09.756534 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:09.756426    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d" containerName="revoke-keys"
Jul 24 14:18:09.756534 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:09.756533    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a96e1f0-16c5-48ce-b78d-ae88ebe88c0d" containerName="revoke-keys"
Jul 24 14:18:09.759460 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:09.759437    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn"
Jul 24 14:18:09.762264 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:09.762236    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:18:09.762383 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:09.762300    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 14:18:09.767227 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:09.767201    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn"]
Jul 24 14:18:09.870033 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:09.869994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6fa2ee-57ce-43cc-95f4-643f11fad290-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn\" (UID: \"8b6fa2ee-57ce-43cc-95f4-643f11fad290\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn"
Jul 24 14:18:09.971082 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:09.971052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6fa2ee-57ce-43cc-95f4-643f11fad290-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn\" (UID: \"8b6fa2ee-57ce-43cc-95f4-643f11fad290\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn"
Jul 24 14:18:09.971790 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:09.971772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6fa2ee-57ce-43cc-95f4-643f11fad290-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn\" (UID: \"8b6fa2ee-57ce-43cc-95f4-643f11fad290\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn"
Jul 24 14:18:10.070460 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:10.070429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn"
Jul 24 14:18:10.204374 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:10.204352    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn"]
Jul 24 14:18:10.206475 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:18:10.206450    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6fa2ee_57ce_43cc_95f4_643f11fad290.slice/crio-d51baf3031d45e889150bdff2d638f0db9d246dbd46cc1c3fb29bdb8aa6c682e WatchSource:0}: Error finding container d51baf3031d45e889150bdff2d638f0db9d246dbd46cc1c3fb29bdb8aa6c682e: Status 404 returned error can't find the container with id d51baf3031d45e889150bdff2d638f0db9d246dbd46cc1c3fb29bdb8aa6c682e
Jul 24 14:18:10.912869 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:10.912835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn" event={"ID":"8b6fa2ee-57ce-43cc-95f4-643f11fad290","Type":"ContainerStarted","Data":"677bf4adb7c30e56fc4a49882509996a5aa4df6f15c449c8271b4a91727bd7ae"}
Jul 24 14:18:10.913294 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:10.912888    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn" event={"ID":"8b6fa2ee-57ce-43cc-95f4-643f11fad290","Type":"ContainerStarted","Data":"d51baf3031d45e889150bdff2d638f0db9d246dbd46cc1c3fb29bdb8aa6c682e"}
Jul 24 14:18:10.929649 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:10.929593    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn" podStartSLOduration=1.929571859 podStartE2EDuration="1.929571859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:18:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:18:10.928856081 +0000 UTC m=+1999.164207444" watchObservedRunningTime="2026-07-24 14:18:10.929571859 +0000 UTC m=+1999.164923222"
Jul 24 14:18:11.924370 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:11.924336    2565 generic.go:356] "Generic (PLEG): container finished" podID="8b6fa2ee-57ce-43cc-95f4-643f11fad290" containerID="677bf4adb7c30e56fc4a49882509996a5aa4df6f15c449c8271b4a91727bd7ae" exitCode=0
Jul 24 14:18:11.924795 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:11.924432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn" event={"ID":"8b6fa2ee-57ce-43cc-95f4-643f11fad290","Type":"ContainerDied","Data":"677bf4adb7c30e56fc4a49882509996a5aa4df6f15c449c8271b4a91727bd7ae"}
Jul 24 14:18:13.063787 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:13.063756    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn"
Jul 24 14:18:13.197469 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:13.197378    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6fa2ee-57ce-43cc-95f4-643f11fad290-maas-api-service-ca\") pod \"8b6fa2ee-57ce-43cc-95f4-643f11fad290\" (UID: \"8b6fa2ee-57ce-43cc-95f4-643f11fad290\") "
Jul 24 14:18:13.197734 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:13.197708    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b6fa2ee-57ce-43cc-95f4-643f11fad290-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8b6fa2ee-57ce-43cc-95f4-643f11fad290" (UID: "8b6fa2ee-57ce-43cc-95f4-643f11fad290"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:18:13.298190 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:13.298146    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6fa2ee-57ce-43cc-95f4-643f11fad290-maas-api-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:18:13.935161 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:13.935119    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn"
Jul 24 14:18:13.935161 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:13.935158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn" event={"ID":"8b6fa2ee-57ce-43cc-95f4-643f11fad290","Type":"ContainerDied","Data":"d51baf3031d45e889150bdff2d638f0db9d246dbd46cc1c3fb29bdb8aa6c682e"}
Jul 24 14:18:13.935481 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:13.935235    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d51baf3031d45e889150bdff2d638f0db9d246dbd46cc1c3fb29bdb8aa6c682e"
Jul 24 14:18:23.245453 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:23.245417    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:18:24.831727 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:24.831692    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn"]
Jul 24 14:18:24.837047 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:24.837002    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f2fc6f2-g4qjn"]
Jul 24 14:18:26.195445 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:26.195405    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b6fa2ee-57ce-43cc-95f4-643f11fad290" path="/var/lib/kubelet/pods/8b6fa2ee-57ce-43cc-95f4-643f11fad290/volumes"
Jul 24 14:18:36.262392 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:36.262354    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:18:54.097047 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:54.097006    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf"]
Jul 24 14:18:54.097596 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:54.097453    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b6fa2ee-57ce-43cc-95f4-643f11fad290" containerName="revoke-keys"
Jul 24 14:18:54.097596 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:54.097469    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b6fa2ee-57ce-43cc-95f4-643f11fad290" containerName="revoke-keys"
Jul 24 14:18:54.097596 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:54.097559    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b6fa2ee-57ce-43cc-95f4-643f11fad290" containerName="revoke-keys"
Jul 24 14:18:54.100716 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:54.100699    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf"
Jul 24 14:18:54.103280 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:54.103259    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:18:54.103388 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:54.103278    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 14:18:54.107828 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:54.107804    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf"]
Jul 24 14:18:54.159947 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:54.159864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400ee241-6ad8-40ed-ac97-2283549b0071-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf\" (UID: \"400ee241-6ad8-40ed-ac97-2283549b0071\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf"
Jul 24 14:18:54.261156 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:54.261112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400ee241-6ad8-40ed-ac97-2283549b0071-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf\" (UID: \"400ee241-6ad8-40ed-ac97-2283549b0071\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf"
Jul 24 14:18:54.261815 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:54.261793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400ee241-6ad8-40ed-ac97-2283549b0071-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf\" (UID: \"400ee241-6ad8-40ed-ac97-2283549b0071\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf"
Jul 24 14:18:54.412735 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:54.412644    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf"
Jul 24 14:18:54.550842 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:54.550810    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf"]
Jul 24 14:18:54.552975 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:18:54.552951    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400ee241_6ad8_40ed_ac97_2283549b0071.slice/crio-7b768759312835a1c5fd6bf2eee14d58161015911f330f2c4e661cfcf90fb441 WatchSource:0}: Error finding container 7b768759312835a1c5fd6bf2eee14d58161015911f330f2c4e661cfcf90fb441: Status 404 returned error can't find the container with id 7b768759312835a1c5fd6bf2eee14d58161015911f330f2c4e661cfcf90fb441
Jul 24 14:18:55.133512 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:55.133475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf" event={"ID":"400ee241-6ad8-40ed-ac97-2283549b0071","Type":"ContainerStarted","Data":"1da72b8978a6f351084d8005c1a9cd205b5c0a442ca5a8581ad6b22c71d2e429"}
Jul 24 14:18:55.134071 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:55.133530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf" event={"ID":"400ee241-6ad8-40ed-ac97-2283549b0071","Type":"ContainerStarted","Data":"7b768759312835a1c5fd6bf2eee14d58161015911f330f2c4e661cfcf90fb441"}
Jul 24 14:18:55.150458 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:55.150399    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf" podStartSLOduration=1.150383 podStartE2EDuration="1.150383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:18:55.1495671 +0000 UTC m=+2043.384918462" watchObservedRunningTime="2026-07-24 14:18:55.150383 +0000 UTC m=+2043.385734361"
Jul 24 14:18:56.140590 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:56.140549    2565 generic.go:356] "Generic (PLEG): container finished" podID="400ee241-6ad8-40ed-ac97-2283549b0071" containerID="1da72b8978a6f351084d8005c1a9cd205b5c0a442ca5a8581ad6b22c71d2e429" exitCode=0
Jul 24 14:18:56.140994 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:56.140599    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf" event={"ID":"400ee241-6ad8-40ed-ac97-2283549b0071","Type":"ContainerDied","Data":"1da72b8978a6f351084d8005c1a9cd205b5c0a442ca5a8581ad6b22c71d2e429"}
Jul 24 14:18:57.280898 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:57.280870    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf"
Jul 24 14:18:57.388750 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:57.388707    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400ee241-6ad8-40ed-ac97-2283549b0071-maas-api-service-ca\") pod \"400ee241-6ad8-40ed-ac97-2283549b0071\" (UID: \"400ee241-6ad8-40ed-ac97-2283549b0071\") "
Jul 24 14:18:57.389100 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:57.389076    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/400ee241-6ad8-40ed-ac97-2283549b0071-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "400ee241-6ad8-40ed-ac97-2283549b0071" (UID: "400ee241-6ad8-40ed-ac97-2283549b0071"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:18:57.489881 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:57.489791    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400ee241-6ad8-40ed-ac97-2283549b0071-maas-api-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:18:58.152365 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:58.152328    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf" event={"ID":"400ee241-6ad8-40ed-ac97-2283549b0071","Type":"ContainerDied","Data":"7b768759312835a1c5fd6bf2eee14d58161015911f330f2c4e661cfcf90fb441"}
Jul 24 14:18:58.152365 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:58.152352    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf"
Jul 24 14:18:58.152620 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:18:58.152376    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b768759312835a1c5fd6bf2eee14d58161015911f330f2c4e661cfcf90fb441"
Jul 24 14:19:07.655694 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:19:07.655660    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:19:09.194586 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:19:09.194545    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf"]
Jul 24 14:19:09.198364 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:19:09.198334    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8fc7075e-jlwvf"]
Jul 24 14:19:10.194702 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:19:10.194670    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="400ee241-6ad8-40ed-ac97-2283549b0071" path="/var/lib/kubelet/pods/400ee241-6ad8-40ed-ac97-2283549b0071/volumes"
Jul 24 14:19:52.303596 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:19:52.303567    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:19:52.311511 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:19:52.311483    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:20:34.648772 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:20:34.648731    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:20:46.244529 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:20:46.244439    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:21:00.041713 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:00.041672    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:21:02.354434 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:02.354395    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7"]
Jul 24 14:21:02.354823 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:02.354792    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="400ee241-6ad8-40ed-ac97-2283549b0071" containerName="revoke-keys"
Jul 24 14:21:02.354823 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:02.354805    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="400ee241-6ad8-40ed-ac97-2283549b0071" containerName="revoke-keys"
Jul 24 14:21:02.354903 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:02.354892    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="400ee241-6ad8-40ed-ac97-2283549b0071" containerName="revoke-keys"
Jul 24 14:21:02.357998 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:02.357981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7"
Jul 24 14:21:02.360584 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:02.360556    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 14:21:02.360728 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:02.360705    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:21:02.365849 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:02.365343    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7"]
Jul 24 14:21:02.435522 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:02.435479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4716da3-108e-4999-886b-25e5e27d5f90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7\" (UID: \"a4716da3-108e-4999-886b-25e5e27d5f90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7"
Jul 24 14:21:02.536727 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:02.536682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4716da3-108e-4999-886b-25e5e27d5f90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7\" (UID: \"a4716da3-108e-4999-886b-25e5e27d5f90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7"
Jul 24 14:21:02.537349 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:02.537331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4716da3-108e-4999-886b-25e5e27d5f90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7\" (UID: \"a4716da3-108e-4999-886b-25e5e27d5f90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7"
Jul 24 14:21:02.669730 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:02.669643    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7"
Jul 24 14:21:02.809416 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:02.806966    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7"]
Jul 24 14:21:03.768352 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:03.768314    2565 generic.go:356] "Generic (PLEG): container finished" podID="a4716da3-108e-4999-886b-25e5e27d5f90" containerID="c2193916a0c77484cd1f17f27873511a229ffca61034bd6b060c96eeff8604db" exitCode=0
Jul 24 14:21:03.768754 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:03.768398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7" event={"ID":"a4716da3-108e-4999-886b-25e5e27d5f90","Type":"ContainerDied","Data":"c2193916a0c77484cd1f17f27873511a229ffca61034bd6b060c96eeff8604db"}
Jul 24 14:21:03.768754 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:03.768457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7" event={"ID":"a4716da3-108e-4999-886b-25e5e27d5f90","Type":"ContainerStarted","Data":"c20d6aa5367ad2dc092ca9731fe3070866e268488c8de02a824aadeff171b408"}
Jul 24 14:21:04.910995 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:04.910959    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7"
Jul 24 14:21:04.959634 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:04.959598    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4716da3-108e-4999-886b-25e5e27d5f90-maas-api-service-ca\") pod \"a4716da3-108e-4999-886b-25e5e27d5f90\" (UID: \"a4716da3-108e-4999-886b-25e5e27d5f90\") "
Jul 24 14:21:04.959988 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:04.959963    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4716da3-108e-4999-886b-25e5e27d5f90-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4716da3-108e-4999-886b-25e5e27d5f90" (UID: "a4716da3-108e-4999-886b-25e5e27d5f90"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:21:05.061001 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:05.060963    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4716da3-108e-4999-886b-25e5e27d5f90-maas-api-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:21:05.779774 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:05.779734    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7" event={"ID":"a4716da3-108e-4999-886b-25e5e27d5f90","Type":"ContainerDied","Data":"c20d6aa5367ad2dc092ca9731fe3070866e268488c8de02a824aadeff171b408"}
Jul 24 14:21:05.779961 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:05.779788    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c20d6aa5367ad2dc092ca9731fe3070866e268488c8de02a824aadeff171b408"
Jul 24 14:21:05.779961 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:05.779754    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7"
Jul 24 14:21:16.543344 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:16.543307    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:21:17.442408 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:17.442360    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7"]
Jul 24 14:21:17.448445 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:17.448412    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89fed8b8-5r8p7"]
Jul 24 14:21:18.194659 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:18.194625    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4716da3-108e-4999-886b-25e5e27d5f90" path="/var/lib/kubelet/pods/a4716da3-108e-4999-886b-25e5e27d5f90/volumes"
Jul 24 14:21:51.989073 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:21:51.989034    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:22:16.627274 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.627167    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"]
Jul 24 14:22:16.627732 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.627674    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4716da3-108e-4999-886b-25e5e27d5f90" containerName="revoke-keys"
Jul 24 14:22:16.627732 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.627688    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4716da3-108e-4999-886b-25e5e27d5f90" containerName="revoke-keys"
Jul 24 14:22:16.627854 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.627756    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4716da3-108e-4999-886b-25e5e27d5f90" containerName="revoke-keys"
Jul 24 14:22:16.630905 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.630887    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.633357 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.633330    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-676e8e92\"/\"openshift-service-ca.crt\""
Jul 24 14:22:16.634478 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.634457    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-676e8e92\"/\"default-dockercfg-m5bsz\""
Jul 24 14:22:16.634563 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.634488    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-676e8e92\"/\"e2e-lifecycle-model-676e8e92-kserve-self-signed-certs\""
Jul 24 14:22:16.634563 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.634496    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-676e8e92\"/\"kube-root-ca.crt\""
Jul 24 14:22:16.646302 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.641910    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"]
Jul 24 14:22:16.719636 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.719591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-tmp-dir\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.719821 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.719652    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-model-cache\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.719821 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.719729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-dshm\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.719821 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.719779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8edf28-b8c4-451b-8e9d-150f197b1938-tls-certs\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.719821 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.719800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmc5j\" (UniqueName: \"kubernetes.io/projected/fb8edf28-b8c4-451b-8e9d-150f197b1938-kube-api-access-xmc5j\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.719959 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.719840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-home\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.821127 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.821086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-dshm\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.821350 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.821155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8edf28-b8c4-451b-8e9d-150f197b1938-tls-certs\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.821350 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.821203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmc5j\" (UniqueName: \"kubernetes.io/projected/fb8edf28-b8c4-451b-8e9d-150f197b1938-kube-api-access-xmc5j\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.821350 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.821225    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-home\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.821350 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.821265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-tmp-dir\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.821350 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.821289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-model-cache\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.821660 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.821638    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-model-cache\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.821724 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.821694    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-home\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.821771 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.821705    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-tmp-dir\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.823556 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.823533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-dshm\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.823824 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.823805    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8edf28-b8c4-451b-8e9d-150f197b1938-tls-certs\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.830055 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.830026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmc5j\" (UniqueName: \"kubernetes.io/projected/fb8edf28-b8c4-451b-8e9d-150f197b1938-kube-api-access-xmc5j\") pod \"e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") " pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:16.941403 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:16.941300    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:17.089914 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:17.089873    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"]
Jul 24 14:22:17.094441 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:22:17.094406    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb8edf28_b8c4_451b_8e9d_150f197b1938.slice/crio-5b9d5488cc8b24d978fb82767e5170a58b7832ff1fc3178ee8a869cd2bcc621f WatchSource:0}: Error finding container 5b9d5488cc8b24d978fb82767e5170a58b7832ff1fc3178ee8a869cd2bcc621f: Status 404 returned error can't find the container with id 5b9d5488cc8b24d978fb82767e5170a58b7832ff1fc3178ee8a869cd2bcc621f
Jul 24 14:22:17.121554 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:17.121515    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg" event={"ID":"fb8edf28-b8c4-451b-8e9d-150f197b1938","Type":"ContainerStarted","Data":"5b9d5488cc8b24d978fb82767e5170a58b7832ff1fc3178ee8a869cd2bcc621f"}
Jul 24 14:22:18.128374 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:18.128333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg" event={"ID":"fb8edf28-b8c4-451b-8e9d-150f197b1938","Type":"ContainerStarted","Data":"b3f525ed4965650632ad544dfb6ac42c956a1f0c0c21719514c69d4fa3dbd934"}
Jul 24 14:22:18.146718 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:18.146658    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg" podStartSLOduration=2.146641877 podStartE2EDuration="2.146641877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:22:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:22:18.144785696 +0000 UTC m=+2246.380137058" watchObservedRunningTime="2026-07-24 14:22:18.146641877 +0000 UTC m=+2246.381993262"
Jul 24 14:22:19.940512 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:19.940475    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:22:26.942403 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:26.942361    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:26.942403 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:26.942423    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:26.956396 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:26.956365    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:27.188980 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:27.188947    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:22:49.642865 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:49.642823    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:22:52.348347 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:22:52.348313    2565 scope.go:117] "RemoveContainer" containerID="458f4213fe485fabea45ea3215a308ade3f77a7f461a66e89ebcd3162d806c80"
Jul 24 14:23:11.541979 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:11.541942    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:23:20.647047 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:20.647007    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:23:25.854714 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:25.854673    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"]
Jul 24 14:23:40.876970 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:40.876897    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg" podUID="fb8edf28-b8c4-451b-8e9d-150f197b1938" containerName="main" containerID="cri-o://b3f525ed4965650632ad544dfb6ac42c956a1f0c0c21719514c69d4fa3dbd934" gracePeriod=45
Jul 24 14:23:41.131943 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.131881    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:23:41.190252 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.190220    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-home\") pod \"fb8edf28-b8c4-451b-8e9d-150f197b1938\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") "
Jul 24 14:23:41.190422 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.190278    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmc5j\" (UniqueName: \"kubernetes.io/projected/fb8edf28-b8c4-451b-8e9d-150f197b1938-kube-api-access-xmc5j\") pod \"fb8edf28-b8c4-451b-8e9d-150f197b1938\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") "
Jul 24 14:23:41.190422 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.190322    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-dshm\") pod \"fb8edf28-b8c4-451b-8e9d-150f197b1938\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") "
Jul 24 14:23:41.190422 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.190396    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8edf28-b8c4-451b-8e9d-150f197b1938-tls-certs\") pod \"fb8edf28-b8c4-451b-8e9d-150f197b1938\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") "
Jul 24 14:23:41.190575 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.190451    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-tmp-dir\") pod \"fb8edf28-b8c4-451b-8e9d-150f197b1938\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") "
Jul 24 14:23:41.190575 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.190478    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-model-cache\") pod \"fb8edf28-b8c4-451b-8e9d-150f197b1938\" (UID: \"fb8edf28-b8c4-451b-8e9d-150f197b1938\") "
Jul 24 14:23:41.190575 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.190486    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-home" (OuterVolumeSpecName: "home") pod "fb8edf28-b8c4-451b-8e9d-150f197b1938" (UID: "fb8edf28-b8c4-451b-8e9d-150f197b1938"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:23:41.190727 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.190695    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb8edf28-b8c4-451b-8e9d-150f197b1938" (UID: "fb8edf28-b8c4-451b-8e9d-150f197b1938"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:23:41.190727 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.190710    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-home\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:23:41.190830 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.190783    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb8edf28-b8c4-451b-8e9d-150f197b1938" (UID: "fb8edf28-b8c4-451b-8e9d-150f197b1938"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:23:41.192811 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.192781    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb8edf28-b8c4-451b-8e9d-150f197b1938-kube-api-access-xmc5j" (OuterVolumeSpecName: "kube-api-access-xmc5j") pod "fb8edf28-b8c4-451b-8e9d-150f197b1938" (UID: "fb8edf28-b8c4-451b-8e9d-150f197b1938"). InnerVolumeSpecName "kube-api-access-xmc5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:23:41.192811 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.192790    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-dshm" (OuterVolumeSpecName: "dshm") pod "fb8edf28-b8c4-451b-8e9d-150f197b1938" (UID: "fb8edf28-b8c4-451b-8e9d-150f197b1938"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:23:41.192959 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.192780    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb8edf28-b8c4-451b-8e9d-150f197b1938-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb8edf28-b8c4-451b-8e9d-150f197b1938" (UID: "fb8edf28-b8c4-451b-8e9d-150f197b1938"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:23:41.291276 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.291232    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-tmp-dir\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:23:41.291276 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.291266    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-model-cache\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:23:41.291276 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.291275    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmc5j\" (UniqueName: \"kubernetes.io/projected/fb8edf28-b8c4-451b-8e9d-150f197b1938-kube-api-access-xmc5j\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:23:41.291276 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.291285    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8edf28-b8c4-451b-8e9d-150f197b1938-dshm\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:23:41.291276 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.291295    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8edf28-b8c4-451b-8e9d-150f197b1938-tls-certs\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:23:41.554616 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.554580    2565 generic.go:356] "Generic (PLEG): container finished" podID="fb8edf28-b8c4-451b-8e9d-150f197b1938" containerID="b3f525ed4965650632ad544dfb6ac42c956a1f0c0c21719514c69d4fa3dbd934" exitCode=0
Jul 24 14:23:41.554801 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.554625    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"
Jul 24 14:23:41.554801 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.554671    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg" event={"ID":"fb8edf28-b8c4-451b-8e9d-150f197b1938","Type":"ContainerDied","Data":"b3f525ed4965650632ad544dfb6ac42c956a1f0c0c21719514c69d4fa3dbd934"}
Jul 24 14:23:41.554801 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.554716    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg" event={"ID":"fb8edf28-b8c4-451b-8e9d-150f197b1938","Type":"ContainerDied","Data":"5b9d5488cc8b24d978fb82767e5170a58b7832ff1fc3178ee8a869cd2bcc621f"}
Jul 24 14:23:41.554801 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.554737    2565 scope.go:117] "RemoveContainer" containerID="b3f525ed4965650632ad544dfb6ac42c956a1f0c0c21719514c69d4fa3dbd934"
Jul 24 14:23:41.564338 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.564319    2565 scope.go:117] "RemoveContainer" containerID="b3f525ed4965650632ad544dfb6ac42c956a1f0c0c21719514c69d4fa3dbd934"
Jul 24 14:23:41.564619 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:23:41.564601    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3f525ed4965650632ad544dfb6ac42c956a1f0c0c21719514c69d4fa3dbd934\": container with ID starting with b3f525ed4965650632ad544dfb6ac42c956a1f0c0c21719514c69d4fa3dbd934 not found: ID does not exist" containerID="b3f525ed4965650632ad544dfb6ac42c956a1f0c0c21719514c69d4fa3dbd934"
Jul 24 14:23:41.564669 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.564629    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3f525ed4965650632ad544dfb6ac42c956a1f0c0c21719514c69d4fa3dbd934"} err="failed to get container status \"b3f525ed4965650632ad544dfb6ac42c956a1f0c0c21719514c69d4fa3dbd934\": rpc error: code = NotFound desc = could not find container \"b3f525ed4965650632ad544dfb6ac42c956a1f0c0c21719514c69d4fa3dbd934\": container with ID starting with b3f525ed4965650632ad544dfb6ac42c956a1f0c0c21719514c69d4fa3dbd934 not found: ID does not exist"
Jul 24 14:23:41.577366 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.577332    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"]
Jul 24 14:23:41.580974 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:41.580948    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-676e8e92/e2e-lifecycle-model-676e8e92-kserve-757f6cdd5f-lqgbg"]
Jul 24 14:23:42.194794 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:42.194759    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb8edf28-b8c4-451b-8e9d-150f197b1938" path="/var/lib/kubelet/pods/fb8edf28-b8c4-451b-8e9d-150f197b1938/volumes"
Jul 24 14:23:52.369734 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:23:52.369702    2565 scope.go:117] "RemoveContainer" containerID="699b53b6881da8e12ec11786b518df26724bbf59cab2cc4ee619d2354ed12fce"
Jul 24 14:24:20.050527 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:24:20.050484    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:24:27.947062 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:24:27.947028    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:24:52.333219 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:24:52.333168    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:24:52.341220 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:24:52.341197    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:24:52.392390 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:24:52.392356    2565 scope.go:117] "RemoveContainer" containerID="677bf4adb7c30e56fc4a49882509996a5aa4df6f15c449c8271b4a91727bd7ae"
Jul 24 14:25:16.858964 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:16.858883    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:25:28.962031 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:28.961988    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:25:29.957396 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:29.957358    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"]
Jul 24 14:25:29.957758 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:29.957745    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb8edf28-b8c4-451b-8e9d-150f197b1938" containerName="main"
Jul 24 14:25:29.957808 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:29.957763    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb8edf28-b8c4-451b-8e9d-150f197b1938" containerName="main"
Jul 24 14:25:29.957864 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:29.957854    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb8edf28-b8c4-451b-8e9d-150f197b1938" containerName="main"
Jul 24 14:25:29.960946 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:29.960926    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:29.965108 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:29.965082    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-bbfced\"/\"openshift-service-ca.crt\""
Jul 24 14:25:29.965480 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:29.965104    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-bbfced\"/\"kube-root-ca.crt\""
Jul 24 14:25:29.965480 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:29.965109    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-bbfced\"/\"default-dockercfg-bgng5\""
Jul 24 14:25:29.965480 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:29.965082    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-bbfced\"/\"test-model-bbfced-kserve-self-signed-certs\""
Jul 24 14:25:29.974743 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:29.974709    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"]
Jul 24 14:25:30.088825 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.088795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4158d13b-5096-451d-8de9-bcbf752fd69e-tls-certs\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.088825 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.088830    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-tmp-dir\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.089092 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.088958    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-home\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.089092 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.088987    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-dshm\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.089092 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.089011    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-model-cache\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.089092 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.089087    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65pqb\" (UniqueName: \"kubernetes.io/projected/4158d13b-5096-451d-8de9-bcbf752fd69e-kube-api-access-65pqb\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.189722 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.189684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-home\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.189722 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.189722    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-dshm\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.189967 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.189738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-model-cache\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.189967 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.189778    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65pqb\" (UniqueName: \"kubernetes.io/projected/4158d13b-5096-451d-8de9-bcbf752fd69e-kube-api-access-65pqb\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.189967 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.189810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4158d13b-5096-451d-8de9-bcbf752fd69e-tls-certs\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.189967 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.189832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-tmp-dir\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.190195 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.190114    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-home\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.190261 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.190236    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-model-cache\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.190348 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.190330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-tmp-dir\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.192186 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.192150    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-dshm\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.192729 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.192708    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4158d13b-5096-451d-8de9-bcbf752fd69e-tls-certs\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.198756 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.198733    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65pqb\" (UniqueName: \"kubernetes.io/projected/4158d13b-5096-451d-8de9-bcbf752fd69e-kube-api-access-65pqb\") pod \"test-model-bbfced-kserve-5df8d5b97c-mtvd9\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") " pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.270622 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.270518    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:30.411858 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:30.411831    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"]
Jul 24 14:25:30.414830 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:25:30.414801    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4158d13b_5096_451d_8de9_bcbf752fd69e.slice/crio-39452c6949822f12a44f3b9d87a453360ccae91e477eb5beb85e441cec771a9e WatchSource:0}: Error finding container 39452c6949822f12a44f3b9d87a453360ccae91e477eb5beb85e441cec771a9e: Status 404 returned error can't find the container with id 39452c6949822f12a44f3b9d87a453360ccae91e477eb5beb85e441cec771a9e
Jul 24 14:25:31.080996 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:31.080959    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9" event={"ID":"4158d13b-5096-451d-8de9-bcbf752fd69e","Type":"ContainerStarted","Data":"fd41736baa63dd91754bf3fcf16c13abd6650791a4dc26195c1f0ee2f1e51f45"}
Jul 24 14:25:31.080996 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:31.081001    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9" event={"ID":"4158d13b-5096-451d-8de9-bcbf752fd69e","Type":"ContainerStarted","Data":"39452c6949822f12a44f3b9d87a453360ccae91e477eb5beb85e441cec771a9e"}
Jul 24 14:25:31.102278 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:31.102226    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9" podStartSLOduration=2.10220819 podStartE2EDuration="2.10220819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:31.100970094 +0000 UTC m=+2439.336321457" watchObservedRunningTime="2026-07-24 14:25:31.10220819 +0000 UTC m=+2439.337559530"
Jul 24 14:25:40.271088 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:40.271055    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:40.273863 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:40.271116    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:40.283559 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:40.283541    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:41.138613 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:41.138583    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:25:41.458526 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:41.458413    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:25:52.411903 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:25:52.411868    2565 scope.go:117] "RemoveContainer" containerID="1da72b8978a6f351084d8005c1a9cd205b5c0a442ca5a8581ad6b22c71d2e429"
Jul 24 14:26:09.260280 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.260249    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"]
Jul 24 14:26:09.264285 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.264261    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.268289 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.268256    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-aa51de\"/\"kube-root-ca.crt\""
Jul 24 14:26:09.268289 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.268254    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-aa51de\"/\"default-dockercfg-lfsvz\""
Jul 24 14:26:09.268492 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.268259    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-aa51de\"/\"test-model-aa51de-kserve-self-signed-certs\""
Jul 24 14:26:09.268492 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.268313    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-aa51de\"/\"openshift-service-ca.crt\""
Jul 24 14:26:09.289655 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.289623    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"]
Jul 24 14:26:09.350559 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.350522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-model-cache\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.350559 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.350559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-tmp-dir\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.350781 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.350585    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-dshm\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.350781 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.350632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8d207b-5497-4c83-9a32-7e858ef8948d-tls-certs\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.350781 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.350687    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-home\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.350885 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.350773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4l62\" (UniqueName: \"kubernetes.io/projected/aa8d207b-5497-4c83-9a32-7e858ef8948d-kube-api-access-w4l62\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.452086 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.452045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4l62\" (UniqueName: \"kubernetes.io/projected/aa8d207b-5497-4c83-9a32-7e858ef8948d-kube-api-access-w4l62\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.452305 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.452127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-model-cache\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.452305 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.452144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-tmp-dir\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.452305 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.452164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-dshm\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.452305 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.452211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8d207b-5497-4c83-9a32-7e858ef8948d-tls-certs\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.452305 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.452247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-home\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.452604 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.452579    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-model-cache\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.452671 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.452624    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-home\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.452671 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.452634    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-tmp-dir\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.454788 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.454765    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-dshm\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.455083 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.455064    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8d207b-5497-4c83-9a32-7e858ef8948d-tls-certs\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.462612 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.462582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4l62\" (UniqueName: \"kubernetes.io/projected/aa8d207b-5497-4c83-9a32-7e858ef8948d-kube-api-access-w4l62\") pod \"test-model-aa51de-kserve-7c4b8756d7-ltn6l\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") " pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.574013 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.573968    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:09.718401 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:09.718336    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"]
Jul 24 14:26:09.720747 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:26:09.720718    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa8d207b_5497_4c83_9a32_7e858ef8948d.slice/crio-204f069bcd9805f7f64940d4b6ff7aacf0a454e6993af8ad5b8a75351d6d5430 WatchSource:0}: Error finding container 204f069bcd9805f7f64940d4b6ff7aacf0a454e6993af8ad5b8a75351d6d5430: Status 404 returned error can't find the container with id 204f069bcd9805f7f64940d4b6ff7aacf0a454e6993af8ad5b8a75351d6d5430
Jul 24 14:26:10.268708 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:10.268668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l" event={"ID":"aa8d207b-5497-4c83-9a32-7e858ef8948d","Type":"ContainerStarted","Data":"15010a43d337cc0a832cb883e5e784a44946b14719cd1fa5bbcbff1dec0b400c"}
Jul 24 14:26:10.268708 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:10.268716    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l" event={"ID":"aa8d207b-5497-4c83-9a32-7e858ef8948d","Type":"ContainerStarted","Data":"204f069bcd9805f7f64940d4b6ff7aacf0a454e6993af8ad5b8a75351d6d5430"}
Jul 24 14:26:10.298631 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:10.298576    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l" podStartSLOduration=1.29855692 podStartE2EDuration="1.29855692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:10.297252617 +0000 UTC m=+2478.532603979" watchObservedRunningTime="2026-07-24 14:26:10.29855692 +0000 UTC m=+2478.533908282"
Jul 24 14:26:14.849139 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:14.849101    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:26:19.574516 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:19.574478    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:19.574924 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:19.574533    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:19.587082 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:19.587053    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:20.326465 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:20.326432    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:26:52.656572 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:52.656497    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"]
Jul 24 14:26:53.571233 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:53.571201    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"]
Jul 24 14:26:53.727493 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:53.727453    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc"]
Jul 24 14:26:53.730983 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:53.730964    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc"
Jul 24 14:26:53.733357 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:53.733335    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:26:53.733495 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:53.733338    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 14:26:53.738611 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:53.738587    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc"]
Jul 24 14:26:53.878576 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:53.878487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa409b4b-df69-4609-b229-5ac03d35c3e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc\" (UID: \"aa409b4b-df69-4609-b229-5ac03d35c3e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc"
Jul 24 14:26:53.979794 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:53.979757    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa409b4b-df69-4609-b229-5ac03d35c3e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc\" (UID: \"aa409b4b-df69-4609-b229-5ac03d35c3e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc"
Jul 24 14:26:53.980497 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:53.980469    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa409b4b-df69-4609-b229-5ac03d35c3e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc\" (UID: \"aa409b4b-df69-4609-b229-5ac03d35c3e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc"
Jul 24 14:26:54.042625 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:54.042586    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc"
Jul 24 14:26:54.187282 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:54.187254    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc"]
Jul 24 14:26:54.189835 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:26:54.189805    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa409b4b_df69_4609_b229_5ac03d35c3e7.slice/crio-d52b565a55ecc2d90709324dc12fd90e80f0806f1ff2c8c079237c80c82fad02 WatchSource:0}: Error finding container d52b565a55ecc2d90709324dc12fd90e80f0806f1ff2c8c079237c80c82fad02: Status 404 returned error can't find the container with id d52b565a55ecc2d90709324dc12fd90e80f0806f1ff2c8c079237c80c82fad02
Jul 24 14:26:54.475141 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:54.475099    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc" event={"ID":"aa409b4b-df69-4609-b229-5ac03d35c3e7","Type":"ContainerStarted","Data":"53e0bf6ec67616f9fd80d31dc561427a764307f2561ebafa556b6da0f39ff7c4"}
Jul 24 14:26:54.475314 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:54.475232    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc" event={"ID":"aa409b4b-df69-4609-b229-5ac03d35c3e7","Type":"ContainerStarted","Data":"d52b565a55ecc2d90709324dc12fd90e80f0806f1ff2c8c079237c80c82fad02"}
Jul 24 14:26:54.507149 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:54.507099    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc" podStartSLOduration=1.507078162 podStartE2EDuration="1.507078162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:54.504696109 +0000 UTC m=+2522.740047472" watchObservedRunningTime="2026-07-24 14:26:54.507078162 +0000 UTC m=+2522.742429524"
Jul 24 14:26:55.482061 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:55.482027    2565 generic.go:356] "Generic (PLEG): container finished" podID="aa409b4b-df69-4609-b229-5ac03d35c3e7" containerID="53e0bf6ec67616f9fd80d31dc561427a764307f2561ebafa556b6da0f39ff7c4" exitCode=0
Jul 24 14:26:55.482508 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:55.482121    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc" event={"ID":"aa409b4b-df69-4609-b229-5ac03d35c3e7","Type":"ContainerDied","Data":"53e0bf6ec67616f9fd80d31dc561427a764307f2561ebafa556b6da0f39ff7c4"}
Jul 24 14:26:56.620719 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:56.620694    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc"
Jul 24 14:26:56.703539 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:56.703505    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa409b4b-df69-4609-b229-5ac03d35c3e7-maas-api-service-ca\") pod \"aa409b4b-df69-4609-b229-5ac03d35c3e7\" (UID: \"aa409b4b-df69-4609-b229-5ac03d35c3e7\") "
Jul 24 14:26:56.703900 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:56.703875    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa409b4b-df69-4609-b229-5ac03d35c3e7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aa409b4b-df69-4609-b229-5ac03d35c3e7" (UID: "aa409b4b-df69-4609-b229-5ac03d35c3e7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:26:56.804692 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:56.804664    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa409b4b-df69-4609-b229-5ac03d35c3e7-maas-api-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:26:57.492645 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:57.492605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc" event={"ID":"aa409b4b-df69-4609-b229-5ac03d35c3e7","Type":"ContainerDied","Data":"d52b565a55ecc2d90709324dc12fd90e80f0806f1ff2c8c079237c80c82fad02"}
Jul 24 14:26:57.492645 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:57.492632    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc"
Jul 24 14:26:57.492846 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:57.492660    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d52b565a55ecc2d90709324dc12fd90e80f0806f1ff2c8c079237c80c82fad02"
Jul 24 14:26:57.647748 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:26:57.647712    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:27:07.676404 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.676355    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9" podUID="4158d13b-5096-451d-8de9-bcbf752fd69e" containerName="main" containerID="cri-o://fd41736baa63dd91754bf3fcf16c13abd6650791a4dc26195c1f0ee2f1e51f45" gracePeriod=45
Jul 24 14:27:07.928138 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.928066    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:27:07.996472 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.996430    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-tmp-dir\") pod \"4158d13b-5096-451d-8de9-bcbf752fd69e\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") "
Jul 24 14:27:07.996677 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.996494    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4158d13b-5096-451d-8de9-bcbf752fd69e-tls-certs\") pod \"4158d13b-5096-451d-8de9-bcbf752fd69e\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") "
Jul 24 14:27:07.996677 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.996523    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65pqb\" (UniqueName: \"kubernetes.io/projected/4158d13b-5096-451d-8de9-bcbf752fd69e-kube-api-access-65pqb\") pod \"4158d13b-5096-451d-8de9-bcbf752fd69e\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") "
Jul 24 14:27:07.996677 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.996563    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-model-cache\") pod \"4158d13b-5096-451d-8de9-bcbf752fd69e\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") "
Jul 24 14:27:07.996677 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.996596    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-dshm\") pod \"4158d13b-5096-451d-8de9-bcbf752fd69e\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") "
Jul 24 14:27:07.996897 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.996742    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-home\") pod \"4158d13b-5096-451d-8de9-bcbf752fd69e\" (UID: \"4158d13b-5096-451d-8de9-bcbf752fd69e\") "
Jul 24 14:27:07.996897 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.996783    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4158d13b-5096-451d-8de9-bcbf752fd69e" (UID: "4158d13b-5096-451d-8de9-bcbf752fd69e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:27:07.997009 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.996905    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-model-cache" (OuterVolumeSpecName: "model-cache") pod "4158d13b-5096-451d-8de9-bcbf752fd69e" (UID: "4158d13b-5096-451d-8de9-bcbf752fd69e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:27:07.997009 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.996990    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-home" (OuterVolumeSpecName: "home") pod "4158d13b-5096-451d-8de9-bcbf752fd69e" (UID: "4158d13b-5096-451d-8de9-bcbf752fd69e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:27:07.997148 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.997129    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-tmp-dir\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:27:07.997232 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.997154    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-model-cache\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:27:07.997232 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.997164    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-home\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:27:07.999069 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.999043    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-dshm" (OuterVolumeSpecName: "dshm") pod "4158d13b-5096-451d-8de9-bcbf752fd69e" (UID: "4158d13b-5096-451d-8de9-bcbf752fd69e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:27:07.999204 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.999077    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4158d13b-5096-451d-8de9-bcbf752fd69e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4158d13b-5096-451d-8de9-bcbf752fd69e" (UID: "4158d13b-5096-451d-8de9-bcbf752fd69e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:27:07.999204 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:07.999077    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4158d13b-5096-451d-8de9-bcbf752fd69e-kube-api-access-65pqb" (OuterVolumeSpecName: "kube-api-access-65pqb") pod "4158d13b-5096-451d-8de9-bcbf752fd69e" (UID: "4158d13b-5096-451d-8de9-bcbf752fd69e"). InnerVolumeSpecName "kube-api-access-65pqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:27:08.097688 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.097633    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4158d13b-5096-451d-8de9-bcbf752fd69e-dshm\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:27:08.097688 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.097678    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4158d13b-5096-451d-8de9-bcbf752fd69e-tls-certs\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:27:08.097688 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.097689    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65pqb\" (UniqueName: \"kubernetes.io/projected/4158d13b-5096-451d-8de9-bcbf752fd69e-kube-api-access-65pqb\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:27:08.545233 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.545123    2565 generic.go:356] "Generic (PLEG): container finished" podID="4158d13b-5096-451d-8de9-bcbf752fd69e" containerID="fd41736baa63dd91754bf3fcf16c13abd6650791a4dc26195c1f0ee2f1e51f45" exitCode=0
Jul 24 14:27:08.545233 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.545205    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"
Jul 24 14:27:08.545233 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.545216    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9" event={"ID":"4158d13b-5096-451d-8de9-bcbf752fd69e","Type":"ContainerDied","Data":"fd41736baa63dd91754bf3fcf16c13abd6650791a4dc26195c1f0ee2f1e51f45"}
Jul 24 14:27:08.545466 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.545263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9" event={"ID":"4158d13b-5096-451d-8de9-bcbf752fd69e","Type":"ContainerDied","Data":"39452c6949822f12a44f3b9d87a453360ccae91e477eb5beb85e441cec771a9e"}
Jul 24 14:27:08.545466 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.545280    2565 scope.go:117] "RemoveContainer" containerID="fd41736baa63dd91754bf3fcf16c13abd6650791a4dc26195c1f0ee2f1e51f45"
Jul 24 14:27:08.554141 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.554121    2565 scope.go:117] "RemoveContainer" containerID="fd41736baa63dd91754bf3fcf16c13abd6650791a4dc26195c1f0ee2f1e51f45"
Jul 24 14:27:08.554437 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:27:08.554416    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd41736baa63dd91754bf3fcf16c13abd6650791a4dc26195c1f0ee2f1e51f45\": container with ID starting with fd41736baa63dd91754bf3fcf16c13abd6650791a4dc26195c1f0ee2f1e51f45 not found: ID does not exist" containerID="fd41736baa63dd91754bf3fcf16c13abd6650791a4dc26195c1f0ee2f1e51f45"
Jul 24 14:27:08.554533 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.554446    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd41736baa63dd91754bf3fcf16c13abd6650791a4dc26195c1f0ee2f1e51f45"} err="failed to get container status \"fd41736baa63dd91754bf3fcf16c13abd6650791a4dc26195c1f0ee2f1e51f45\": rpc error: code = NotFound desc = could not find container \"fd41736baa63dd91754bf3fcf16c13abd6650791a4dc26195c1f0ee2f1e51f45\": container with ID starting with fd41736baa63dd91754bf3fcf16c13abd6650791a4dc26195c1f0ee2f1e51f45 not found: ID does not exist"
Jul 24 14:27:08.561902 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.561874    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"]
Jul 24 14:27:08.568154 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.568129    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-bbfced/test-model-bbfced-kserve-5df8d5b97c-mtvd9"]
Jul 24 14:27:08.591234 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.591164    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l" podUID="aa8d207b-5497-4c83-9a32-7e858ef8948d" containerName="main" containerID="cri-o://15010a43d337cc0a832cb883e5e784a44946b14719cd1fa5bbcbff1dec0b400c" gracePeriod=45
Jul 24 14:27:08.810250 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.810218    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc"]
Jul 24 14:27:08.812660 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.812631    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bbfced-9g4mc"]
Jul 24 14:27:08.852657 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.852630    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:27:08.905598 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.905565    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-dshm\") pod \"aa8d207b-5497-4c83-9a32-7e858ef8948d\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") "
Jul 24 14:27:08.905598 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.905600    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4l62\" (UniqueName: \"kubernetes.io/projected/aa8d207b-5497-4c83-9a32-7e858ef8948d-kube-api-access-w4l62\") pod \"aa8d207b-5497-4c83-9a32-7e858ef8948d\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") "
Jul 24 14:27:08.905845 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.905634    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-tmp-dir\") pod \"aa8d207b-5497-4c83-9a32-7e858ef8948d\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") "
Jul 24 14:27:08.905845 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.905690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-home\") pod \"aa8d207b-5497-4c83-9a32-7e858ef8948d\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") "
Jul 24 14:27:08.905845 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.905714    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8d207b-5497-4c83-9a32-7e858ef8948d-tls-certs\") pod \"aa8d207b-5497-4c83-9a32-7e858ef8948d\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") "
Jul 24 14:27:08.905845 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.905760    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-model-cache\") pod \"aa8d207b-5497-4c83-9a32-7e858ef8948d\" (UID: \"aa8d207b-5497-4c83-9a32-7e858ef8948d\") "
Jul 24 14:27:08.906047 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.905954    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-home" (OuterVolumeSpecName: "home") pod "aa8d207b-5497-4c83-9a32-7e858ef8948d" (UID: "aa8d207b-5497-4c83-9a32-7e858ef8948d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:27:08.906047 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.905988    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aa8d207b-5497-4c83-9a32-7e858ef8948d" (UID: "aa8d207b-5497-4c83-9a32-7e858ef8948d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:27:08.906136 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.906058    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-model-cache" (OuterVolumeSpecName: "model-cache") pod "aa8d207b-5497-4c83-9a32-7e858ef8948d" (UID: "aa8d207b-5497-4c83-9a32-7e858ef8948d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:27:08.906136 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.906084    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-home\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:27:08.906136 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.906100    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-tmp-dir\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:27:08.908236 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.908210    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa8d207b-5497-4c83-9a32-7e858ef8948d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aa8d207b-5497-4c83-9a32-7e858ef8948d" (UID: "aa8d207b-5497-4c83-9a32-7e858ef8948d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:27:08.908236 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.908224    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa8d207b-5497-4c83-9a32-7e858ef8948d-kube-api-access-w4l62" (OuterVolumeSpecName: "kube-api-access-w4l62") pod "aa8d207b-5497-4c83-9a32-7e858ef8948d" (UID: "aa8d207b-5497-4c83-9a32-7e858ef8948d"). InnerVolumeSpecName "kube-api-access-w4l62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:27:08.908236 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:08.908209    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-dshm" (OuterVolumeSpecName: "dshm") pod "aa8d207b-5497-4c83-9a32-7e858ef8948d" (UID: "aa8d207b-5497-4c83-9a32-7e858ef8948d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:27:09.007503 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:09.007462    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8d207b-5497-4c83-9a32-7e858ef8948d-tls-certs\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:27:09.007503 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:09.007494    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-model-cache\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:27:09.007503 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:09.007503    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8d207b-5497-4c83-9a32-7e858ef8948d-dshm\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:27:09.007503 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:09.007512    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4l62\" (UniqueName: \"kubernetes.io/projected/aa8d207b-5497-4c83-9a32-7e858ef8948d-kube-api-access-w4l62\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:27:09.552357 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:09.552315    2565 generic.go:356] "Generic (PLEG): container finished" podID="aa8d207b-5497-4c83-9a32-7e858ef8948d" containerID="15010a43d337cc0a832cb883e5e784a44946b14719cd1fa5bbcbff1dec0b400c" exitCode=0
Jul 24 14:27:09.552570 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:09.552361    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"
Jul 24 14:27:09.552570 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:09.552378    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l" event={"ID":"aa8d207b-5497-4c83-9a32-7e858ef8948d","Type":"ContainerDied","Data":"15010a43d337cc0a832cb883e5e784a44946b14719cd1fa5bbcbff1dec0b400c"}
Jul 24 14:27:09.552570 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:09.552409    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l" event={"ID":"aa8d207b-5497-4c83-9a32-7e858ef8948d","Type":"ContainerDied","Data":"204f069bcd9805f7f64940d4b6ff7aacf0a454e6993af8ad5b8a75351d6d5430"}
Jul 24 14:27:09.552570 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:09.552425    2565 scope.go:117] "RemoveContainer" containerID="15010a43d337cc0a832cb883e5e784a44946b14719cd1fa5bbcbff1dec0b400c"
Jul 24 14:27:09.561666 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:09.561641    2565 scope.go:117] "RemoveContainer" containerID="15010a43d337cc0a832cb883e5e784a44946b14719cd1fa5bbcbff1dec0b400c"
Jul 24 14:27:09.561939 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:27:09.561919    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15010a43d337cc0a832cb883e5e784a44946b14719cd1fa5bbcbff1dec0b400c\": container with ID starting with 15010a43d337cc0a832cb883e5e784a44946b14719cd1fa5bbcbff1dec0b400c not found: ID does not exist" containerID="15010a43d337cc0a832cb883e5e784a44946b14719cd1fa5bbcbff1dec0b400c"
Jul 24 14:27:09.562012 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:09.561951    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15010a43d337cc0a832cb883e5e784a44946b14719cd1fa5bbcbff1dec0b400c"} err="failed to get container status \"15010a43d337cc0a832cb883e5e784a44946b14719cd1fa5bbcbff1dec0b400c\": rpc error: code = NotFound desc = could not find container \"15010a43d337cc0a832cb883e5e784a44946b14719cd1fa5bbcbff1dec0b400c\": container with ID starting with 15010a43d337cc0a832cb883e5e784a44946b14719cd1fa5bbcbff1dec0b400c not found: ID does not exist"
Jul 24 14:27:09.575411 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:09.575379    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"]
Jul 24 14:27:09.581632 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:09.581604    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-aa51de/test-model-aa51de-kserve-7c4b8756d7-ltn6l"]
Jul 24 14:27:10.196157 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:10.196107    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4158d13b-5096-451d-8de9-bcbf752fd69e" path="/var/lib/kubelet/pods/4158d13b-5096-451d-8de9-bcbf752fd69e/volumes"
Jul 24 14:27:10.196680 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:10.196625    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa409b4b-df69-4609-b229-5ac03d35c3e7" path="/var/lib/kubelet/pods/aa409b4b-df69-4609-b229-5ac03d35c3e7/volumes"
Jul 24 14:27:10.197045 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:10.197024    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa8d207b-5497-4c83-9a32-7e858ef8948d" path="/var/lib/kubelet/pods/aa8d207b-5497-4c83-9a32-7e858ef8948d/volumes"
Jul 24 14:27:13.046773 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:13.046735    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:27:15.717959 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.717923    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh"]
Jul 24 14:27:15.718379 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.718279    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4158d13b-5096-451d-8de9-bcbf752fd69e" containerName="main"
Jul 24 14:27:15.718379 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.718289    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4158d13b-5096-451d-8de9-bcbf752fd69e" containerName="main"
Jul 24 14:27:15.718379 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.718303    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa409b4b-df69-4609-b229-5ac03d35c3e7" containerName="revoke-keys"
Jul 24 14:27:15.718379 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.718310    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa409b4b-df69-4609-b229-5ac03d35c3e7" containerName="revoke-keys"
Jul 24 14:27:15.718379 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.718319    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa8d207b-5497-4c83-9a32-7e858ef8948d" containerName="main"
Jul 24 14:27:15.718379 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.718324    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa8d207b-5497-4c83-9a32-7e858ef8948d" containerName="main"
Jul 24 14:27:15.718567 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.718401    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa8d207b-5497-4c83-9a32-7e858ef8948d" containerName="main"
Jul 24 14:27:15.718567 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.718411    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa409b4b-df69-4609-b229-5ac03d35c3e7" containerName="revoke-keys"
Jul 24 14:27:15.718567 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.718418    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4158d13b-5096-451d-8de9-bcbf752fd69e" containerName="main"
Jul 24 14:27:15.722814 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.722797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh"
Jul 24 14:27:15.726513 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.726494    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 14:27:15.726600 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.726525    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:27:15.735926 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.735902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh"]
Jul 24 14:27:15.768611 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.768575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6f8fc4-7830-4562-af1b-73893cbf2345-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh\" (UID: \"da6f8fc4-7830-4562-af1b-73893cbf2345\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh"
Jul 24 14:27:15.869744 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.869704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6f8fc4-7830-4562-af1b-73893cbf2345-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh\" (UID: \"da6f8fc4-7830-4562-af1b-73893cbf2345\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh"
Jul 24 14:27:15.870434 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:15.870409    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6f8fc4-7830-4562-af1b-73893cbf2345-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh\" (UID: \"da6f8fc4-7830-4562-af1b-73893cbf2345\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh"
Jul 24 14:27:16.033360 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:16.033253    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh"
Jul 24 14:27:16.173122 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:16.173092    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh"]
Jul 24 14:27:16.174965 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:27:16.174941    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6f8fc4_7830_4562_af1b_73893cbf2345.slice/crio-8035ff29a89056ce9a178392fd5d4d75a854b623ba14f17c1ac8b099421d39d3 WatchSource:0}: Error finding container 8035ff29a89056ce9a178392fd5d4d75a854b623ba14f17c1ac8b099421d39d3: Status 404 returned error can't find the container with id 8035ff29a89056ce9a178392fd5d4d75a854b623ba14f17c1ac8b099421d39d3
Jul 24 14:27:16.588004 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:16.587966    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh" event={"ID":"da6f8fc4-7830-4562-af1b-73893cbf2345","Type":"ContainerStarted","Data":"e740a1d24d98d605a28be4175e9534c0509575f6998a0cf2b7fb8c1eb300d784"}
Jul 24 14:27:16.588212 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:16.588017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh" event={"ID":"da6f8fc4-7830-4562-af1b-73893cbf2345","Type":"ContainerStarted","Data":"8035ff29a89056ce9a178392fd5d4d75a854b623ba14f17c1ac8b099421d39d3"}
Jul 24 14:27:16.606165 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:16.606044    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh" podStartSLOduration=1.606028067 podStartE2EDuration="1.606028067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:27:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:16.604439618 +0000 UTC m=+2544.839790980" watchObservedRunningTime="2026-07-24 14:27:16.606028067 +0000 UTC m=+2544.841379465"
Jul 24 14:27:17.595283 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:17.595245    2565 generic.go:356] "Generic (PLEG): container finished" podID="da6f8fc4-7830-4562-af1b-73893cbf2345" containerID="e740a1d24d98d605a28be4175e9534c0509575f6998a0cf2b7fb8c1eb300d784" exitCode=0
Jul 24 14:27:17.595666 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:17.595345    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh" event={"ID":"da6f8fc4-7830-4562-af1b-73893cbf2345","Type":"ContainerDied","Data":"e740a1d24d98d605a28be4175e9534c0509575f6998a0cf2b7fb8c1eb300d784"}
Jul 24 14:27:18.735485 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:18.735459    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh"
Jul 24 14:27:18.797129 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:18.797096    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6f8fc4-7830-4562-af1b-73893cbf2345-maas-api-service-ca\") pod \"da6f8fc4-7830-4562-af1b-73893cbf2345\" (UID: \"da6f8fc4-7830-4562-af1b-73893cbf2345\") "
Jul 24 14:27:18.797587 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:18.797558    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da6f8fc4-7830-4562-af1b-73893cbf2345-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "da6f8fc4-7830-4562-af1b-73893cbf2345" (UID: "da6f8fc4-7830-4562-af1b-73893cbf2345"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:27:18.898775 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:18.898684    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6f8fc4-7830-4562-af1b-73893cbf2345-maas-api-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:27:19.605543 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:19.605510    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh"
Jul 24 14:27:19.605695 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:19.605519    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh" event={"ID":"da6f8fc4-7830-4562-af1b-73893cbf2345","Type":"ContainerDied","Data":"8035ff29a89056ce9a178392fd5d4d75a854b623ba14f17c1ac8b099421d39d3"}
Jul 24 14:27:19.605695 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:19.605633    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8035ff29a89056ce9a178392fd5d4d75a854b623ba14f17c1ac8b099421d39d3"
Jul 24 14:27:29.238503 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:29.238466    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:27:30.802279 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:30.802241    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh"]
Jul 24 14:27:30.804057 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:30.804029    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa51de-54qvh"]
Jul 24 14:27:32.201048 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:32.201014    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da6f8fc4-7830-4562-af1b-73893cbf2345" path="/var/lib/kubelet/pods/da6f8fc4-7830-4562-af1b-73893cbf2345/volumes"
Jul 24 14:27:48.843607 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:48.843567    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:27:52.438874 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:27:52.438841    2565 scope.go:117] "RemoveContainer" containerID="c2193916a0c77484cd1f17f27873511a229ffca61034bd6b060c96eeff8604db"
Jul 24 14:28:02.726935 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:02.726896    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw"]
Jul 24 14:28:02.727472 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:02.727299    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6f8fc4-7830-4562-af1b-73893cbf2345" containerName="revoke-keys"
Jul 24 14:28:02.727472 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:02.727311    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6f8fc4-7830-4562-af1b-73893cbf2345" containerName="revoke-keys"
Jul 24 14:28:02.727472 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:02.727370    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6f8fc4-7830-4562-af1b-73893cbf2345" containerName="revoke-keys"
Jul 24 14:28:02.730044 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:02.730020    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw"
Jul 24 14:28:02.733005 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:02.732973    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:28:02.733136 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:02.732976    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 14:28:02.742398 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:02.742363    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw"]
Jul 24 14:28:02.801606 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:02.801569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/575a480d-eb22-47a7-baff-8f5f9f4cbefc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw\" (UID: \"575a480d-eb22-47a7-baff-8f5f9f4cbefc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw"
Jul 24 14:28:02.902889 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:02.902847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/575a480d-eb22-47a7-baff-8f5f9f4cbefc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw\" (UID: \"575a480d-eb22-47a7-baff-8f5f9f4cbefc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw"
Jul 24 14:28:02.903543 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:02.903518    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/575a480d-eb22-47a7-baff-8f5f9f4cbefc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw\" (UID: \"575a480d-eb22-47a7-baff-8f5f9f4cbefc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw"
Jul 24 14:28:03.041901 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:03.041804    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw"
Jul 24 14:28:03.184850 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:03.184720    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw"]
Jul 24 14:28:03.187120 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:28:03.187083    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575a480d_eb22_47a7_baff_8f5f9f4cbefc.slice/crio-e50e690cf4355ba242b30771c4f650950803537e2561efe01a818ede524fe2dc WatchSource:0}: Error finding container e50e690cf4355ba242b30771c4f650950803537e2561efe01a818ede524fe2dc: Status 404 returned error can't find the container with id e50e690cf4355ba242b30771c4f650950803537e2561efe01a818ede524fe2dc
Jul 24 14:28:03.819419 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:03.819382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw" event={"ID":"575a480d-eb22-47a7-baff-8f5f9f4cbefc","Type":"ContainerStarted","Data":"72399070cc60fdc1eeedfc480fe7b3c299c5a08df57f11c5fbd1309dffa0c8e9"}
Jul 24 14:28:03.819827 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:03.819435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw" event={"ID":"575a480d-eb22-47a7-baff-8f5f9f4cbefc","Type":"ContainerStarted","Data":"e50e690cf4355ba242b30771c4f650950803537e2561efe01a818ede524fe2dc"}
Jul 24 14:28:03.835552 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:03.835493    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw" podStartSLOduration=1.8354726540000001 podStartE2EDuration="1.835472654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:28:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:28:03.834520276 +0000 UTC m=+2592.069871637" watchObservedRunningTime="2026-07-24 14:28:03.835472654 +0000 UTC m=+2592.070824016"
Jul 24 14:28:04.825838 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:04.825801    2565 generic.go:356] "Generic (PLEG): container finished" podID="575a480d-eb22-47a7-baff-8f5f9f4cbefc" containerID="72399070cc60fdc1eeedfc480fe7b3c299c5a08df57f11c5fbd1309dffa0c8e9" exitCode=0
Jul 24 14:28:04.826261 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:04.825888    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw" event={"ID":"575a480d-eb22-47a7-baff-8f5f9f4cbefc","Type":"ContainerDied","Data":"72399070cc60fdc1eeedfc480fe7b3c299c5a08df57f11c5fbd1309dffa0c8e9"}
Jul 24 14:28:05.962679 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:05.962644    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw"
Jul 24 14:28:06.030436 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:06.030396    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/575a480d-eb22-47a7-baff-8f5f9f4cbefc-maas-api-service-ca\") pod \"575a480d-eb22-47a7-baff-8f5f9f4cbefc\" (UID: \"575a480d-eb22-47a7-baff-8f5f9f4cbefc\") "
Jul 24 14:28:06.030784 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:06.030760    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/575a480d-eb22-47a7-baff-8f5f9f4cbefc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "575a480d-eb22-47a7-baff-8f5f9f4cbefc" (UID: "575a480d-eb22-47a7-baff-8f5f9f4cbefc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:06.131333 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:06.131249    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/575a480d-eb22-47a7-baff-8f5f9f4cbefc-maas-api-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:28:06.436071 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:06.435987    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:28:06.837701 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:06.837662    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw" event={"ID":"575a480d-eb22-47a7-baff-8f5f9f4cbefc","Type":"ContainerDied","Data":"e50e690cf4355ba242b30771c4f650950803537e2561efe01a818ede524fe2dc"}
Jul 24 14:28:06.837701 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:06.837693    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw"
Jul 24 14:28:06.837920 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:06.837719    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e50e690cf4355ba242b30771c4f650950803537e2561efe01a818ede524fe2dc"
Jul 24 14:28:22.962208 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:22.962154    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw"]
Jul 24 14:28:22.963855 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:22.963834    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e7d231-f9jcw"]
Jul 24 14:28:24.063303 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:24.063264    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:28:24.195497 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:24.195461    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="575a480d-eb22-47a7-baff-8f5f9f4cbefc" path="/var/lib/kubelet/pods/575a480d-eb22-47a7-baff-8f5f9f4cbefc/volumes"
Jul 24 14:28:30.179728 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.179689    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n"]
Jul 24 14:28:30.180121 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.180053    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="575a480d-eb22-47a7-baff-8f5f9f4cbefc" containerName="revoke-keys"
Jul 24 14:28:30.180121 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.180063    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="575a480d-eb22-47a7-baff-8f5f9f4cbefc" containerName="revoke-keys"
Jul 24 14:28:30.180121 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.180117    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="575a480d-eb22-47a7-baff-8f5f9f4cbefc" containerName="revoke-keys"
Jul 24 14:28:30.183138 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.183118    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n"
Jul 24 14:28:30.190150 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.190110    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 14:28:30.190297 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.190163    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:28:30.198676 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.198650    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n"]
Jul 24 14:28:30.353478 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.353436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fc786e-b19a-43e5-aecb-4040eb239d28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n\" (UID: \"d1fc786e-b19a-43e5-aecb-4040eb239d28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n"
Jul 24 14:28:30.454121 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.454034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fc786e-b19a-43e5-aecb-4040eb239d28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n\" (UID: \"d1fc786e-b19a-43e5-aecb-4040eb239d28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n"
Jul 24 14:28:30.454654 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.454633    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fc786e-b19a-43e5-aecb-4040eb239d28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n\" (UID: \"d1fc786e-b19a-43e5-aecb-4040eb239d28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n"
Jul 24 14:28:30.494062 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.494019    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n"
Jul 24 14:28:30.646211 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:28:30.646165    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1fc786e_b19a_43e5_aecb_4040eb239d28.slice/crio-2f0890423da7029896cd628da12ee88bf77eab5b6ee88739ed2ca7e4fe0d193e WatchSource:0}: Error finding container 2f0890423da7029896cd628da12ee88bf77eab5b6ee88739ed2ca7e4fe0d193e: Status 404 returned error can't find the container with id 2f0890423da7029896cd628da12ee88bf77eab5b6ee88739ed2ca7e4fe0d193e
Jul 24 14:28:30.647812 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.647789    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n"]
Jul 24 14:28:30.956853 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.956820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n" event={"ID":"d1fc786e-b19a-43e5-aecb-4040eb239d28","Type":"ContainerStarted","Data":"45ece113e22f55cb21df53630fecc520e210c3500e836d1871e38d1b772af30e"}
Jul 24 14:28:30.957006 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.956871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n" event={"ID":"d1fc786e-b19a-43e5-aecb-4040eb239d28","Type":"ContainerStarted","Data":"2f0890423da7029896cd628da12ee88bf77eab5b6ee88739ed2ca7e4fe0d193e"}
Jul 24 14:28:30.992780 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:30.992727    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n" podStartSLOduration=0.992710513 podStartE2EDuration="992.710513ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:28:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:28:30.992464199 +0000 UTC m=+2619.227815563" watchObservedRunningTime="2026-07-24 14:28:30.992710513 +0000 UTC m=+2619.228061991"
Jul 24 14:28:31.964226 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:31.964193    2565 generic.go:356] "Generic (PLEG): container finished" podID="d1fc786e-b19a-43e5-aecb-4040eb239d28" containerID="45ece113e22f55cb21df53630fecc520e210c3500e836d1871e38d1b772af30e" exitCode=0
Jul 24 14:28:31.964675 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:31.964244    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n" event={"ID":"d1fc786e-b19a-43e5-aecb-4040eb239d28","Type":"ContainerDied","Data":"45ece113e22f55cb21df53630fecc520e210c3500e836d1871e38d1b772af30e"}
Jul 24 14:28:33.103974 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:33.103948    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n"
Jul 24 14:28:33.176524 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:33.176489    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fc786e-b19a-43e5-aecb-4040eb239d28-maas-api-service-ca\") pod \"d1fc786e-b19a-43e5-aecb-4040eb239d28\" (UID: \"d1fc786e-b19a-43e5-aecb-4040eb239d28\") "
Jul 24 14:28:33.176854 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:33.176828    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1fc786e-b19a-43e5-aecb-4040eb239d28-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d1fc786e-b19a-43e5-aecb-4040eb239d28" (UID: "d1fc786e-b19a-43e5-aecb-4040eb239d28"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:33.277681 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:33.277593    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1fc786e-b19a-43e5-aecb-4040eb239d28-maas-api-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:28:33.974549 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:33.974524    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n"
Jul 24 14:28:33.974549 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:33.974540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n" event={"ID":"d1fc786e-b19a-43e5-aecb-4040eb239d28","Type":"ContainerDied","Data":"2f0890423da7029896cd628da12ee88bf77eab5b6ee88739ed2ca7e4fe0d193e"}
Jul 24 14:28:33.974773 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:33.974582    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f0890423da7029896cd628da12ee88bf77eab5b6ee88739ed2ca7e4fe0d193e"
Jul 24 14:28:50.254506 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:50.254465    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n"]
Jul 24 14:28:50.257670 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:50.257640    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-45b6b7-fjb6n"]
Jul 24 14:28:51.960905 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:51.960872    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:28:52.194857 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:28:52.194811    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1fc786e-b19a-43e5-aecb-4040eb239d28" path="/var/lib/kubelet/pods/d1fc786e-b19a-43e5-aecb-4040eb239d28/volumes"
Jul 24 14:29:07.559542 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:07.559505    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:29:23.904402 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:23.904362    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:29:32.964209 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:32.964156    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"]
Jul 24 14:29:32.964790 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:32.964525    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1fc786e-b19a-43e5-aecb-4040eb239d28" containerName="revoke-keys"
Jul 24 14:29:32.964790 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:32.964535    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1fc786e-b19a-43e5-aecb-4040eb239d28" containerName="revoke-keys"
Jul 24 14:29:32.964790 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:32.964605    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1fc786e-b19a-43e5-aecb-4040eb239d28" containerName="revoke-keys"
Jul 24 14:29:32.967785 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:32.967761    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:32.974809 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:32.974769    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-94af13\"/\"openshift-service-ca.crt\""
Jul 24 14:29:32.974987 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:32.974813    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-94af13\"/\"auth-test-model-94af13-kserve-self-signed-certs\""
Jul 24 14:29:32.975705 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:32.975680    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-94af13\"/\"kube-root-ca.crt\""
Jul 24 14:29:32.975839 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:32.975722    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-94af13\"/\"default-dockercfg-lrxvm\""
Jul 24 14:29:32.984397 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:32.984369    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"]
Jul 24 14:29:33.009058 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.009020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/256dab97-d6e4-432e-a054-a380d1c35de0-tls-certs\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.009058 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.009061    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88jkp\" (UniqueName: \"kubernetes.io/projected/256dab97-d6e4-432e-a054-a380d1c35de0-kube-api-access-88jkp\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.009309 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.009083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-tmp-dir\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.009309 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.009203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-model-cache\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.009309 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.009280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-dshm\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.009437 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.009322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-home\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.110697 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.110652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-model-cache\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.110898 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.110709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-dshm\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.110898 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.110737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-home\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.110898 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.110766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/256dab97-d6e4-432e-a054-a380d1c35de0-tls-certs\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.110898 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.110789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88jkp\" (UniqueName: \"kubernetes.io/projected/256dab97-d6e4-432e-a054-a380d1c35de0-kube-api-access-88jkp\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.110898 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.110807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-tmp-dir\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.111266 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.111241    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-model-cache\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.111357 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.111268    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-tmp-dir\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.111357 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.111309    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-home\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.113277 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.113251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-dshm\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.113531 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.113513    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/256dab97-d6e4-432e-a054-a380d1c35de0-tls-certs\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.121443 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.121420    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88jkp\" (UniqueName: \"kubernetes.io/projected/256dab97-d6e4-432e-a054-a380d1c35de0-kube-api-access-88jkp\") pod \"auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") " pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.283705 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.283610    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:33.435075 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:33.435035    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"]
Jul 24 14:29:33.437747 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:29:33.437719    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod256dab97_d6e4_432e_a054_a380d1c35de0.slice/crio-729b86c8f0d4c3eeccc652c989ea242edc649dacc0ace443d9fd69b3a4b9b5e0 WatchSource:0}: Error finding container 729b86c8f0d4c3eeccc652c989ea242edc649dacc0ace443d9fd69b3a4b9b5e0: Status 404 returned error can't find the container with id 729b86c8f0d4c3eeccc652c989ea242edc649dacc0ace443d9fd69b3a4b9b5e0
Jul 24 14:29:34.263365 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:34.263330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9" event={"ID":"256dab97-d6e4-432e-a054-a380d1c35de0","Type":"ContainerStarted","Data":"239ab7765d0f24a133844227cae41a579d3f7d1cf760524c4995381c9bcdfd27"}
Jul 24 14:29:34.263365 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:34.263372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9" event={"ID":"256dab97-d6e4-432e-a054-a380d1c35de0","Type":"ContainerStarted","Data":"729b86c8f0d4c3eeccc652c989ea242edc649dacc0ace443d9fd69b3a4b9b5e0"}
Jul 24 14:29:36.567808 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:36.567747    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9" podStartSLOduration=4.56772768 podStartE2EDuration="4.56772768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:29:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:29:34.305467013 +0000 UTC m=+2682.540818375" watchObservedRunningTime="2026-07-24 14:29:36.56772768 +0000 UTC m=+2684.803079042"
Jul 24 14:29:36.568226 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:36.568096    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:29:43.284152 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:43.284053    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:43.284588 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:43.284214    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:43.296636 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:43.296610    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:43.320098 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:43.320058    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:29:52.363635 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:52.363610    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:29:52.371610 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:52.371585    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:29:52.857005 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:52.856977    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"]
Jul 24 14:29:52.860911 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:52.860879    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:52.863821 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:52.863790    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-938af8\"/\"kube-root-ca.crt\""
Jul 24 14:29:52.863978 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:52.863838    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-938af8\"/\"openshift-service-ca.crt\""
Jul 24 14:29:52.864988 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:52.864967    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-938af8\"/\"auth-test-model-938af8-kserve-self-signed-certs\""
Jul 24 14:29:52.865114 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:52.865075    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-938af8\"/\"default-dockercfg-mwphr\""
Jul 24 14:29:52.870573 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:52.870549    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"]
Jul 24 14:29:53.000972 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.000928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-dshm\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.000972 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.000974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fqwp\" (UniqueName: \"kubernetes.io/projected/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-kube-api-access-8fqwp\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.001286 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.001117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-tmp-dir\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.001286 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.001253    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-model-cache\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.001286 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.001275    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-home\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.001405 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.001290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-tls-certs\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.102435 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.102398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-tmp-dir\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.102594 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.102473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-model-cache\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.102594 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.102494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-home\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.102594 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.102509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-tls-certs\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.102594 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.102531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-dshm\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.102594 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.102552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fqwp\" (UniqueName: \"kubernetes.io/projected/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-kube-api-access-8fqwp\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.102895 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.102864    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-tmp-dir\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.102895 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.102880    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-model-cache\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.103003 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.102907    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-home\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.105023 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.104999    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-dshm\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.105396 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.105378    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-tls-certs\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.110972 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.110902    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fqwp\" (UniqueName: \"kubernetes.io/projected/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-kube-api-access-8fqwp\") pod \"auth-test-model-938af8-kserve-67c6cbbc79-m6ktg\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") " pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.172383 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.172343    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:29:53.311845 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.311814    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"]
Jul 24 14:29:53.314849 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:29:53.314819    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9da24af_d4a7_44d0_a95b_5d2ff8512a10.slice/crio-d6fbf288467fc093b00776613b6bd0f22337bd85b56a1c52b31b21e0d38adf84 WatchSource:0}: Error finding container d6fbf288467fc093b00776613b6bd0f22337bd85b56a1c52b31b21e0d38adf84: Status 404 returned error can't find the container with id d6fbf288467fc093b00776613b6bd0f22337bd85b56a1c52b31b21e0d38adf84
Jul 24 14:29:53.359775 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:53.359741    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg" event={"ID":"e9da24af-d4a7-44d0-a95b-5d2ff8512a10","Type":"ContainerStarted","Data":"d6fbf288467fc093b00776613b6bd0f22337bd85b56a1c52b31b21e0d38adf84"}
Jul 24 14:29:54.366300 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:54.366254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg" event={"ID":"e9da24af-d4a7-44d0-a95b-5d2ff8512a10","Type":"ContainerStarted","Data":"c7b304aae0340f2e4da48c460902466895327c8617ab9619146b4a10a0d39387"}
Jul 24 14:29:54.387516 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:54.387460    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg" podStartSLOduration=2.387441187 podStartE2EDuration="2.387441187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:29:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:29:54.385465402 +0000 UTC m=+2702.620816776" watchObservedRunningTime="2026-07-24 14:29:54.387441187 +0000 UTC m=+2702.622792548"
Jul 24 14:29:56.550750 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:29:56.550709    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:30:00.137300 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:00.137252    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748390-nps29"]
Jul 24 14:30:00.140741 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:00.140715    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-938af8-29748390-nrbg4"]
Jul 24 14:30:00.140900 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:00.140828    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748390-nps29"
Jul 24 14:30:00.143540 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:00.143516    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:30:00.143946 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:00.143928    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-938af8-29748390-nrbg4"
Jul 24 14:30:00.149066 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:00.148990    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748390-nps29"]
Jul 24 14:30:00.153521 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:00.153501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748390-nps29"
Jul 24 14:30:00.161484 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:00.161459    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-938af8-29748390-nrbg4"
Jul 24 14:30:00.161866 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:00.161839    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-938af8-29748390-nrbg4"]
Jul 24 14:30:00.311506 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:00.311475    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748390-nps29"]
Jul 24 14:30:00.314537 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:30:00.314509    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf479de47_5864_426d_9f73_9b79e0346b93.slice/crio-604f0e47b93d9d274305017726dc4d0975a9522ec826a517072920b858a90f9b WatchSource:0}: Error finding container 604f0e47b93d9d274305017726dc4d0975a9522ec826a517072920b858a90f9b: Status 404 returned error can't find the container with id 604f0e47b93d9d274305017726dc4d0975a9522ec826a517072920b858a90f9b
Jul 24 14:30:00.337378 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:00.337346    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-938af8-29748390-nrbg4"]
Jul 24 14:30:00.340389 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:30:00.340351    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9265561_0bd3_4567_9bf7_55af5c0d5b3d.slice/crio-237b528d9e88b82d595e0ce6bd3246f87c3ba70ec999ba732909172341b4d469 WatchSource:0}: Error finding container 237b528d9e88b82d595e0ce6bd3246f87c3ba70ec999ba732909172341b4d469: Status 404 returned error can't find the container with id 237b528d9e88b82d595e0ce6bd3246f87c3ba70ec999ba732909172341b4d469
Jul 24 14:30:00.404290 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:00.404201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748390-nps29" event={"ID":"f479de47-5864-426d-9f73-9b79e0346b93","Type":"ContainerStarted","Data":"604f0e47b93d9d274305017726dc4d0975a9522ec826a517072920b858a90f9b"}
Jul 24 14:30:00.405545 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:00.405519    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-938af8-29748390-nrbg4" event={"ID":"f9265561-0bd3-4567-9bf7-55af5c0d5b3d","Type":"ContainerStarted","Data":"237b528d9e88b82d595e0ce6bd3246f87c3ba70ec999ba732909172341b4d469"}
Jul 24 14:30:01.411579 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:01.411548    2565 generic.go:356] "Generic (PLEG): container finished" podID="f479de47-5864-426d-9f73-9b79e0346b93" containerID="6084bb8b7947313c0433dccd1d017b86659c381b4e96ddf246372c63321e05fb" exitCode=0
Jul 24 14:30:01.412000 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:01.411642    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748390-nps29" event={"ID":"f479de47-5864-426d-9f73-9b79e0346b93","Type":"ContainerDied","Data":"6084bb8b7947313c0433dccd1d017b86659c381b4e96ddf246372c63321e05fb"}
Jul 24 14:30:01.413212 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:01.413167    2565 generic.go:356] "Generic (PLEG): container finished" podID="f9265561-0bd3-4567-9bf7-55af5c0d5b3d" containerID="1cbeaf468265995f9e175001f06200f728cff1c3b0ab63633da275f254e233d0" exitCode=0
Jul 24 14:30:01.413288 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:01.413256    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-938af8-29748390-nrbg4" event={"ID":"f9265561-0bd3-4567-9bf7-55af5c0d5b3d","Type":"ContainerDied","Data":"1cbeaf468265995f9e175001f06200f728cff1c3b0ab63633da275f254e233d0"}
Jul 24 14:30:02.551392 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:02.551361    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-938af8-29748390-nrbg4"
Jul 24 14:30:02.582630 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:02.582595    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748390-nps29"
Jul 24 14:30:03.173117 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:03.173081    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:30:03.173364 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:03.173138    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:30:03.185724 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:03.185693    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:30:03.424018 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:03.423932    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748390-nps29"
Jul 24 14:30:03.424018 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:03.423930    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748390-nps29" event={"ID":"f479de47-5864-426d-9f73-9b79e0346b93","Type":"ContainerDied","Data":"604f0e47b93d9d274305017726dc4d0975a9522ec826a517072920b858a90f9b"}
Jul 24 14:30:03.424242 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:03.424063    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="604f0e47b93d9d274305017726dc4d0975a9522ec826a517072920b858a90f9b"
Jul 24 14:30:03.425341 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:03.425310    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-938af8-29748390-nrbg4"
Jul 24 14:30:03.425456 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:03.425354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-938af8-29748390-nrbg4" event={"ID":"f9265561-0bd3-4567-9bf7-55af5c0d5b3d","Type":"ContainerDied","Data":"237b528d9e88b82d595e0ce6bd3246f87c3ba70ec999ba732909172341b4d469"}
Jul 24 14:30:03.425456 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:03.425408    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="237b528d9e88b82d595e0ce6bd3246f87c3ba70ec999ba732909172341b4d469"
Jul 24 14:30:03.437681 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:03.437659    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:30:11.156605 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:11.156567    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:30:30.349789 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:30.349753    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:30:41.748982 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:30:41.748938    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:31:01.250472 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:31:01.250433    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:31:16.554121 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:31:16.554026    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:31:32.344292 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:31:32.344247    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:31:50.551923 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:31:50.551884    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:32:06.874417 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:06.874384    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"]
Jul 24 14:32:08.137249 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:08.137213    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"]
Jul 24 14:32:09.650403 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:09.650354    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:32:19.747484 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.747445    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"]
Jul 24 14:32:19.747968 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.747816    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f479de47-5864-426d-9f73-9b79e0346b93" containerName="cleanup"
Jul 24 14:32:19.747968 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.747827    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f479de47-5864-426d-9f73-9b79e0346b93" containerName="cleanup"
Jul 24 14:32:19.747968 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.747839    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9265561-0bd3-4567-9bf7-55af5c0d5b3d" containerName="cleanup"
Jul 24 14:32:19.747968 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.747845    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9265561-0bd3-4567-9bf7-55af5c0d5b3d" containerName="cleanup"
Jul 24 14:32:19.747968 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.747909    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9265561-0bd3-4567-9bf7-55af5c0d5b3d" containerName="cleanup"
Jul 24 14:32:19.747968 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.747916    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f479de47-5864-426d-9f73-9b79e0346b93" containerName="cleanup"
Jul 24 14:32:19.751255 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.751230    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.754016 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.753980    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-94af13\"/\"sub-test-model-94af13-kserve-self-signed-certs\""
Jul 24 14:32:19.761222 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.761196    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"]
Jul 24 14:32:19.773143 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.773114    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-dshm\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.773143 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.773145    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-model-cache\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.773394 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.773166    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad8f61a-32e9-4cf2-aaec-4008e8238060-tls-certs\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.773394 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.773284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58llr\" (UniqueName: \"kubernetes.io/projected/aad8f61a-32e9-4cf2-aaec-4008e8238060-kube-api-access-58llr\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.773394 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.773322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-home\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.773394 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.773341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-tmp-dir\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.873982 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.873942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-home\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.873982 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.873983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-tmp-dir\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.874279 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.874093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-dshm\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.874279 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.874119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-model-cache\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.874279 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.874141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad8f61a-32e9-4cf2-aaec-4008e8238060-tls-certs\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.874279 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.874236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58llr\" (UniqueName: \"kubernetes.io/projected/aad8f61a-32e9-4cf2-aaec-4008e8238060-kube-api-access-58llr\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.874489 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.874468    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-tmp-dir\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.874547 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.874497    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-home\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.874625 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.874599    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-model-cache\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.876640 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.876607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-dshm\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.876868 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.876849    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad8f61a-32e9-4cf2-aaec-4008e8238060-tls-certs\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:19.882918 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:19.882899    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58llr\" (UniqueName: \"kubernetes.io/projected/aad8f61a-32e9-4cf2-aaec-4008e8238060-kube-api-access-58llr\") pod \"sub-test-model-94af13-kserve-df8dc7dcf-jw6vv\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") " pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:20.062900 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:20.062864    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:20.204164 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:20.204138    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"]
Jul 24 14:32:20.206415 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:32:20.206388    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaad8f61a_32e9_4cf2_aaec_4008e8238060.slice/crio-4cd0718697892f68c37015b3bec3614f285aff618cb86fd527873dedad88fec1 WatchSource:0}: Error finding container 4cd0718697892f68c37015b3bec3614f285aff618cb86fd527873dedad88fec1: Status 404 returned error can't find the container with id 4cd0718697892f68c37015b3bec3614f285aff618cb86fd527873dedad88fec1
Jul 24 14:32:21.122759 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:21.122721    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv" event={"ID":"aad8f61a-32e9-4cf2-aaec-4008e8238060","Type":"ContainerStarted","Data":"b5f567497d63ef4408b798e03480ea9ebdee72520e8354c62a20a94f02e5e570"}
Jul 24 14:32:21.122759 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:21.122764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv" event={"ID":"aad8f61a-32e9-4cf2-aaec-4008e8238060","Type":"ContainerStarted","Data":"4cd0718697892f68c37015b3bec3614f285aff618cb86fd527873dedad88fec1"}
Jul 24 14:32:21.140389 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:21.140334    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv" podStartSLOduration=2.140316616 podStartE2EDuration="2.140316616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:21.138491399 +0000 UTC m=+2849.373842761" watchObservedRunningTime="2026-07-24 14:32:21.140316616 +0000 UTC m=+2849.375667978"
Jul 24 14:32:21.894507 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:21.894460    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9" podUID="256dab97-d6e4-432e-a054-a380d1c35de0" containerName="main" containerID="cri-o://239ab7765d0f24a133844227cae41a579d3f7d1cf760524c4995381c9bcdfd27" gracePeriod=45
Jul 24 14:32:22.129624 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.129593    2565 generic.go:356] "Generic (PLEG): container finished" podID="256dab97-d6e4-432e-a054-a380d1c35de0" containerID="239ab7765d0f24a133844227cae41a579d3f7d1cf760524c4995381c9bcdfd27" exitCode=0
Jul 24 14:32:22.130075 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.129659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9" event={"ID":"256dab97-d6e4-432e-a054-a380d1c35de0","Type":"ContainerDied","Data":"239ab7765d0f24a133844227cae41a579d3f7d1cf760524c4995381c9bcdfd27"}
Jul 24 14:32:22.147646 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.147573    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:32:22.197269 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.197240    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-home\") pod \"256dab97-d6e4-432e-a054-a380d1c35de0\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") "
Jul 24 14:32:22.197453 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.197301    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-tmp-dir\") pod \"256dab97-d6e4-432e-a054-a380d1c35de0\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") "
Jul 24 14:32:22.197453 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.197341    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-model-cache\") pod \"256dab97-d6e4-432e-a054-a380d1c35de0\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") "
Jul 24 14:32:22.197453 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.197404    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/256dab97-d6e4-432e-a054-a380d1c35de0-tls-certs\") pod \"256dab97-d6e4-432e-a054-a380d1c35de0\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") "
Jul 24 14:32:22.197622 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.197466    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88jkp\" (UniqueName: \"kubernetes.io/projected/256dab97-d6e4-432e-a054-a380d1c35de0-kube-api-access-88jkp\") pod \"256dab97-d6e4-432e-a054-a380d1c35de0\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") "
Jul 24 14:32:22.197622 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.197518    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-home" (OuterVolumeSpecName: "home") pod "256dab97-d6e4-432e-a054-a380d1c35de0" (UID: "256dab97-d6e4-432e-a054-a380d1c35de0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:22.197622 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.197542    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-dshm\") pod \"256dab97-d6e4-432e-a054-a380d1c35de0\" (UID: \"256dab97-d6e4-432e-a054-a380d1c35de0\") "
Jul 24 14:32:22.197622 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.197557    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "256dab97-d6e4-432e-a054-a380d1c35de0" (UID: "256dab97-d6e4-432e-a054-a380d1c35de0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:22.197622 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.197572    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-model-cache" (OuterVolumeSpecName: "model-cache") pod "256dab97-d6e4-432e-a054-a380d1c35de0" (UID: "256dab97-d6e4-432e-a054-a380d1c35de0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:22.197892 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.197871    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-tmp-dir\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:32:22.197933 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.197895    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-model-cache\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:32:22.197933 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.197908    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-home\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:32:22.199991 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.199960    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/256dab97-d6e4-432e-a054-a380d1c35de0-kube-api-access-88jkp" (OuterVolumeSpecName: "kube-api-access-88jkp") pod "256dab97-d6e4-432e-a054-a380d1c35de0" (UID: "256dab97-d6e4-432e-a054-a380d1c35de0"). InnerVolumeSpecName "kube-api-access-88jkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:32:22.199991 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.199975    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/256dab97-d6e4-432e-a054-a380d1c35de0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "256dab97-d6e4-432e-a054-a380d1c35de0" (UID: "256dab97-d6e4-432e-a054-a380d1c35de0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:32:22.200149 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.200035    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-dshm" (OuterVolumeSpecName: "dshm") pod "256dab97-d6e4-432e-a054-a380d1c35de0" (UID: "256dab97-d6e4-432e-a054-a380d1c35de0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:22.298442 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.298403    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/256dab97-d6e4-432e-a054-a380d1c35de0-dshm\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:32:22.298442 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.298434    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/256dab97-d6e4-432e-a054-a380d1c35de0-tls-certs\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:32:22.298442 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:22.298444    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88jkp\" (UniqueName: \"kubernetes.io/projected/256dab97-d6e4-432e-a054-a380d1c35de0-kube-api-access-88jkp\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:32:23.135925 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.135889    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"
Jul 24 14:32:23.135925 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.135918    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9" event={"ID":"256dab97-d6e4-432e-a054-a380d1c35de0","Type":"ContainerDied","Data":"729b86c8f0d4c3eeccc652c989ea242edc649dacc0ace443d9fd69b3a4b9b5e0"}
Jul 24 14:32:23.136433 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.135963    2565 scope.go:117] "RemoveContainer" containerID="239ab7765d0f24a133844227cae41a579d3f7d1cf760524c4995381c9bcdfd27"
Jul 24 14:32:23.157159 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.157124    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg" podUID="e9da24af-d4a7-44d0-a95b-5d2ff8512a10" containerName="main" containerID="cri-o://c7b304aae0340f2e4da48c460902466895327c8617ab9619146b4a10a0d39387" gracePeriod=45
Jul 24 14:32:23.157696 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.157670    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"]
Jul 24 14:32:23.161427 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.161402    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/auth-test-model-94af13-kserve-cc6bbc9bc-r2vv9"]
Jul 24 14:32:23.417906 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.417881    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:32:23.510196 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.510131    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fqwp\" (UniqueName: \"kubernetes.io/projected/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-kube-api-access-8fqwp\") pod \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") "
Jul 24 14:32:23.510196 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.510186    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-tls-certs\") pod \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") "
Jul 24 14:32:23.510446 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.510244    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-model-cache\") pod \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") "
Jul 24 14:32:23.510446 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.510269    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-home\") pod \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") "
Jul 24 14:32:23.510446 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.510328    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-tmp-dir\") pod \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") "
Jul 24 14:32:23.510446 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.510345    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-dshm\") pod \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\" (UID: \"e9da24af-d4a7-44d0-a95b-5d2ff8512a10\") "
Jul 24 14:32:23.510651 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.510539    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-model-cache" (OuterVolumeSpecName: "model-cache") pod "e9da24af-d4a7-44d0-a95b-5d2ff8512a10" (UID: "e9da24af-d4a7-44d0-a95b-5d2ff8512a10"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:23.510651 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.510548    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-home" (OuterVolumeSpecName: "home") pod "e9da24af-d4a7-44d0-a95b-5d2ff8512a10" (UID: "e9da24af-d4a7-44d0-a95b-5d2ff8512a10"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:23.510651 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.510603    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e9da24af-d4a7-44d0-a95b-5d2ff8512a10" (UID: "e9da24af-d4a7-44d0-a95b-5d2ff8512a10"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:23.512788 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.512761    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e9da24af-d4a7-44d0-a95b-5d2ff8512a10" (UID: "e9da24af-d4a7-44d0-a95b-5d2ff8512a10"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:32:23.512788 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.512780    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-dshm" (OuterVolumeSpecName: "dshm") pod "e9da24af-d4a7-44d0-a95b-5d2ff8512a10" (UID: "e9da24af-d4a7-44d0-a95b-5d2ff8512a10"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:32:23.512916 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.512805    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-kube-api-access-8fqwp" (OuterVolumeSpecName: "kube-api-access-8fqwp") pod "e9da24af-d4a7-44d0-a95b-5d2ff8512a10" (UID: "e9da24af-d4a7-44d0-a95b-5d2ff8512a10"). InnerVolumeSpecName "kube-api-access-8fqwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:32:23.611662 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.611620    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-home\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:32:23.611662 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.611654    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-tmp-dir\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:32:23.611662 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.611668    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-dshm\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:32:23.611911 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.611679    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fqwp\" (UniqueName: \"kubernetes.io/projected/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-kube-api-access-8fqwp\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:32:23.611911 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.611690    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-tls-certs\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:32:23.611911 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.611701    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9da24af-d4a7-44d0-a95b-5d2ff8512a10-model-cache\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:32:23.651483 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:23.651390    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:32:24.143376 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:24.143336    2565 generic.go:356] "Generic (PLEG): container finished" podID="e9da24af-d4a7-44d0-a95b-5d2ff8512a10" containerID="c7b304aae0340f2e4da48c460902466895327c8617ab9619146b4a10a0d39387" exitCode=0
Jul 24 14:32:24.143376 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:24.143381    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"
Jul 24 14:32:24.143919 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:24.143423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg" event={"ID":"e9da24af-d4a7-44d0-a95b-5d2ff8512a10","Type":"ContainerDied","Data":"c7b304aae0340f2e4da48c460902466895327c8617ab9619146b4a10a0d39387"}
Jul 24 14:32:24.143919 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:24.143465    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg" event={"ID":"e9da24af-d4a7-44d0-a95b-5d2ff8512a10","Type":"ContainerDied","Data":"d6fbf288467fc093b00776613b6bd0f22337bd85b56a1c52b31b21e0d38adf84"}
Jul 24 14:32:24.143919 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:24.143484    2565 scope.go:117] "RemoveContainer" containerID="c7b304aae0340f2e4da48c460902466895327c8617ab9619146b4a10a0d39387"
Jul 24 14:32:24.153107 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:24.153087    2565 scope.go:117] "RemoveContainer" containerID="c7b304aae0340f2e4da48c460902466895327c8617ab9619146b4a10a0d39387"
Jul 24 14:32:24.153421 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:32:24.153400    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7b304aae0340f2e4da48c460902466895327c8617ab9619146b4a10a0d39387\": container with ID starting with c7b304aae0340f2e4da48c460902466895327c8617ab9619146b4a10a0d39387 not found: ID does not exist" containerID="c7b304aae0340f2e4da48c460902466895327c8617ab9619146b4a10a0d39387"
Jul 24 14:32:24.153524 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:24.153430    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b304aae0340f2e4da48c460902466895327c8617ab9619146b4a10a0d39387"} err="failed to get container status \"c7b304aae0340f2e4da48c460902466895327c8617ab9619146b4a10a0d39387\": rpc error: code = NotFound desc = could not find container \"c7b304aae0340f2e4da48c460902466895327c8617ab9619146b4a10a0d39387\": container with ID starting with c7b304aae0340f2e4da48c460902466895327c8617ab9619146b4a10a0d39387 not found: ID does not exist"
Jul 24 14:32:24.172353 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:24.167808    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"]
Jul 24 14:32:24.172353 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:24.171717    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/auth-test-model-938af8-kserve-67c6cbbc79-m6ktg"]
Jul 24 14:32:24.195435 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:24.195402    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="256dab97-d6e4-432e-a054-a380d1c35de0" path="/var/lib/kubelet/pods/256dab97-d6e4-432e-a054-a380d1c35de0/volumes"
Jul 24 14:32:24.195804 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:24.195792    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9da24af-d4a7-44d0-a95b-5d2ff8512a10" path="/var/lib/kubelet/pods/e9da24af-d4a7-44d0-a95b-5d2ff8512a10/volumes"
Jul 24 14:32:30.063805 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:30.063751    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:30.063805 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:30.063823    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:30.076738 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:30.076707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:30.186712 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:30.186680    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:32:44.849461 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:44.849385    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"]
Jul 24 14:32:44.849954 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:44.849767    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9da24af-d4a7-44d0-a95b-5d2ff8512a10" containerName="main"
Jul 24 14:32:44.849954 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:44.849782    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9da24af-d4a7-44d0-a95b-5d2ff8512a10" containerName="main"
Jul 24 14:32:44.849954 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:44.849793    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256dab97-d6e4-432e-a054-a380d1c35de0" containerName="main"
Jul 24 14:32:44.849954 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:44.849799    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="256dab97-d6e4-432e-a054-a380d1c35de0" containerName="main"
Jul 24 14:32:44.849954 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:44.849867    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="256dab97-d6e4-432e-a054-a380d1c35de0" containerName="main"
Jul 24 14:32:44.849954 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:44.849877    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9da24af-d4a7-44d0-a95b-5d2ff8512a10" containerName="main"
Jul 24 14:32:44.852596 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:44.852576    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:44.856440 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:44.856284    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-938af8\"/\"openshift-service-ca.crt\""
Jul 24 14:32:44.856440 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:44.856287    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-938af8\"/\"kube-root-ca.crt\""
Jul 24 14:32:44.856440 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:44.856289    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-938af8\"/\"sub-test-model-938af8-kserve-self-signed-certs\""
Jul 24 14:32:44.856440 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:44.856343    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-938af8\"/\"default-dockercfg-mwphr\""
Jul 24 14:32:44.863261 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:44.863232    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"]
Jul 24 14:32:45.004211 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.004159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2ql8\" (UniqueName: \"kubernetes.io/projected/121fd011-6a72-427b-acc1-2757f65a1bb2-kube-api-access-b2ql8\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.004392 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.004225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-home\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.004392 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.004307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/121fd011-6a72-427b-acc1-2757f65a1bb2-tls-certs\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.004392 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.004372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-dshm\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.004514 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.004397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-model-cache\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.004514 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.004413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-tmp-dir\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.105075 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.104981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-model-cache\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.105075 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.105022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-tmp-dir\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.105075 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.105071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2ql8\" (UniqueName: \"kubernetes.io/projected/121fd011-6a72-427b-acc1-2757f65a1bb2-kube-api-access-b2ql8\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.105390 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.105100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-home\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.105390 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.105142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/121fd011-6a72-427b-acc1-2757f65a1bb2-tls-certs\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.105390 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.105202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-dshm\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.105543 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.105495    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-model-cache\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.105543 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.105511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-tmp-dir\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.105654 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.105617    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-home\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.107621 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.107596    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-dshm\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.107991 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.107972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/121fd011-6a72-427b-acc1-2757f65a1bb2-tls-certs\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.114319 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.114301    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2ql8\" (UniqueName: \"kubernetes.io/projected/121fd011-6a72-427b-acc1-2757f65a1bb2-kube-api-access-b2ql8\") pod \"sub-test-model-938af8-kserve-c997b7cc7-642lb\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") " pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.163058 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.163013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:45.303037 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:45.303011    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"]
Jul 24 14:32:45.304798 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:32:45.304766    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod121fd011_6a72_427b_acc1_2757f65a1bb2.slice/crio-f87146f14b9dd1ba2d839ac2e296ec66db121f0a03921411d9ce814ac91da6c7 WatchSource:0}: Error finding container f87146f14b9dd1ba2d839ac2e296ec66db121f0a03921411d9ce814ac91da6c7: Status 404 returned error can't find the container with id f87146f14b9dd1ba2d839ac2e296ec66db121f0a03921411d9ce814ac91da6c7
Jul 24 14:32:46.269553 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:46.269499    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb" event={"ID":"121fd011-6a72-427b-acc1-2757f65a1bb2","Type":"ContainerStarted","Data":"c8f03b3e2d245920f859764a966a8096836142c73ce0810d3773ee41bf292ee7"}
Jul 24 14:32:46.269553 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:46.269555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb" event={"ID":"121fd011-6a72-427b-acc1-2757f65a1bb2","Type":"ContainerStarted","Data":"f87146f14b9dd1ba2d839ac2e296ec66db121f0a03921411d9ce814ac91da6c7"}
Jul 24 14:32:46.289887 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:46.289833    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb" podStartSLOduration=2.289816003 podStartE2EDuration="2.289816003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:46.289032347 +0000 UTC m=+2874.524383722" watchObservedRunningTime="2026-07-24 14:32:46.289816003 +0000 UTC m=+2874.525167361"
Jul 24 14:32:48.447027 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:48.446993    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:32:55.163611 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:55.163573    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:55.164090 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:55.163637    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:55.176436 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:55.176408    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:32:55.327458 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:32:55.327425    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:33:13.454765 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:13.454719    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:33:27.442758 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:27.442718    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:33:33.841623 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:33.841586    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"]
Jul 24 14:33:34.671307 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:34.671267    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"]
Jul 24 14:33:46.443388 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:46.443354    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:33:48.430319 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.430284    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"]
Jul 24 14:33:48.433894 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.433875    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.436359 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.436341    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-94af13\"/\"rate-test-model-94af13-kserve-self-signed-certs\""
Jul 24 14:33:48.443851 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.443823    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"]
Jul 24 14:33:48.503051 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.503019    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-tls-certs\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.503332 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.503093    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-tmp-dir\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.503332 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.503128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-dshm\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.503332 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.503149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fjkg\" (UniqueName: \"kubernetes.io/projected/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-kube-api-access-5fjkg\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.503332 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.503254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-model-cache\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.503332 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.503311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-home\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.604097 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.604052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-tls-certs\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.604317 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.604138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-tmp-dir\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.604317 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.604213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-dshm\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.604317 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.604246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fjkg\" (UniqueName: \"kubernetes.io/projected/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-kube-api-access-5fjkg\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.604317 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.604310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-model-cache\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.604496 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.604343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-home\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.604630 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.604601    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-tmp-dir\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.604728 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.604668    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-home\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.604799 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.604767    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-model-cache\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.606678 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.606658    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-dshm\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.607113 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.607092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-tls-certs\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.612780 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.612756    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fjkg\" (UniqueName: \"kubernetes.io/projected/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-kube-api-access-5fjkg\") pod \"rate-test-model-94af13-kserve-69d47f46cf-r4lvl\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") " pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.744800 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.744708    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:48.863419 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.863371    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv" podUID="aad8f61a-32e9-4cf2-aaec-4008e8238060" containerName="main" containerID="cri-o://b5f567497d63ef4408b798e03480ea9ebdee72520e8354c62a20a94f02e5e570" gracePeriod=45
Jul 24 14:33:48.888887 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:48.888863    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"]
Jul 24 14:33:48.918269 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:33:48.918220    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67bb4abc_2db1_48fe_8d5e_e5f9f0267fff.slice/crio-0eb45bcdee62ae6cdaf2ecb68c790755871345fb75b8e4fae595a7ea72f26f06 WatchSource:0}: Error finding container 0eb45bcdee62ae6cdaf2ecb68c790755871345fb75b8e4fae595a7ea72f26f06: Status 404 returned error can't find the container with id 0eb45bcdee62ae6cdaf2ecb68c790755871345fb75b8e4fae595a7ea72f26f06
Jul 24 14:33:49.127719 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.127693    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:33:49.209785 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.209751    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58llr\" (UniqueName: \"kubernetes.io/projected/aad8f61a-32e9-4cf2-aaec-4008e8238060-kube-api-access-58llr\") pod \"aad8f61a-32e9-4cf2-aaec-4008e8238060\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") "
Jul 24 14:33:49.209785 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.209795    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-model-cache\") pod \"aad8f61a-32e9-4cf2-aaec-4008e8238060\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") "
Jul 24 14:33:49.210040 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.209824    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-dshm\") pod \"aad8f61a-32e9-4cf2-aaec-4008e8238060\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") "
Jul 24 14:33:49.210040 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.210014    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-home\") pod \"aad8f61a-32e9-4cf2-aaec-4008e8238060\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") "
Jul 24 14:33:49.210144 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.210084    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-model-cache" (OuterVolumeSpecName: "model-cache") pod "aad8f61a-32e9-4cf2-aaec-4008e8238060" (UID: "aad8f61a-32e9-4cf2-aaec-4008e8238060"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:33:49.210144 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.210093    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-tmp-dir\") pod \"aad8f61a-32e9-4cf2-aaec-4008e8238060\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") "
Jul 24 14:33:49.210284 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.210228    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad8f61a-32e9-4cf2-aaec-4008e8238060-tls-certs\") pod \"aad8f61a-32e9-4cf2-aaec-4008e8238060\" (UID: \"aad8f61a-32e9-4cf2-aaec-4008e8238060\") "
Jul 24 14:33:49.210284 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.210265    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-home" (OuterVolumeSpecName: "home") pod "aad8f61a-32e9-4cf2-aaec-4008e8238060" (UID: "aad8f61a-32e9-4cf2-aaec-4008e8238060"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:33:49.210395 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.210315    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aad8f61a-32e9-4cf2-aaec-4008e8238060" (UID: "aad8f61a-32e9-4cf2-aaec-4008e8238060"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:33:49.210627 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.210604    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-model-cache\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:33:49.210627 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.210630    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-home\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:33:49.210813 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.210642    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-tmp-dir\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:33:49.212145 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.212126    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-dshm" (OuterVolumeSpecName: "dshm") pod "aad8f61a-32e9-4cf2-aaec-4008e8238060" (UID: "aad8f61a-32e9-4cf2-aaec-4008e8238060"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:33:49.212250 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.212141    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad8f61a-32e9-4cf2-aaec-4008e8238060-kube-api-access-58llr" (OuterVolumeSpecName: "kube-api-access-58llr") pod "aad8f61a-32e9-4cf2-aaec-4008e8238060" (UID: "aad8f61a-32e9-4cf2-aaec-4008e8238060"). InnerVolumeSpecName "kube-api-access-58llr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:33:49.212250 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.212224    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad8f61a-32e9-4cf2-aaec-4008e8238060-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aad8f61a-32e9-4cf2-aaec-4008e8238060" (UID: "aad8f61a-32e9-4cf2-aaec-4008e8238060"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:33:49.311873 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.311832    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad8f61a-32e9-4cf2-aaec-4008e8238060-tls-certs\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:33:49.311873 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.311874    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58llr\" (UniqueName: \"kubernetes.io/projected/aad8f61a-32e9-4cf2-aaec-4008e8238060-kube-api-access-58llr\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:33:49.311873 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.311886    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad8f61a-32e9-4cf2-aaec-4008e8238060-dshm\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:33:49.582397 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.582310    2565 generic.go:356] "Generic (PLEG): container finished" podID="aad8f61a-32e9-4cf2-aaec-4008e8238060" containerID="b5f567497d63ef4408b798e03480ea9ebdee72520e8354c62a20a94f02e5e570" exitCode=0
Jul 24 14:33:49.582397 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.582360    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"
Jul 24 14:33:49.582892 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.582403    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv" event={"ID":"aad8f61a-32e9-4cf2-aaec-4008e8238060","Type":"ContainerDied","Data":"b5f567497d63ef4408b798e03480ea9ebdee72520e8354c62a20a94f02e5e570"}
Jul 24 14:33:49.582892 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.582444    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv" event={"ID":"aad8f61a-32e9-4cf2-aaec-4008e8238060","Type":"ContainerDied","Data":"4cd0718697892f68c37015b3bec3614f285aff618cb86fd527873dedad88fec1"}
Jul 24 14:33:49.582892 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.582467    2565 scope.go:117] "RemoveContainer" containerID="b5f567497d63ef4408b798e03480ea9ebdee72520e8354c62a20a94f02e5e570"
Jul 24 14:33:49.584167 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.584032    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl" event={"ID":"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff","Type":"ContainerStarted","Data":"c3f7884e36efca62733a107fbebbc21f58c939e321e91f5f293ecf10e614357b"}
Jul 24 14:33:49.584167 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.584078    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl" event={"ID":"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff","Type":"ContainerStarted","Data":"0eb45bcdee62ae6cdaf2ecb68c790755871345fb75b8e4fae595a7ea72f26f06"}
Jul 24 14:33:49.591711 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.591697    2565 scope.go:117] "RemoveContainer" containerID="b5f567497d63ef4408b798e03480ea9ebdee72520e8354c62a20a94f02e5e570"
Jul 24 14:33:49.591927 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:33:49.591910    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5f567497d63ef4408b798e03480ea9ebdee72520e8354c62a20a94f02e5e570\": container with ID starting with b5f567497d63ef4408b798e03480ea9ebdee72520e8354c62a20a94f02e5e570 not found: ID does not exist" containerID="b5f567497d63ef4408b798e03480ea9ebdee72520e8354c62a20a94f02e5e570"
Jul 24 14:33:49.591975 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.591935    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5f567497d63ef4408b798e03480ea9ebdee72520e8354c62a20a94f02e5e570"} err="failed to get container status \"b5f567497d63ef4408b798e03480ea9ebdee72520e8354c62a20a94f02e5e570\": rpc error: code = NotFound desc = could not find container \"b5f567497d63ef4408b798e03480ea9ebdee72520e8354c62a20a94f02e5e570\": container with ID starting with b5f567497d63ef4408b798e03480ea9ebdee72520e8354c62a20a94f02e5e570 not found: ID does not exist"
Jul 24 14:33:49.606569 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.606515    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl" podStartSLOduration=1.606498329 podStartE2EDuration="1.606498329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:49.605466625 +0000 UTC m=+2937.840817988" watchObservedRunningTime="2026-07-24 14:33:49.606498329 +0000 UTC m=+2937.841849690"
Jul 24 14:33:49.624081 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.624055    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"]
Jul 24 14:33:49.628137 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.628115    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/sub-test-model-94af13-kserve-df8dc7dcf-jw6vv"]
Jul 24 14:33:49.690945 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.690901    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb" podUID="121fd011-6a72-427b-acc1-2757f65a1bb2" containerName="main" containerID="cri-o://c8f03b3e2d245920f859764a966a8096836142c73ce0810d3773ee41bf292ee7" gracePeriod=45
Jul 24 14:33:49.956260 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:49.956234    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:33:50.018403 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.018369    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/121fd011-6a72-427b-acc1-2757f65a1bb2-tls-certs\") pod \"121fd011-6a72-427b-acc1-2757f65a1bb2\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") "
Jul 24 14:33:50.018588 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.018425    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-model-cache\") pod \"121fd011-6a72-427b-acc1-2757f65a1bb2\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") "
Jul 24 14:33:50.018588 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.018471    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-dshm\") pod \"121fd011-6a72-427b-acc1-2757f65a1bb2\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") "
Jul 24 14:33:50.018588 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.018501    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-home\") pod \"121fd011-6a72-427b-acc1-2757f65a1bb2\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") "
Jul 24 14:33:50.018588 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.018522    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-tmp-dir\") pod \"121fd011-6a72-427b-acc1-2757f65a1bb2\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") "
Jul 24 14:33:50.018802 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.018608    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2ql8\" (UniqueName: \"kubernetes.io/projected/121fd011-6a72-427b-acc1-2757f65a1bb2-kube-api-access-b2ql8\") pod \"121fd011-6a72-427b-acc1-2757f65a1bb2\" (UID: \"121fd011-6a72-427b-acc1-2757f65a1bb2\") "
Jul 24 14:33:50.018802 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.018770    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-model-cache" (OuterVolumeSpecName: "model-cache") pod "121fd011-6a72-427b-acc1-2757f65a1bb2" (UID: "121fd011-6a72-427b-acc1-2757f65a1bb2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:33:50.018802 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.018788    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-home" (OuterVolumeSpecName: "home") pod "121fd011-6a72-427b-acc1-2757f65a1bb2" (UID: "121fd011-6a72-427b-acc1-2757f65a1bb2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:33:50.018948 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.018799    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "121fd011-6a72-427b-acc1-2757f65a1bb2" (UID: "121fd011-6a72-427b-acc1-2757f65a1bb2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:33:50.019004 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.018953    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-model-cache\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:33:50.019004 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.018972    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-home\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:33:50.019004 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.018987    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-tmp-dir\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:33:50.020837 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.020812    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/121fd011-6a72-427b-acc1-2757f65a1bb2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "121fd011-6a72-427b-acc1-2757f65a1bb2" (UID: "121fd011-6a72-427b-acc1-2757f65a1bb2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:33:50.020837 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.020821    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/121fd011-6a72-427b-acc1-2757f65a1bb2-kube-api-access-b2ql8" (OuterVolumeSpecName: "kube-api-access-b2ql8") pod "121fd011-6a72-427b-acc1-2757f65a1bb2" (UID: "121fd011-6a72-427b-acc1-2757f65a1bb2"). InnerVolumeSpecName "kube-api-access-b2ql8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:33:50.020967 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.020867    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-dshm" (OuterVolumeSpecName: "dshm") pod "121fd011-6a72-427b-acc1-2757f65a1bb2" (UID: "121fd011-6a72-427b-acc1-2757f65a1bb2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:33:50.119524 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.119426    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2ql8\" (UniqueName: \"kubernetes.io/projected/121fd011-6a72-427b-acc1-2757f65a1bb2-kube-api-access-b2ql8\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:33:50.119524 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.119459    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/121fd011-6a72-427b-acc1-2757f65a1bb2-tls-certs\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:33:50.119524 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.119469    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/121fd011-6a72-427b-acc1-2757f65a1bb2-dshm\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:33:50.194723 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.194691    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aad8f61a-32e9-4cf2-aaec-4008e8238060" path="/var/lib/kubelet/pods/aad8f61a-32e9-4cf2-aaec-4008e8238060/volumes"
Jul 24 14:33:50.590094 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.590064    2565 generic.go:356] "Generic (PLEG): container finished" podID="121fd011-6a72-427b-acc1-2757f65a1bb2" containerID="c8f03b3e2d245920f859764a966a8096836142c73ce0810d3773ee41bf292ee7" exitCode=0
Jul 24 14:33:50.590584 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.590107    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"
Jul 24 14:33:50.590584 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.590152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb" event={"ID":"121fd011-6a72-427b-acc1-2757f65a1bb2","Type":"ContainerDied","Data":"c8f03b3e2d245920f859764a966a8096836142c73ce0810d3773ee41bf292ee7"}
Jul 24 14:33:50.590584 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.590211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb" event={"ID":"121fd011-6a72-427b-acc1-2757f65a1bb2","Type":"ContainerDied","Data":"f87146f14b9dd1ba2d839ac2e296ec66db121f0a03921411d9ce814ac91da6c7"}
Jul 24 14:33:50.590584 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.590230    2565 scope.go:117] "RemoveContainer" containerID="c8f03b3e2d245920f859764a966a8096836142c73ce0810d3773ee41bf292ee7"
Jul 24 14:33:50.599213 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.599195    2565 scope.go:117] "RemoveContainer" containerID="c8f03b3e2d245920f859764a966a8096836142c73ce0810d3773ee41bf292ee7"
Jul 24 14:33:50.599529 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:33:50.599508    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8f03b3e2d245920f859764a966a8096836142c73ce0810d3773ee41bf292ee7\": container with ID starting with c8f03b3e2d245920f859764a966a8096836142c73ce0810d3773ee41bf292ee7 not found: ID does not exist" containerID="c8f03b3e2d245920f859764a966a8096836142c73ce0810d3773ee41bf292ee7"
Jul 24 14:33:50.599608 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.599540    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f03b3e2d245920f859764a966a8096836142c73ce0810d3773ee41bf292ee7"} err="failed to get container status \"c8f03b3e2d245920f859764a966a8096836142c73ce0810d3773ee41bf292ee7\": rpc error: code = NotFound desc = could not find container \"c8f03b3e2d245920f859764a966a8096836142c73ce0810d3773ee41bf292ee7\": container with ID starting with c8f03b3e2d245920f859764a966a8096836142c73ce0810d3773ee41bf292ee7 not found: ID does not exist"
Jul 24 14:33:50.607598 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.607566    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"]
Jul 24 14:33:50.617377 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:50.617348    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/sub-test-model-938af8-kserve-c997b7cc7-642lb"]
Jul 24 14:33:52.196873 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:52.196839    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="121fd011-6a72-427b-acc1-2757f65a1bb2" path="/var/lib/kubelet/pods/121fd011-6a72-427b-acc1-2757f65a1bb2/volumes"
Jul 24 14:33:52.517138 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:52.517058    2565 scope.go:117] "RemoveContainer" containerID="53e0bf6ec67616f9fd80d31dc561427a764307f2561ebafa556b6da0f39ff7c4"
Jul 24 14:33:52.527582 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:52.527554    2565 scope.go:117] "RemoveContainer" containerID="e740a1d24d98d605a28be4175e9534c0509575f6998a0cf2b7fb8c1eb300d784"
Jul 24 14:33:58.350220 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:58.350154    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:33:58.745296 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:58.745206    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:58.745296 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:58.745258    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:58.757730 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:58.757707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:33:59.647746 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:33:59.647711    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:34:25.151292 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.151257    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"]
Jul 24 14:34:25.151694 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.151619    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="121fd011-6a72-427b-acc1-2757f65a1bb2" containerName="main"
Jul 24 14:34:25.151694 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.151629    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="121fd011-6a72-427b-acc1-2757f65a1bb2" containerName="main"
Jul 24 14:34:25.151694 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.151639    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad8f61a-32e9-4cf2-aaec-4008e8238060" containerName="main"
Jul 24 14:34:25.151694 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.151646    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad8f61a-32e9-4cf2-aaec-4008e8238060" containerName="main"
Jul 24 14:34:25.151694 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.151693    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad8f61a-32e9-4cf2-aaec-4008e8238060" containerName="main"
Jul 24 14:34:25.151860 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.151701    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="121fd011-6a72-427b-acc1-2757f65a1bb2" containerName="main"
Jul 24 14:34:25.154592 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.154575    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.158197 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.158135    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-938af8\"/\"kube-root-ca.crt\""
Jul 24 14:34:25.158365 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.158335    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-938af8\"/\"openshift-service-ca.crt\""
Jul 24 14:34:25.158365 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.158341    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-938af8\"/\"default-dockercfg-mwphr\""
Jul 24 14:34:25.158655 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.158638    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-938af8\"/\"rate-test-model-938af8-kserve-self-signed-certs\""
Jul 24 14:34:25.165955 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.165930    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"]
Jul 24 14:34:25.247142 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.247093    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-model-cache\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.247367 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.247156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-tmp-dir\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.247367 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.247263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-home\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.247367 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.247304    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94jxc\" (UniqueName: \"kubernetes.io/projected/28e8949b-d17e-40cc-8f1d-4b7757527a94-kube-api-access-94jxc\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.247490 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.247411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-dshm\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.247490 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.247432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28e8949b-d17e-40cc-8f1d-4b7757527a94-tls-certs\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.348822 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.348777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-dshm\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.348822 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.348820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28e8949b-d17e-40cc-8f1d-4b7757527a94-tls-certs\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.349089 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.348861    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-model-cache\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.349089 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.348897    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-tmp-dir\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.349089 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.348941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-home\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.349307 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.349079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94jxc\" (UniqueName: \"kubernetes.io/projected/28e8949b-d17e-40cc-8f1d-4b7757527a94-kube-api-access-94jxc\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.349381 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.349358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-model-cache\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.349443 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.349402    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-home\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.349443 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.349429    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-tmp-dir\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.351379 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.351357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-dshm\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.351544 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.351527    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28e8949b-d17e-40cc-8f1d-4b7757527a94-tls-certs\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.358308 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.358282    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94jxc\" (UniqueName: \"kubernetes.io/projected/28e8949b-d17e-40cc-8f1d-4b7757527a94-kube-api-access-94jxc\") pod \"rate-test-model-938af8-kserve-5496cc9f9f-nm8qp\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") " pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.464710 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.464620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:25.607237 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.607204    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"]
Jul 24 14:34:25.609676 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:34:25.609649    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28e8949b_d17e_40cc_8f1d_4b7757527a94.slice/crio-324b0aa6fd6b45e287682c1ce47a516f46f37c5f5c5ec7ee2f59cba014dc0cd0 WatchSource:0}: Error finding container 324b0aa6fd6b45e287682c1ce47a516f46f37c5f5c5ec7ee2f59cba014dc0cd0: Status 404 returned error can't find the container with id 324b0aa6fd6b45e287682c1ce47a516f46f37c5f5c5ec7ee2f59cba014dc0cd0
Jul 24 14:34:25.775230 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.775107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp" event={"ID":"28e8949b-d17e-40cc-8f1d-4b7757527a94","Type":"ContainerStarted","Data":"43ba50af01083c221e65b04271ab359dc2c0e5543e5acdb9476f0c18b9c93060"}
Jul 24 14:34:25.775230 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.775162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp" event={"ID":"28e8949b-d17e-40cc-8f1d-4b7757527a94","Type":"ContainerStarted","Data":"324b0aa6fd6b45e287682c1ce47a516f46f37c5f5c5ec7ee2f59cba014dc0cd0"}
Jul 24 14:34:25.791834 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:25.791777    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp" podStartSLOduration=0.791758871 podStartE2EDuration="791.758871ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:25.790537352 +0000 UTC m=+2974.025888727" watchObservedRunningTime="2026-07-24 14:34:25.791758871 +0000 UTC m=+2974.027110233"
Jul 24 14:34:29.046020 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:29.045978    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:34:35.465235 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:35.465165    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:35.465235 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:35.465243    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:35.478284 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:35.478251    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:35.838924 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:35.838888    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:34:42.756538 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:42.756500    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:34:52.395761 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:52.395733    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:34:52.403865 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:52.403837    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:34:52.558995 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:52.558957    2565 scope.go:117] "RemoveContainer" containerID="45ece113e22f55cb21df53630fecc520e210c3500e836d1871e38d1b772af30e"
Jul 24 14:34:52.568687 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:52.568663    2565 scope.go:117] "RemoveContainer" containerID="72399070cc60fdc1eeedfc480fe7b3c299c5a08df57f11c5fbd1309dffa0c8e9"
Jul 24 14:34:58.259740 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:34:58.259700    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:35:06.292435 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:06.292397    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"]
Jul 24 14:35:07.177599 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:07.177562    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"]
Jul 24 14:35:08.207540 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:08.207499    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7387-139878398036784"]
Jul 24 14:35:08.211031 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:08.211011    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878398036784"
Jul 24 14:35:08.213627 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:08.213606    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hs75p\""
Jul 24 14:35:08.217808 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:08.217781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7387-139878398036784"]
Jul 24 14:35:08.342846 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:08.342803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr8zv\" (UniqueName: \"kubernetes.io/projected/2d89ef50-dc10-42c5-9fce-e543b55a1df4-kube-api-access-vr8zv\") pod \"test-curl-7387-139878398036784\" (UID: \"2d89ef50-dc10-42c5-9fce-e543b55a1df4\") " pod="opendatahub/test-curl-7387-139878398036784"
Jul 24 14:35:08.444455 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:08.444413    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr8zv\" (UniqueName: \"kubernetes.io/projected/2d89ef50-dc10-42c5-9fce-e543b55a1df4-kube-api-access-vr8zv\") pod \"test-curl-7387-139878398036784\" (UID: \"2d89ef50-dc10-42c5-9fce-e543b55a1df4\") " pod="opendatahub/test-curl-7387-139878398036784"
Jul 24 14:35:08.453318 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:08.453289    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr8zv\" (UniqueName: \"kubernetes.io/projected/2d89ef50-dc10-42c5-9fce-e543b55a1df4-kube-api-access-vr8zv\") pod \"test-curl-7387-139878398036784\" (UID: \"2d89ef50-dc10-42c5-9fce-e543b55a1df4\") " pod="opendatahub/test-curl-7387-139878398036784"
Jul 24 14:35:08.521637 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:08.521543    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878398036784"
Jul 24 14:35:08.665549 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:08.664658    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:35:08.667526 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:08.667501    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7387-139878398036784"]
Jul 24 14:35:08.998922 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:08.998878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7387-139878398036784" event={"ID":"2d89ef50-dc10-42c5-9fce-e543b55a1df4","Type":"ContainerStarted","Data":"5d656f6619c9ea2bc9ec1c2376b9e6d13685d3db8b6b4c78a9be0afdc643a24e"}
Jul 24 14:35:10.005122 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:10.005080    2565 generic.go:356] "Generic (PLEG): container finished" podID="2d89ef50-dc10-42c5-9fce-e543b55a1df4" containerID="2267dd7f5b6e873da36e9cf9581813cb30f440f50dc734711a4848aa82f82c24" exitCode=0
Jul 24 14:35:10.005552 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:10.005168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7387-139878398036784" event={"ID":"2d89ef50-dc10-42c5-9fce-e543b55a1df4","Type":"ContainerDied","Data":"2267dd7f5b6e873da36e9cf9581813cb30f440f50dc734711a4848aa82f82c24"}
Jul 24 14:35:11.144705 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.144678    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878398036784"
Jul 24 14:35:11.193760 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.193726    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7387-139878398036784_2d89ef50-dc10-42c5-9fce-e543b55a1df4/test-curl-7387-139878398036784/0.log"
Jul 24 14:35:11.218578 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.218544    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7387-139878398036784"]
Jul 24 14:35:11.223156 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.223132    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7387-139878398036784"]
Jul 24 14:35:11.272493 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.272403    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr8zv\" (UniqueName: \"kubernetes.io/projected/2d89ef50-dc10-42c5-9fce-e543b55a1df4-kube-api-access-vr8zv\") pod \"2d89ef50-dc10-42c5-9fce-e543b55a1df4\" (UID: \"2d89ef50-dc10-42c5-9fce-e543b55a1df4\") "
Jul 24 14:35:11.274860 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.274825    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d89ef50-dc10-42c5-9fce-e543b55a1df4-kube-api-access-vr8zv" (OuterVolumeSpecName: "kube-api-access-vr8zv") pod "2d89ef50-dc10-42c5-9fce-e543b55a1df4" (UID: "2d89ef50-dc10-42c5-9fce-e543b55a1df4"). InnerVolumeSpecName "kube-api-access-vr8zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:35:11.350517 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.350480    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7387-139878398037424"]
Jul 24 14:35:11.350862 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.350850    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d89ef50-dc10-42c5-9fce-e543b55a1df4" containerName="test-curl-7387-139878398036784"
Jul 24 14:35:11.350907 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.350864    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d89ef50-dc10-42c5-9fce-e543b55a1df4" containerName="test-curl-7387-139878398036784"
Jul 24 14:35:11.350942 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.350936    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d89ef50-dc10-42c5-9fce-e543b55a1df4" containerName="test-curl-7387-139878398036784"
Jul 24 14:35:11.353837 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.353819    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878398037424"
Jul 24 14:35:11.358893 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.358864    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7387-139878398037424"]
Jul 24 14:35:11.374042 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.374011    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr8zv\" (UniqueName: \"kubernetes.io/projected/2d89ef50-dc10-42c5-9fce-e543b55a1df4-kube-api-access-vr8zv\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:11.474699 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.474655    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl926\" (UniqueName: \"kubernetes.io/projected/daa14199-32da-4232-81b9-b143d9e8190f-kube-api-access-jl926\") pod \"test-curl-7387-139878398037424\" (UID: \"daa14199-32da-4232-81b9-b143d9e8190f\") " pod="opendatahub/test-curl-7387-139878398037424"
Jul 24 14:35:11.575399 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.575352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl926\" (UniqueName: \"kubernetes.io/projected/daa14199-32da-4232-81b9-b143d9e8190f-kube-api-access-jl926\") pod \"test-curl-7387-139878398037424\" (UID: \"daa14199-32da-4232-81b9-b143d9e8190f\") " pod="opendatahub/test-curl-7387-139878398037424"
Jul 24 14:35:11.588744 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.588711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl926\" (UniqueName: \"kubernetes.io/projected/daa14199-32da-4232-81b9-b143d9e8190f-kube-api-access-jl926\") pod \"test-curl-7387-139878398037424\" (UID: \"daa14199-32da-4232-81b9-b143d9e8190f\") " pod="opendatahub/test-curl-7387-139878398037424"
Jul 24 14:35:11.664327 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.664293    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878398037424"
Jul 24 14:35:11.805637 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:11.805608    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7387-139878398037424"]
Jul 24 14:35:11.807437 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:35:11.807405    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddaa14199_32da_4232_81b9_b143d9e8190f.slice/crio-a90d33f40bef9c0b87558b7e24a71cf94face9c9b6d895cb5135c6bcf92d149c WatchSource:0}: Error finding container a90d33f40bef9c0b87558b7e24a71cf94face9c9b6d895cb5135c6bcf92d149c: Status 404 returned error can't find the container with id a90d33f40bef9c0b87558b7e24a71cf94face9c9b6d895cb5135c6bcf92d149c
Jul 24 14:35:12.015968 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:12.015930    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7387-139878398037424" event={"ID":"daa14199-32da-4232-81b9-b143d9e8190f","Type":"ContainerStarted","Data":"a90d33f40bef9c0b87558b7e24a71cf94face9c9b6d895cb5135c6bcf92d149c"}
Jul 24 14:35:12.017165 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:12.017139    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878398036784"
Jul 24 14:35:12.017165 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:12.017156    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d656f6619c9ea2bc9ec1c2376b9e6d13685d3db8b6b4c78a9be0afdc643a24e"
Jul 24 14:35:12.027516 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:35:12.027483    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7387-139878398036784\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="2d89ef50-dc10-42c5-9fce-e543b55a1df4" pod="opendatahub/test-curl-7387-139878398036784"
Jul 24 14:35:12.193249 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:35:12.193218    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7387-139878398036784\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="2d89ef50-dc10-42c5-9fce-e543b55a1df4" pod="opendatahub/test-curl-7387-139878398036784"
Jul 24 14:35:12.194989 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:12.194959    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d89ef50-dc10-42c5-9fce-e543b55a1df4" path="/var/lib/kubelet/pods/2d89ef50-dc10-42c5-9fce-e543b55a1df4/volumes"
Jul 24 14:35:13.022564 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:13.022529    2565 generic.go:356] "Generic (PLEG): container finished" podID="daa14199-32da-4232-81b9-b143d9e8190f" containerID="a40bcdcc0c7143d8af36d81ae358bf5886fee03dbc9f5bbecb76e2fbd0098a43" exitCode=0
Jul 24 14:35:13.022761 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:13.022621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7387-139878398037424" event={"ID":"daa14199-32da-4232-81b9-b143d9e8190f","Type":"ContainerDied","Data":"a40bcdcc0c7143d8af36d81ae358bf5886fee03dbc9f5bbecb76e2fbd0098a43"}
Jul 24 14:35:13.252371 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:13.252330    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:35:14.169823 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.169793    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878398037424"
Jul 24 14:35:14.194119 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.194095    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7387-139878398037424_daa14199-32da-4232-81b9-b143d9e8190f/test-curl-7387-139878398037424/0.log"
Jul 24 14:35:14.215257 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.215227    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7387-139878398037424"]
Jul 24 14:35:14.219214 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.219167    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7387-139878398037424"]
Jul 24 14:35:14.301651 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.301622    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl926\" (UniqueName: \"kubernetes.io/projected/daa14199-32da-4232-81b9-b143d9e8190f-kube-api-access-jl926\") pod \"daa14199-32da-4232-81b9-b143d9e8190f\" (UID: \"daa14199-32da-4232-81b9-b143d9e8190f\") "
Jul 24 14:35:14.303911 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.303887    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daa14199-32da-4232-81b9-b143d9e8190f-kube-api-access-jl926" (OuterVolumeSpecName: "kube-api-access-jl926") pod "daa14199-32da-4232-81b9-b143d9e8190f" (UID: "daa14199-32da-4232-81b9-b143d9e8190f"). InnerVolumeSpecName "kube-api-access-jl926". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:35:14.402474 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.402374    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl926\" (UniqueName: \"kubernetes.io/projected/daa14199-32da-4232-81b9-b143d9e8190f-kube-api-access-jl926\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:14.404464 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.404434    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7387-139878404360208"]
Jul 24 14:35:14.404791 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.404778    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa14199-32da-4232-81b9-b143d9e8190f" containerName="test-curl-7387-139878398037424"
Jul 24 14:35:14.404839 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.404793    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa14199-32da-4232-81b9-b143d9e8190f" containerName="test-curl-7387-139878398037424"
Jul 24 14:35:14.404905 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.404895    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa14199-32da-4232-81b9-b143d9e8190f" containerName="test-curl-7387-139878398037424"
Jul 24 14:35:14.407937 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.407918    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:14.424901 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.424868    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7387-139878404360208"]
Jul 24 14:35:14.502941 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.502903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr5td\" (UniqueName: \"kubernetes.io/projected/0d675f82-cacd-4547-bb7b-5be3ff873b3b-kube-api-access-tr5td\") pod \"test-curl-7387-139878404360208\" (UID: \"0d675f82-cacd-4547-bb7b-5be3ff873b3b\") " pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:14.604089 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.603974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr5td\" (UniqueName: \"kubernetes.io/projected/0d675f82-cacd-4547-bb7b-5be3ff873b3b-kube-api-access-tr5td\") pod \"test-curl-7387-139878404360208\" (UID: \"0d675f82-cacd-4547-bb7b-5be3ff873b3b\") " pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:14.613283 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.613255    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr5td\" (UniqueName: \"kubernetes.io/projected/0d675f82-cacd-4547-bb7b-5be3ff873b3b-kube-api-access-tr5td\") pod \"test-curl-7387-139878404360208\" (UID: \"0d675f82-cacd-4547-bb7b-5be3ff873b3b\") " pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:14.717532 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.717496    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:14.858619 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:14.858590    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7387-139878404360208"]
Jul 24 14:35:14.860594 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:35:14.860562    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d675f82_cacd_4547_bb7b_5be3ff873b3b.slice/crio-d782c389fb0b8030b39bdceb9ca1b724ba8c2bcbe206aeccbb77e62b37612020 WatchSource:0}: Error finding container d782c389fb0b8030b39bdceb9ca1b724ba8c2bcbe206aeccbb77e62b37612020: Status 404 returned error can't find the container with id d782c389fb0b8030b39bdceb9ca1b724ba8c2bcbe206aeccbb77e62b37612020
Jul 24 14:35:15.034256 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:15.034214    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7387-139878404360208" event={"ID":"0d675f82-cacd-4547-bb7b-5be3ff873b3b","Type":"ContainerStarted","Data":"d782c389fb0b8030b39bdceb9ca1b724ba8c2bcbe206aeccbb77e62b37612020"}
Jul 24 14:35:15.035432 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:15.035412    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878398037424"
Jul 24 14:35:15.035545 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:15.035440    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a90d33f40bef9c0b87558b7e24a71cf94face9c9b6d895cb5135c6bcf92d149c"
Jul 24 14:35:15.046063 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:35:15.046032    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7387-139878398037424\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="daa14199-32da-4232-81b9-b143d9e8190f" pod="opendatahub/test-curl-7387-139878398037424"
Jul 24 14:35:16.042035 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:16.041997    2565 generic.go:356] "Generic (PLEG): container finished" podID="0d675f82-cacd-4547-bb7b-5be3ff873b3b" containerID="c4dd5c5bb1f81d7742ca7734ca0678a225bfa0362c23fe0bc84c32982cdb0624" exitCode=0
Jul 24 14:35:16.042463 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:16.042055    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7387-139878404360208" event={"ID":"0d675f82-cacd-4547-bb7b-5be3ff873b3b","Type":"ContainerDied","Data":"c4dd5c5bb1f81d7742ca7734ca0678a225bfa0362c23fe0bc84c32982cdb0624"}
Jul 24 14:35:16.044538 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:35:16.044512    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7387-139878398037424\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="daa14199-32da-4232-81b9-b143d9e8190f" pod="opendatahub/test-curl-7387-139878398037424"
Jul 24 14:35:16.195789 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:16.195752    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daa14199-32da-4232-81b9-b143d9e8190f" path="/var/lib/kubelet/pods/daa14199-32da-4232-81b9-b143d9e8190f/volumes"
Jul 24 14:35:17.195857 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.195824    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:17.217740 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.217708    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7387-139878404360208_0d675f82-cacd-4547-bb7b-5be3ff873b3b/test-curl-7387-139878404360208/0.log"
Jul 24 14:35:17.226054 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.226023    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr5td\" (UniqueName: \"kubernetes.io/projected/0d675f82-cacd-4547-bb7b-5be3ff873b3b-kube-api-access-tr5td\") pod \"0d675f82-cacd-4547-bb7b-5be3ff873b3b\" (UID: \"0d675f82-cacd-4547-bb7b-5be3ff873b3b\") "
Jul 24 14:35:17.228436 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.228402    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d675f82-cacd-4547-bb7b-5be3ff873b3b-kube-api-access-tr5td" (OuterVolumeSpecName: "kube-api-access-tr5td") pod "0d675f82-cacd-4547-bb7b-5be3ff873b3b" (UID: "0d675f82-cacd-4547-bb7b-5be3ff873b3b"). InnerVolumeSpecName "kube-api-access-tr5td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:35:17.241070 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.241038    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7387-139878404360208"]
Jul 24 14:35:17.244626 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.244600    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7387-139878404360208"]
Jul 24 14:35:17.327430 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.327398    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr5td\" (UniqueName: \"kubernetes.io/projected/0d675f82-cacd-4547-bb7b-5be3ff873b3b-kube-api-access-tr5td\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:17.372280 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.372185    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7387-139878404360208"]
Jul 24 14:35:17.372551 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.372537    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d675f82-cacd-4547-bb7b-5be3ff873b3b" containerName="test-curl-7387-139878404360208"
Jul 24 14:35:17.372624 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.372552    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d675f82-cacd-4547-bb7b-5be3ff873b3b" containerName="test-curl-7387-139878404360208"
Jul 24 14:35:17.372675 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.372623    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d675f82-cacd-4547-bb7b-5be3ff873b3b" containerName="test-curl-7387-139878404360208"
Jul 24 14:35:17.375653 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.375618    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:17.383317 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.383280    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7387-139878404360208"]
Jul 24 14:35:17.428152 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.428116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knrkf\" (UniqueName: \"kubernetes.io/projected/b83cdb9e-84c5-4231-9bcc-e2a011ce8744-kube-api-access-knrkf\") pod \"test-curl-7387-139878404360208\" (UID: \"b83cdb9e-84c5-4231-9bcc-e2a011ce8744\") " pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:17.528787 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.528754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knrkf\" (UniqueName: \"kubernetes.io/projected/b83cdb9e-84c5-4231-9bcc-e2a011ce8744-kube-api-access-knrkf\") pod \"test-curl-7387-139878404360208\" (UID: \"b83cdb9e-84c5-4231-9bcc-e2a011ce8744\") " pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:17.537553 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.537521    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knrkf\" (UniqueName: \"kubernetes.io/projected/b83cdb9e-84c5-4231-9bcc-e2a011ce8744-kube-api-access-knrkf\") pod \"test-curl-7387-139878404360208\" (UID: \"b83cdb9e-84c5-4231-9bcc-e2a011ce8744\") " pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:17.688418 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.688318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:17.833058 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:17.833020    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7387-139878404360208"]
Jul 24 14:35:17.837136 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:35:17.837106    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb83cdb9e_84c5_4231_9bcc_e2a011ce8744.slice/crio-4a416116a11160232d7654947bb723e9e65622bf792a47386b085d03def8e066 WatchSource:0}: Error finding container 4a416116a11160232d7654947bb723e9e65622bf792a47386b085d03def8e066: Status 404 returned error can't find the container with id 4a416116a11160232d7654947bb723e9e65622bf792a47386b085d03def8e066
Jul 24 14:35:18.053624 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:18.053586    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7387-139878404360208" event={"ID":"b83cdb9e-84c5-4231-9bcc-e2a011ce8744","Type":"ContainerStarted","Data":"4a416116a11160232d7654947bb723e9e65622bf792a47386b085d03def8e066"}
Jul 24 14:35:18.055066 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:18.055038    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:18.055240 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:18.055042    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d782c389fb0b8030b39bdceb9ca1b724ba8c2bcbe206aeccbb77e62b37612020"
Jul 24 14:35:18.066943 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:18.066895    2565 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7387-139878404360208" oldPodUID="0d675f82-cacd-4547-bb7b-5be3ff873b3b" podUID="b83cdb9e-84c5-4231-9bcc-e2a011ce8744"
Jul 24 14:35:18.209401 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:18.209375    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d675f82-cacd-4547-bb7b-5be3ff873b3b" path="/var/lib/kubelet/pods/0d675f82-cacd-4547-bb7b-5be3ff873b3b/volumes"
Jul 24 14:35:19.061344 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:19.061310    2565 generic.go:356] "Generic (PLEG): container finished" podID="b83cdb9e-84c5-4231-9bcc-e2a011ce8744" containerID="2d35ff9f11ce55d646973f0e92ad6c2027935d4150fe237522d503dfbf2a66ad" exitCode=0
Jul 24 14:35:19.061512 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:19.061397    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7387-139878404360208" event={"ID":"b83cdb9e-84c5-4231-9bcc-e2a011ce8744","Type":"ContainerDied","Data":"2d35ff9f11ce55d646973f0e92ad6c2027935d4150fe237522d503dfbf2a66ad"}
Jul 24 14:35:20.206682 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.206656    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:20.227043 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.226988    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7387-139878404360208_b83cdb9e-84c5-4231-9bcc-e2a011ce8744/test-curl-7387-139878404360208/0.log"
Jul 24 14:35:20.252124 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.252087    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7387-139878404360208"]
Jul 24 14:35:20.253966 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.253944    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7387-139878404360208"]
Jul 24 14:35:20.255916 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.255897    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knrkf\" (UniqueName: \"kubernetes.io/projected/b83cdb9e-84c5-4231-9bcc-e2a011ce8744-kube-api-access-knrkf\") pod \"b83cdb9e-84c5-4231-9bcc-e2a011ce8744\" (UID: \"b83cdb9e-84c5-4231-9bcc-e2a011ce8744\") "
Jul 24 14:35:20.258240 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.258204    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b83cdb9e-84c5-4231-9bcc-e2a011ce8744-kube-api-access-knrkf" (OuterVolumeSpecName: "kube-api-access-knrkf") pod "b83cdb9e-84c5-4231-9bcc-e2a011ce8744" (UID: "b83cdb9e-84c5-4231-9bcc-e2a011ce8744"). InnerVolumeSpecName "kube-api-access-knrkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:35:20.357501 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.357409    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knrkf\" (UniqueName: \"kubernetes.io/projected/b83cdb9e-84c5-4231-9bcc-e2a011ce8744-kube-api-access-knrkf\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:20.383601 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.383567    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7387-139878397937104"]
Jul 24 14:35:20.384133 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.384110    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b83cdb9e-84c5-4231-9bcc-e2a011ce8744" containerName="test-curl-7387-139878404360208"
Jul 24 14:35:20.384196 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.384139    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b83cdb9e-84c5-4231-9bcc-e2a011ce8744" containerName="test-curl-7387-139878404360208"
Jul 24 14:35:20.384306 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.384293    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b83cdb9e-84c5-4231-9bcc-e2a011ce8744" containerName="test-curl-7387-139878404360208"
Jul 24 14:35:20.387316 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.387296    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:20.393162 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.393128    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7387-139878397937104"]
Jul 24 14:35:20.458301 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.458265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpx44\" (UniqueName: \"kubernetes.io/projected/358e3891-769f-426e-b61d-e99185534f4c-kube-api-access-zpx44\") pod \"test-curl-7387-139878397937104\" (UID: \"358e3891-769f-426e-b61d-e99185534f4c\") " pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:20.559286 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.559251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpx44\" (UniqueName: \"kubernetes.io/projected/358e3891-769f-426e-b61d-e99185534f4c-kube-api-access-zpx44\") pod \"test-curl-7387-139878397937104\" (UID: \"358e3891-769f-426e-b61d-e99185534f4c\") " pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:20.567697 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.567670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpx44\" (UniqueName: \"kubernetes.io/projected/358e3891-769f-426e-b61d-e99185534f4c-kube-api-access-zpx44\") pod \"test-curl-7387-139878397937104\" (UID: \"358e3891-769f-426e-b61d-e99185534f4c\") " pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:20.698025 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.697935    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:20.836221 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:20.836167    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7387-139878397937104"]
Jul 24 14:35:20.837355 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:35:20.837329    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod358e3891_769f_426e_b61d_e99185534f4c.slice/crio-7cbc455360f67d2b91d298fa2c6f719a9d36634bf240a2804213170d65ef78ee WatchSource:0}: Error finding container 7cbc455360f67d2b91d298fa2c6f719a9d36634bf240a2804213170d65ef78ee: Status 404 returned error can't find the container with id 7cbc455360f67d2b91d298fa2c6f719a9d36634bf240a2804213170d65ef78ee
Jul 24 14:35:21.072667 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.072635    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a416116a11160232d7654947bb723e9e65622bf792a47386b085d03def8e066"
Jul 24 14:35:21.072667 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.072636    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:21.073916 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.073890    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7387-139878397937104" event={"ID":"358e3891-769f-426e-b61d-e99185534f4c","Type":"ContainerStarted","Data":"7cbc455360f67d2b91d298fa2c6f719a9d36634bf240a2804213170d65ef78ee"}
Jul 24 14:35:21.083421 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:35:21.083391    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7387-139878404360208\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="b83cdb9e-84c5-4231-9bcc-e2a011ce8744" pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:21.312314 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.312271    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl" podUID="67bb4abc-2db1-48fe-8d5e-e5f9f0267fff" containerName="main" containerID="cri-o://c3f7884e36efca62733a107fbebbc21f58c939e321e91f5f293ecf10e614357b" gracePeriod=45
Jul 24 14:35:21.560026 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.559997    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:35:21.562433 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:35:21.562402    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7387-139878404360208\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="b83cdb9e-84c5-4231-9bcc-e2a011ce8744" pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:21.669091 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.668994    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-model-cache\") pod \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") "
Jul 24 14:35:21.669091 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.669055    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-tmp-dir\") pod \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") "
Jul 24 14:35:21.669351 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.669099    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-tls-certs\") pod \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") "
Jul 24 14:35:21.669351 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.669147    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-dshm\") pod \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") "
Jul 24 14:35:21.669351 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.669213    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fjkg\" (UniqueName: \"kubernetes.io/projected/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-kube-api-access-5fjkg\") pod \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") "
Jul 24 14:35:21.669351 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.669240    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-home\") pod \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\" (UID: \"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff\") "
Jul 24 14:35:21.669561 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.669355    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-model-cache" (OuterVolumeSpecName: "model-cache") pod "67bb4abc-2db1-48fe-8d5e-e5f9f0267fff" (UID: "67bb4abc-2db1-48fe-8d5e-e5f9f0267fff"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:35:21.669561 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.669416    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "67bb4abc-2db1-48fe-8d5e-e5f9f0267fff" (UID: "67bb4abc-2db1-48fe-8d5e-e5f9f0267fff"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:35:21.669647 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.669562    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-home" (OuterVolumeSpecName: "home") pod "67bb4abc-2db1-48fe-8d5e-e5f9f0267fff" (UID: "67bb4abc-2db1-48fe-8d5e-e5f9f0267fff"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:35:21.669647 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.669593    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-model-cache\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:21.669647 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.669614    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-tmp-dir\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:21.671560 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.671536    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-dshm" (OuterVolumeSpecName: "dshm") pod "67bb4abc-2db1-48fe-8d5e-e5f9f0267fff" (UID: "67bb4abc-2db1-48fe-8d5e-e5f9f0267fff"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:35:21.671560 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.671542    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-kube-api-access-5fjkg" (OuterVolumeSpecName: "kube-api-access-5fjkg") pod "67bb4abc-2db1-48fe-8d5e-e5f9f0267fff" (UID: "67bb4abc-2db1-48fe-8d5e-e5f9f0267fff"). InnerVolumeSpecName "kube-api-access-5fjkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:35:21.671560 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.671547    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "67bb4abc-2db1-48fe-8d5e-e5f9f0267fff" (UID: "67bb4abc-2db1-48fe-8d5e-e5f9f0267fff"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:35:21.770262 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.770229    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-tls-certs\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:21.770262 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.770258    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-dshm\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:21.770262 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.770268    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fjkg\" (UniqueName: \"kubernetes.io/projected/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-kube-api-access-5fjkg\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:21.770534 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:21.770276    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff-home\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:22.080086 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.080052    2565 generic.go:356] "Generic (PLEG): container finished" podID="67bb4abc-2db1-48fe-8d5e-e5f9f0267fff" containerID="c3f7884e36efca62733a107fbebbc21f58c939e321e91f5f293ecf10e614357b" exitCode=0
Jul 24 14:35:22.080300 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.080099    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"
Jul 24 14:35:22.080300 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.080140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl" event={"ID":"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff","Type":"ContainerDied","Data":"c3f7884e36efca62733a107fbebbc21f58c939e321e91f5f293ecf10e614357b"}
Jul 24 14:35:22.080300 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.080204    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl" event={"ID":"67bb4abc-2db1-48fe-8d5e-e5f9f0267fff","Type":"ContainerDied","Data":"0eb45bcdee62ae6cdaf2ecb68c790755871345fb75b8e4fae595a7ea72f26f06"}
Jul 24 14:35:22.080300 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.080230    2565 scope.go:117] "RemoveContainer" containerID="c3f7884e36efca62733a107fbebbc21f58c939e321e91f5f293ecf10e614357b"
Jul 24 14:35:22.081797 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.081771    2565 generic.go:356] "Generic (PLEG): container finished" podID="358e3891-769f-426e-b61d-e99185534f4c" containerID="6b5857e8c682be7b1192ad8ae6e42c4c148157ff2f1c4f3c9f0b6cb133aa995b" exitCode=0
Jul 24 14:35:22.081917 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.081868    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7387-139878397937104" event={"ID":"358e3891-769f-426e-b61d-e99185534f4c","Type":"ContainerDied","Data":"6b5857e8c682be7b1192ad8ae6e42c4c148157ff2f1c4f3c9f0b6cb133aa995b"}
Jul 24 14:35:22.082612 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:35:22.082581    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7387-139878404360208\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="b83cdb9e-84c5-4231-9bcc-e2a011ce8744" pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:22.089912 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:35:22.088648    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7387-139878404360208\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="b83cdb9e-84c5-4231-9bcc-e2a011ce8744" pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:22.092878 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.092860    2565 scope.go:117] "RemoveContainer" containerID="c3f7884e36efca62733a107fbebbc21f58c939e321e91f5f293ecf10e614357b"
Jul 24 14:35:22.093138 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:35:22.093121    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3f7884e36efca62733a107fbebbc21f58c939e321e91f5f293ecf10e614357b\": container with ID starting with c3f7884e36efca62733a107fbebbc21f58c939e321e91f5f293ecf10e614357b not found: ID does not exist" containerID="c3f7884e36efca62733a107fbebbc21f58c939e321e91f5f293ecf10e614357b"
Jul 24 14:35:22.093229 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.093145    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f7884e36efca62733a107fbebbc21f58c939e321e91f5f293ecf10e614357b"} err="failed to get container status \"c3f7884e36efca62733a107fbebbc21f58c939e321e91f5f293ecf10e614357b\": rpc error: code = NotFound desc = could not find container \"c3f7884e36efca62733a107fbebbc21f58c939e321e91f5f293ecf10e614357b\": container with ID starting with c3f7884e36efca62733a107fbebbc21f58c939e321e91f5f293ecf10e614357b not found: ID does not exist"
Jul 24 14:35:22.104552 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:35:22.104513    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7387-139878404360208\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="b83cdb9e-84c5-4231-9bcc-e2a011ce8744" pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:22.117035 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.117007    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"]
Jul 24 14:35:22.120528 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.120501    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-94af13/rate-test-model-94af13-kserve-69d47f46cf-r4lvl"]
Jul 24 14:35:22.197527 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.197486    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp" podUID="28e8949b-d17e-40cc-8f1d-4b7757527a94" containerName="main" containerID="cri-o://43ba50af01083c221e65b04271ab359dc2c0e5543e5acdb9476f0c18b9c93060" gracePeriod=45
Jul 24 14:35:22.198373 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:35:22.198342    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7387-139878404360208\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="b83cdb9e-84c5-4231-9bcc-e2a011ce8744" pod="opendatahub/test-curl-7387-139878404360208"
Jul 24 14:35:22.198972 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.198953    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67bb4abc-2db1-48fe-8d5e-e5f9f0267fff" path="/var/lib/kubelet/pods/67bb4abc-2db1-48fe-8d5e-e5f9f0267fff/volumes"
Jul 24 14:35:22.199361 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.199346    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b83cdb9e-84c5-4231-9bcc-e2a011ce8744" path="/var/lib/kubelet/pods/b83cdb9e-84c5-4231-9bcc-e2a011ce8744/volumes"
Jul 24 14:35:22.457563 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.457529    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:35:22.476586 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.476551    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-model-cache\") pod \"28e8949b-d17e-40cc-8f1d-4b7757527a94\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") "
Jul 24 14:35:22.476586 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.476592    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-home\") pod \"28e8949b-d17e-40cc-8f1d-4b7757527a94\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") "
Jul 24 14:35:22.476867 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.476739    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28e8949b-d17e-40cc-8f1d-4b7757527a94-tls-certs\") pod \"28e8949b-d17e-40cc-8f1d-4b7757527a94\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") "
Jul 24 14:35:22.476867 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.476782    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-tmp-dir\") pod \"28e8949b-d17e-40cc-8f1d-4b7757527a94\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") "
Jul 24 14:35:22.477034 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.476809    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94jxc\" (UniqueName: \"kubernetes.io/projected/28e8949b-d17e-40cc-8f1d-4b7757527a94-kube-api-access-94jxc\") pod \"28e8949b-d17e-40cc-8f1d-4b7757527a94\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") "
Jul 24 14:35:22.477034 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.476854    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-model-cache" (OuterVolumeSpecName: "model-cache") pod "28e8949b-d17e-40cc-8f1d-4b7757527a94" (UID: "28e8949b-d17e-40cc-8f1d-4b7757527a94"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:35:22.477034 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.476949    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-dshm\") pod \"28e8949b-d17e-40cc-8f1d-4b7757527a94\" (UID: \"28e8949b-d17e-40cc-8f1d-4b7757527a94\") "
Jul 24 14:35:22.477034 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.477012    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-home" (OuterVolumeSpecName: "home") pod "28e8949b-d17e-40cc-8f1d-4b7757527a94" (UID: "28e8949b-d17e-40cc-8f1d-4b7757527a94"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:35:22.477660 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.477595    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-model-cache\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:22.477660 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.477620    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-home\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:22.477945 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.477916    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "28e8949b-d17e-40cc-8f1d-4b7757527a94" (UID: "28e8949b-d17e-40cc-8f1d-4b7757527a94"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:35:22.483009 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.482974    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-dshm" (OuterVolumeSpecName: "dshm") pod "28e8949b-d17e-40cc-8f1d-4b7757527a94" (UID: "28e8949b-d17e-40cc-8f1d-4b7757527a94"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:35:22.491725 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.491650    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28e8949b-d17e-40cc-8f1d-4b7757527a94-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "28e8949b-d17e-40cc-8f1d-4b7757527a94" (UID: "28e8949b-d17e-40cc-8f1d-4b7757527a94"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:35:22.492416 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.492389    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28e8949b-d17e-40cc-8f1d-4b7757527a94-kube-api-access-94jxc" (OuterVolumeSpecName: "kube-api-access-94jxc") pod "28e8949b-d17e-40cc-8f1d-4b7757527a94" (UID: "28e8949b-d17e-40cc-8f1d-4b7757527a94"). InnerVolumeSpecName "kube-api-access-94jxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:35:22.578582 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.578538    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28e8949b-d17e-40cc-8f1d-4b7757527a94-tls-certs\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:22.578582 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.578571    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-tmp-dir\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:22.578582 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.578580    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94jxc\" (UniqueName: \"kubernetes.io/projected/28e8949b-d17e-40cc-8f1d-4b7757527a94-kube-api-access-94jxc\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:22.578582 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:22.578590    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28e8949b-d17e-40cc-8f1d-4b7757527a94-dshm\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:23.090522 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.090484    2565 generic.go:356] "Generic (PLEG): container finished" podID="28e8949b-d17e-40cc-8f1d-4b7757527a94" containerID="43ba50af01083c221e65b04271ab359dc2c0e5543e5acdb9476f0c18b9c93060" exitCode=0
Jul 24 14:35:23.090684 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.090542    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"
Jul 24 14:35:23.090684 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.090573    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp" event={"ID":"28e8949b-d17e-40cc-8f1d-4b7757527a94","Type":"ContainerDied","Data":"43ba50af01083c221e65b04271ab359dc2c0e5543e5acdb9476f0c18b9c93060"}
Jul 24 14:35:23.090684 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.090611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp" event={"ID":"28e8949b-d17e-40cc-8f1d-4b7757527a94","Type":"ContainerDied","Data":"324b0aa6fd6b45e287682c1ce47a516f46f37c5f5c5ec7ee2f59cba014dc0cd0"}
Jul 24 14:35:23.090684 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.090629    2565 scope.go:117] "RemoveContainer" containerID="43ba50af01083c221e65b04271ab359dc2c0e5543e5acdb9476f0c18b9c93060"
Jul 24 14:35:23.099777 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.099758    2565 scope.go:117] "RemoveContainer" containerID="43ba50af01083c221e65b04271ab359dc2c0e5543e5acdb9476f0c18b9c93060"
Jul 24 14:35:23.100085 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:35:23.100063    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43ba50af01083c221e65b04271ab359dc2c0e5543e5acdb9476f0c18b9c93060\": container with ID starting with 43ba50af01083c221e65b04271ab359dc2c0e5543e5acdb9476f0c18b9c93060 not found: ID does not exist" containerID="43ba50af01083c221e65b04271ab359dc2c0e5543e5acdb9476f0c18b9c93060"
Jul 24 14:35:23.100160 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.100097    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ba50af01083c221e65b04271ab359dc2c0e5543e5acdb9476f0c18b9c93060"} err="failed to get container status \"43ba50af01083c221e65b04271ab359dc2c0e5543e5acdb9476f0c18b9c93060\": rpc error: code = NotFound desc = could not find container \"43ba50af01083c221e65b04271ab359dc2c0e5543e5acdb9476f0c18b9c93060\": container with ID starting with 43ba50af01083c221e65b04271ab359dc2c0e5543e5acdb9476f0c18b9c93060 not found: ID does not exist"
Jul 24 14:35:23.114197 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.114146    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"]
Jul 24 14:35:23.117076 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.117051    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-938af8/rate-test-model-938af8-kserve-5496cc9f9f-nm8qp"]
Jul 24 14:35:23.237030 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.237001    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:23.261402 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.261375    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7387-139878397937104_358e3891-769f-426e-b61d-e99185534f4c/test-curl-7387-139878397937104/0.log"
Jul 24 14:35:23.284893 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.284861    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7387-139878397937104"]
Jul 24 14:35:23.285201 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.285164    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpx44\" (UniqueName: \"kubernetes.io/projected/358e3891-769f-426e-b61d-e99185534f4c-kube-api-access-zpx44\") pod \"358e3891-769f-426e-b61d-e99185534f4c\" (UID: \"358e3891-769f-426e-b61d-e99185534f4c\") "
Jul 24 14:35:23.287708 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.287680    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358e3891-769f-426e-b61d-e99185534f4c-kube-api-access-zpx44" (OuterVolumeSpecName: "kube-api-access-zpx44") pod "358e3891-769f-426e-b61d-e99185534f4c" (UID: "358e3891-769f-426e-b61d-e99185534f4c"). InnerVolumeSpecName "kube-api-access-zpx44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:35:23.288153 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.288136    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7387-139878397937104"]
Jul 24 14:35:23.387214 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.387113    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpx44\" (UniqueName: \"kubernetes.io/projected/358e3891-769f-426e-b61d-e99185534f4c-kube-api-access-zpx44\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:23.418210 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.418156    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7387-139878397937104"]
Jul 24 14:35:23.418591 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.418577    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28e8949b-d17e-40cc-8f1d-4b7757527a94" containerName="main"
Jul 24 14:35:23.418637 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.418592    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="28e8949b-d17e-40cc-8f1d-4b7757527a94" containerName="main"
Jul 24 14:35:23.418637 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.418606    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67bb4abc-2db1-48fe-8d5e-e5f9f0267fff" containerName="main"
Jul 24 14:35:23.418637 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.418612    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="67bb4abc-2db1-48fe-8d5e-e5f9f0267fff" containerName="main"
Jul 24 14:35:23.418637 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.418624    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="358e3891-769f-426e-b61d-e99185534f4c" containerName="test-curl-7387-139878397937104"
Jul 24 14:35:23.418637 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.418630    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="358e3891-769f-426e-b61d-e99185534f4c" containerName="test-curl-7387-139878397937104"
Jul 24 14:35:23.418777 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.418696    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="67bb4abc-2db1-48fe-8d5e-e5f9f0267fff" containerName="main"
Jul 24 14:35:23.418777 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.418703    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="28e8949b-d17e-40cc-8f1d-4b7757527a94" containerName="main"
Jul 24 14:35:23.418777 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.418709    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="358e3891-769f-426e-b61d-e99185534f4c" containerName="test-curl-7387-139878397937104"
Jul 24 14:35:23.421936 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.421917    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:23.430407 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.430376    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7387-139878397937104"]
Jul 24 14:35:23.488124 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.488083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29l85\" (UniqueName: \"kubernetes.io/projected/b39206ad-76fa-4e11-8288-edb37ae305b6-kube-api-access-29l85\") pod \"test-curl-7387-139878397937104\" (UID: \"b39206ad-76fa-4e11-8288-edb37ae305b6\") " pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:23.589561 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.589517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29l85\" (UniqueName: \"kubernetes.io/projected/b39206ad-76fa-4e11-8288-edb37ae305b6-kube-api-access-29l85\") pod \"test-curl-7387-139878397937104\" (UID: \"b39206ad-76fa-4e11-8288-edb37ae305b6\") " pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:23.598937 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.598911    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29l85\" (UniqueName: \"kubernetes.io/projected/b39206ad-76fa-4e11-8288-edb37ae305b6-kube-api-access-29l85\") pod \"test-curl-7387-139878397937104\" (UID: \"b39206ad-76fa-4e11-8288-edb37ae305b6\") " pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:23.731505 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.731408    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:23.871601 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:23.871568    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7387-139878397937104"]
Jul 24 14:35:23.873689 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:35:23.873663    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb39206ad_76fa_4e11_8288_edb37ae305b6.slice/crio-14255a1f6bef630d5686fec6b8f14425745cb0d5143bba548124d2220502fa1c WatchSource:0}: Error finding container 14255a1f6bef630d5686fec6b8f14425745cb0d5143bba548124d2220502fa1c: Status 404 returned error can't find the container with id 14255a1f6bef630d5686fec6b8f14425745cb0d5143bba548124d2220502fa1c
Jul 24 14:35:24.096439 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:24.096411    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:24.096605 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:24.096457    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cbc455360f67d2b91d298fa2c6f719a9d36634bf240a2804213170d65ef78ee"
Jul 24 14:35:24.098711 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:24.098682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7387-139878397937104" event={"ID":"b39206ad-76fa-4e11-8288-edb37ae305b6","Type":"ContainerStarted","Data":"14255a1f6bef630d5686fec6b8f14425745cb0d5143bba548124d2220502fa1c"}
Jul 24 14:35:24.109021 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:24.108988    2565 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7387-139878397937104" oldPodUID="358e3891-769f-426e-b61d-e99185534f4c" podUID="b39206ad-76fa-4e11-8288-edb37ae305b6"
Jul 24 14:35:24.196434 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:24.196401    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28e8949b-d17e-40cc-8f1d-4b7757527a94" path="/var/lib/kubelet/pods/28e8949b-d17e-40cc-8f1d-4b7757527a94/volumes"
Jul 24 14:35:24.196757 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:24.196741    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="358e3891-769f-426e-b61d-e99185534f4c" path="/var/lib/kubelet/pods/358e3891-769f-426e-b61d-e99185534f4c/volumes"
Jul 24 14:35:25.106027 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:25.105994    2565 generic.go:356] "Generic (PLEG): container finished" podID="b39206ad-76fa-4e11-8288-edb37ae305b6" containerID="ddb0cf25b58f7d6104b1d89d108b294eca445d9710960cb8ff129128eb670629" exitCode=0
Jul 24 14:35:25.106598 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:25.106079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7387-139878397937104" event={"ID":"b39206ad-76fa-4e11-8288-edb37ae305b6","Type":"ContainerDied","Data":"ddb0cf25b58f7d6104b1d89d108b294eca445d9710960cb8ff129128eb670629"}
Jul 24 14:35:26.252450 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:26.252416    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:26.274776 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:26.274744    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7387-139878397937104_b39206ad-76fa-4e11-8288-edb37ae305b6/test-curl-7387-139878397937104/0.log"
Jul 24 14:35:26.296911 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:26.296882    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7387-139878397937104"]
Jul 24 14:35:26.300903 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:26.300874    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7387-139878397937104"]
Jul 24 14:35:26.316971 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:26.316938    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29l85\" (UniqueName: \"kubernetes.io/projected/b39206ad-76fa-4e11-8288-edb37ae305b6-kube-api-access-29l85\") pod \"b39206ad-76fa-4e11-8288-edb37ae305b6\" (UID: \"b39206ad-76fa-4e11-8288-edb37ae305b6\") "
Jul 24 14:35:26.319279 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:26.319251    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b39206ad-76fa-4e11-8288-edb37ae305b6-kube-api-access-29l85" (OuterVolumeSpecName: "kube-api-access-29l85") pod "b39206ad-76fa-4e11-8288-edb37ae305b6" (UID: "b39206ad-76fa-4e11-8288-edb37ae305b6"). InnerVolumeSpecName "kube-api-access-29l85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:35:26.418585 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:26.418492    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29l85\" (UniqueName: \"kubernetes.io/projected/b39206ad-76fa-4e11-8288-edb37ae305b6-kube-api-access-29l85\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:35:27.119413 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:27.119386    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14255a1f6bef630d5686fec6b8f14425745cb0d5143bba548124d2220502fa1c"
Jul 24 14:35:27.119677 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:27.119603    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:27.130125 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:35:27.130095    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7387-139878397937104\" is forbidden: User \"system:node:ip-10-0-132-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-200.ec2.internal' and this object" podUID="b39206ad-76fa-4e11-8288-edb37ae305b6" pod="opendatahub/test-curl-7387-139878397937104"
Jul 24 14:35:28.195021 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:28.194985    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b39206ad-76fa-4e11-8288-edb37ae305b6" path="/var/lib/kubelet/pods/b39206ad-76fa-4e11-8288-edb37ae305b6/volumes"
Jul 24 14:35:39.051722 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:39.051680    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:35:59.626894 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.626857    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"]
Jul 24 14:35:59.627450 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.627292    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b39206ad-76fa-4e11-8288-edb37ae305b6" containerName="test-curl-7387-139878397937104"
Jul 24 14:35:59.627450 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.627306    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b39206ad-76fa-4e11-8288-edb37ae305b6" containerName="test-curl-7387-139878397937104"
Jul 24 14:35:59.627450 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.627373    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b39206ad-76fa-4e11-8288-edb37ae305b6" containerName="test-curl-7387-139878397937104"
Jul 24 14:35:59.630219 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.630195    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:35:59.633353 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.633334    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 14:35:59.633681 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.633660    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ctd4l\""
Jul 24 14:35:59.634221 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.634200    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-fde43a-serving-cert\""
Jul 24 14:35:59.634948 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.634931    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 14:35:59.648195 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.648141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"]
Jul 24 14:35:59.817835 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.817804    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad47c729-cfc7-435b-94a4-87c9b542306c-maas-api-tls\") pod \"maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29\" (UID: \"ad47c729-cfc7-435b-94a4-87c9b542306c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:35:59.818043 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.817861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad47c729-cfc7-435b-94a4-87c9b542306c-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29\" (UID: \"ad47c729-cfc7-435b-94a4-87c9b542306c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:35:59.818043 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.817894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptwtv\" (UniqueName: \"kubernetes.io/projected/ad47c729-cfc7-435b-94a4-87c9b542306c-kube-api-access-ptwtv\") pod \"maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29\" (UID: \"ad47c729-cfc7-435b-94a4-87c9b542306c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:35:59.919452 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.919347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad47c729-cfc7-435b-94a4-87c9b542306c-maas-api-tls\") pod \"maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29\" (UID: \"ad47c729-cfc7-435b-94a4-87c9b542306c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:35:59.919452 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.919410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad47c729-cfc7-435b-94a4-87c9b542306c-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29\" (UID: \"ad47c729-cfc7-435b-94a4-87c9b542306c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:35:59.919452 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.919437    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptwtv\" (UniqueName: \"kubernetes.io/projected/ad47c729-cfc7-435b-94a4-87c9b542306c-kube-api-access-ptwtv\") pod \"maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29\" (UID: \"ad47c729-cfc7-435b-94a4-87c9b542306c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:35:59.920069 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.920049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad47c729-cfc7-435b-94a4-87c9b542306c-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29\" (UID: \"ad47c729-cfc7-435b-94a4-87c9b542306c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:35:59.921974 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.921952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad47c729-cfc7-435b-94a4-87c9b542306c-maas-api-tls\") pod \"maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29\" (UID: \"ad47c729-cfc7-435b-94a4-87c9b542306c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:35:59.928252 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.928230    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptwtv\" (UniqueName: \"kubernetes.io/projected/ad47c729-cfc7-435b-94a4-87c9b542306c-kube-api-access-ptwtv\") pod \"maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29\" (UID: \"ad47c729-cfc7-435b-94a4-87c9b542306c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:35:59.941087 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:35:59.941056    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:36:00.077701 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:00.077681    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"]
Jul 24 14:36:00.080086 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:36:00.080054    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad47c729_cfc7_435b_94a4_87c9b542306c.slice/crio-80c323a4f4e0e400684cedc66cc4c00cbdee53f9c52407ce51753657fea9e5a6 WatchSource:0}: Error finding container 80c323a4f4e0e400684cedc66cc4c00cbdee53f9c52407ce51753657fea9e5a6: Status 404 returned error can't find the container with id 80c323a4f4e0e400684cedc66cc4c00cbdee53f9c52407ce51753657fea9e5a6
Jul 24 14:36:00.277670 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:00.277591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29" event={"ID":"ad47c729-cfc7-435b-94a4-87c9b542306c","Type":"ContainerStarted","Data":"80c323a4f4e0e400684cedc66cc4c00cbdee53f9c52407ce51753657fea9e5a6"}
Jul 24 14:36:03.296355 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:03.296316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29" event={"ID":"ad47c729-cfc7-435b-94a4-87c9b542306c","Type":"ContainerStarted","Data":"bb2593a6e38f4eb32b50309d55cf57fd8e190a2da4b1578e1db50ad9c867f753"}
Jul 24 14:36:03.296759 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:03.296453    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:36:03.315758 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:03.315705    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29" podStartSLOduration=2.087991805 podStartE2EDuration="4.315689858s" totalImagesPullingTime="2.227698053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:03.314601176 +0000 UTC m=+3071.549952542" watchObservedRunningTime="2026-07-24 14:36:03.315689858 +0000 UTC m=+3071.551041219"
Jul 24 14:36:08.951528 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:08.951485    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:36:09.306299 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:09.306270    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:36:28.355396 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.355354    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"]
Jul 24 14:36:28.359447 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.359422    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.363018 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.362995    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-106097\"/\"openshift-service-ca.crt\""
Jul 24 14:36:28.363018 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.362995    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-106097\"/\"ipp-route-106097-kserve-self-signed-certs\""
Jul 24 14:36:28.363262 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.362995    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-106097\"/\"default-dockercfg-gxk5g\""
Jul 24 14:36:28.363262 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.363003    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-106097\"/\"kube-root-ca.crt\""
Jul 24 14:36:28.370072 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.370050    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"]
Jul 24 14:36:28.480800 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.480762    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-tmp-dir\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.480800 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.480806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-model-cache\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.481033 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.480869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-tls-certs\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.481033 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.480906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-dshm\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.481033 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.480956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-home\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.481135 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.481036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4j6q\" (UniqueName: \"kubernetes.io/projected/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-kube-api-access-r4j6q\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.582370 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.582333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-home\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.582538 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.582387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4j6q\" (UniqueName: \"kubernetes.io/projected/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-kube-api-access-r4j6q\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.582538 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.582426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-tmp-dir\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.582538 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.582444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-model-cache\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.582538 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.582465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-tls-certs\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.582538 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.582481    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-dshm\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.582838 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.582815    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-home\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.582882 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.582833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-model-cache\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.582882 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.582868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-tmp-dir\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.584933 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.584902    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-dshm\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.585235 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.585217    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-tls-certs\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.592759 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.592730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4j6q\" (UniqueName: \"kubernetes.io/projected/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-kube-api-access-r4j6q\") pod \"ipp-route-106097-kserve-77d6c9865f-mc7r6\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") " pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.671290 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.671204    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:28.811158 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:28.811126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"]
Jul 24 14:36:28.814581 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:36:28.814556    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod977bd24d_a41d_4a5b_b8cf_84b98d2366ae.slice/crio-9fef1c44851c5b51c4f13990ea68dec794f9c22234626981e6c63e64cbe2f6bf WatchSource:0}: Error finding container 9fef1c44851c5b51c4f13990ea68dec794f9c22234626981e6c63e64cbe2f6bf: Status 404 returned error can't find the container with id 9fef1c44851c5b51c4f13990ea68dec794f9c22234626981e6c63e64cbe2f6bf
Jul 24 14:36:29.426425 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:29.426390    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6" event={"ID":"977bd24d-a41d-4a5b-b8cf-84b98d2366ae","Type":"ContainerStarted","Data":"3a7bb6e35b83da2e06975f884747db852fedc2480536a91c313d60bf4212e25c"}
Jul 24 14:36:29.426813 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:29.426438    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6" event={"ID":"977bd24d-a41d-4a5b-b8cf-84b98d2366ae","Type":"ContainerStarted","Data":"9fef1c44851c5b51c4f13990ea68dec794f9c22234626981e6c63e64cbe2f6bf"}
Jul 24 14:36:29.443508 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:29.443459    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6" podStartSLOduration=1.44344038 podStartE2EDuration="1.44344038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:29.44321412 +0000 UTC m=+3097.678565484" watchObservedRunningTime="2026-07-24 14:36:29.44344038 +0000 UTC m=+3097.678791742"
Jul 24 14:36:32.149324 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:32.149287    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:36:38.671978 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:38.671932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:38.672413 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:38.671995    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:38.685013 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:38.684984    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:39.487607 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:39.487566    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:36:47.950484 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:36:47.950446    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:37:03.974149 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:03.974114    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"]
Jul 24 14:37:03.978705 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:03.978681    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:03.981344 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:03.981313    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-57f095-serving-cert\""
Jul 24 14:37:03.991671 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:03.991639    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"]
Jul 24 14:37:04.006775 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:04.006740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rds4t\" (UniqueName: \"kubernetes.io/projected/b976202c-44e9-4213-9971-b98c7955fd1a-kube-api-access-rds4t\") pod \"maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt\" (UID: \"b976202c-44e9-4213-9971-b98c7955fd1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:04.006949 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:04.006848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b976202c-44e9-4213-9971-b98c7955fd1a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt\" (UID: \"b976202c-44e9-4213-9971-b98c7955fd1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:04.006949 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:04.006876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b976202c-44e9-4213-9971-b98c7955fd1a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt\" (UID: \"b976202c-44e9-4213-9971-b98c7955fd1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:04.107565 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:04.107529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b976202c-44e9-4213-9971-b98c7955fd1a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt\" (UID: \"b976202c-44e9-4213-9971-b98c7955fd1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:04.107565 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:04.107571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b976202c-44e9-4213-9971-b98c7955fd1a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt\" (UID: \"b976202c-44e9-4213-9971-b98c7955fd1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:04.107820 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:04.107621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rds4t\" (UniqueName: \"kubernetes.io/projected/b976202c-44e9-4213-9971-b98c7955fd1a-kube-api-access-rds4t\") pod \"maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt\" (UID: \"b976202c-44e9-4213-9971-b98c7955fd1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:04.108399 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:04.108376    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b976202c-44e9-4213-9971-b98c7955fd1a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt\" (UID: \"b976202c-44e9-4213-9971-b98c7955fd1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:04.110372 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:04.110354    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b976202c-44e9-4213-9971-b98c7955fd1a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt\" (UID: \"b976202c-44e9-4213-9971-b98c7955fd1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:04.121714 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:04.121691    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rds4t\" (UniqueName: \"kubernetes.io/projected/b976202c-44e9-4213-9971-b98c7955fd1a-kube-api-access-rds4t\") pod \"maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt\" (UID: \"b976202c-44e9-4213-9971-b98c7955fd1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:04.289648 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:04.289550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:04.434779 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:04.434754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"]
Jul 24 14:37:04.437104 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:37:04.437069    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb976202c_44e9_4213_9971_b98c7955fd1a.slice/crio-54d33e3ab6cd4c4f4e51819e62657e6114857d87c3a4fcf24b2d7556d69ba041 WatchSource:0}: Error finding container 54d33e3ab6cd4c4f4e51819e62657e6114857d87c3a4fcf24b2d7556d69ba041: Status 404 returned error can't find the container with id 54d33e3ab6cd4c4f4e51819e62657e6114857d87c3a4fcf24b2d7556d69ba041
Jul 24 14:37:04.605361 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:04.605322    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt" event={"ID":"b976202c-44e9-4213-9971-b98c7955fd1a","Type":"ContainerStarted","Data":"54d33e3ab6cd4c4f4e51819e62657e6114857d87c3a4fcf24b2d7556d69ba041"}
Jul 24 14:37:05.612295 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:05.612244    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt" event={"ID":"b976202c-44e9-4213-9971-b98c7955fd1a","Type":"ContainerStarted","Data":"059d194e82bfd92af8522550b314fd36902ff2a1c947ab013e560c5003432f8b"}
Jul 24 14:37:05.612724 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:05.612402    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:05.641243 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:05.641192    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt" podStartSLOduration=2.154481118 podStartE2EDuration="2.641157648s" totalImagesPullingTime="486.67653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:05.640505331 +0000 UTC m=+3133.875856704" watchObservedRunningTime="2026-07-24 14:37:05.641157648 +0000 UTC m=+3133.876508988"
Jul 24 14:37:09.157494 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:09.157459    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:37:11.624323 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:11.624289    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:19.350058 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:19.350023    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq"]
Jul 24 14:37:19.354060 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:19.354036    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq"
Jul 24 14:37:19.356507 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:19.356486    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:37:19.361213 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:19.361166    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq"]
Jul 24 14:37:19.457696 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:19.457658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cb646a-fe98-413c-862d-157af5035c7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq\" (UID: \"a0cb646a-fe98-413c-862d-157af5035c7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq"
Jul 24 14:37:19.558415 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:19.558373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cb646a-fe98-413c-862d-157af5035c7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq\" (UID: \"a0cb646a-fe98-413c-862d-157af5035c7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq"
Jul 24 14:37:19.559312 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:19.559285    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cb646a-fe98-413c-862d-157af5035c7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq\" (UID: \"a0cb646a-fe98-413c-862d-157af5035c7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq"
Jul 24 14:37:19.668608 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:19.668509    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq"
Jul 24 14:37:19.812901 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:19.812870    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq"]
Jul 24 14:37:19.814797 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:37:19.814768    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0cb646a_fe98_413c_862d_157af5035c7b.slice/crio-874323dc4267e9861f7611ba63e1181448b526a952b6660b1ffaf9e2e77eef8f WatchSource:0}: Error finding container 874323dc4267e9861f7611ba63e1181448b526a952b6660b1ffaf9e2e77eef8f: Status 404 returned error can't find the container with id 874323dc4267e9861f7611ba63e1181448b526a952b6660b1ffaf9e2e77eef8f
Jul 24 14:37:20.692196 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:20.692136    2565 generic.go:356] "Generic (PLEG): container finished" podID="a0cb646a-fe98-413c-862d-157af5035c7b" containerID="3dc6c0ec2e751706fa7aa4868add0e33230157c4d4375de6d46ca1c048d42abe" exitCode=0
Jul 24 14:37:20.692585 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:20.692239    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq" event={"ID":"a0cb646a-fe98-413c-862d-157af5035c7b","Type":"ContainerDied","Data":"3dc6c0ec2e751706fa7aa4868add0e33230157c4d4375de6d46ca1c048d42abe"}
Jul 24 14:37:20.692585 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:20.692330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq" event={"ID":"a0cb646a-fe98-413c-862d-157af5035c7b","Type":"ContainerStarted","Data":"874323dc4267e9861f7611ba63e1181448b526a952b6660b1ffaf9e2e77eef8f"}
Jul 24 14:37:21.836566 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:21.836541    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq"
Jul 24 14:37:21.983044 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:21.982947    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cb646a-fe98-413c-862d-157af5035c7b-maas-api-service-ca\") pod \"a0cb646a-fe98-413c-862d-157af5035c7b\" (UID: \"a0cb646a-fe98-413c-862d-157af5035c7b\") "
Jul 24 14:37:21.983357 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:21.983332    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0cb646a-fe98-413c-862d-157af5035c7b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a0cb646a-fe98-413c-862d-157af5035c7b" (UID: "a0cb646a-fe98-413c-862d-157af5035c7b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:37:22.084305 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:22.084259    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cb646a-fe98-413c-862d-157af5035c7b-maas-api-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:37:22.703106 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:22.703068    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq"
Jul 24 14:37:22.703106 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:22.703098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq" event={"ID":"a0cb646a-fe98-413c-862d-157af5035c7b","Type":"ContainerDied","Data":"874323dc4267e9861f7611ba63e1181448b526a952b6660b1ffaf9e2e77eef8f"}
Jul 24 14:37:22.703347 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:22.703141    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="874323dc4267e9861f7611ba63e1181448b526a952b6660b1ffaf9e2e77eef8f"
Jul 24 14:37:29.886211 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:29.886142    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"]
Jul 24 14:37:29.886707 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:29.886399    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt" podUID="b976202c-44e9-4213-9971-b98c7955fd1a" containerName="maas-api" containerID="cri-o://059d194e82bfd92af8522550b314fd36902ff2a1c947ab013e560c5003432f8b" gracePeriod=30
Jul 24 14:37:30.134924 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.134898    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:30.259088 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.258990    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b976202c-44e9-4213-9971-b98c7955fd1a-maas-api-tls\") pod \"b976202c-44e9-4213-9971-b98c7955fd1a\" (UID: \"b976202c-44e9-4213-9971-b98c7955fd1a\") "
Jul 24 14:37:30.259290 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.259093    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rds4t\" (UniqueName: \"kubernetes.io/projected/b976202c-44e9-4213-9971-b98c7955fd1a-kube-api-access-rds4t\") pod \"b976202c-44e9-4213-9971-b98c7955fd1a\" (UID: \"b976202c-44e9-4213-9971-b98c7955fd1a\") "
Jul 24 14:37:30.259290 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.259211    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b976202c-44e9-4213-9971-b98c7955fd1a-openshift-service-ca\") pod \"b976202c-44e9-4213-9971-b98c7955fd1a\" (UID: \"b976202c-44e9-4213-9971-b98c7955fd1a\") "
Jul 24 14:37:30.259529 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.259508    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b976202c-44e9-4213-9971-b98c7955fd1a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b976202c-44e9-4213-9971-b98c7955fd1a" (UID: "b976202c-44e9-4213-9971-b98c7955fd1a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:37:30.261646 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.261613    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b976202c-44e9-4213-9971-b98c7955fd1a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b976202c-44e9-4213-9971-b98c7955fd1a" (UID: "b976202c-44e9-4213-9971-b98c7955fd1a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:37:30.261646 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.261630    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b976202c-44e9-4213-9971-b98c7955fd1a-kube-api-access-rds4t" (OuterVolumeSpecName: "kube-api-access-rds4t") pod "b976202c-44e9-4213-9971-b98c7955fd1a" (UID: "b976202c-44e9-4213-9971-b98c7955fd1a"). InnerVolumeSpecName "kube-api-access-rds4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:37:30.360053 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.360016    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rds4t\" (UniqueName: \"kubernetes.io/projected/b976202c-44e9-4213-9971-b98c7955fd1a-kube-api-access-rds4t\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:37:30.360053 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.360048    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b976202c-44e9-4213-9971-b98c7955fd1a-openshift-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:37:30.360053 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.360059    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b976202c-44e9-4213-9971-b98c7955fd1a-maas-api-tls\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:37:30.745688 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.745648    2565 generic.go:356] "Generic (PLEG): container finished" podID="b976202c-44e9-4213-9971-b98c7955fd1a" containerID="059d194e82bfd92af8522550b314fd36902ff2a1c947ab013e560c5003432f8b" exitCode=0
Jul 24 14:37:30.745907 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.745695    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"
Jul 24 14:37:30.745907 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.745734    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt" event={"ID":"b976202c-44e9-4213-9971-b98c7955fd1a","Type":"ContainerDied","Data":"059d194e82bfd92af8522550b314fd36902ff2a1c947ab013e560c5003432f8b"}
Jul 24 14:37:30.745907 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.745801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt" event={"ID":"b976202c-44e9-4213-9971-b98c7955fd1a","Type":"ContainerDied","Data":"54d33e3ab6cd4c4f4e51819e62657e6114857d87c3a4fcf24b2d7556d69ba041"}
Jul 24 14:37:30.745907 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.745830    2565 scope.go:117] "RemoveContainer" containerID="059d194e82bfd92af8522550b314fd36902ff2a1c947ab013e560c5003432f8b"
Jul 24 14:37:30.755898 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.755877    2565 scope.go:117] "RemoveContainer" containerID="059d194e82bfd92af8522550b314fd36902ff2a1c947ab013e560c5003432f8b"
Jul 24 14:37:30.756220 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:37:30.756199    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"059d194e82bfd92af8522550b314fd36902ff2a1c947ab013e560c5003432f8b\": container with ID starting with 059d194e82bfd92af8522550b314fd36902ff2a1c947ab013e560c5003432f8b not found: ID does not exist" containerID="059d194e82bfd92af8522550b314fd36902ff2a1c947ab013e560c5003432f8b"
Jul 24 14:37:30.756275 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.756230    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"059d194e82bfd92af8522550b314fd36902ff2a1c947ab013e560c5003432f8b"} err="failed to get container status \"059d194e82bfd92af8522550b314fd36902ff2a1c947ab013e560c5003432f8b\": rpc error: code = NotFound desc = could not find container \"059d194e82bfd92af8522550b314fd36902ff2a1c947ab013e560c5003432f8b\": container with ID starting with 059d194e82bfd92af8522550b314fd36902ff2a1c947ab013e560c5003432f8b not found: ID does not exist"
Jul 24 14:37:30.769693 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.769655    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"]
Jul 24 14:37:30.774235 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:30.774207    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-57f095-c6d698bcb-bqlkt"]
Jul 24 14:37:32.201406 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:32.201371    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b976202c-44e9-4213-9971-b98c7955fd1a" path="/var/lib/kubelet/pods/b976202c-44e9-4213-9971-b98c7955fd1a/volumes"
Jul 24 14:37:34.427457 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:34.427419    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq"]
Jul 24 14:37:34.429432 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:34.429409    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-57f095-8wsrq"]
Jul 24 14:37:36.195569 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:36.195535    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0cb646a-fe98-413c-862d-157af5035c7b" path="/var/lib/kubelet/pods/a0cb646a-fe98-413c-862d-157af5035c7b/volumes"
Jul 24 14:37:37.444022 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:37.443988    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:37:44.732915 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:44.732875    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8"]
Jul 24 14:37:44.733464 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:44.733450    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0cb646a-fe98-413c-862d-157af5035c7b" containerName="revoke-keys"
Jul 24 14:37:44.733536 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:44.733471    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0cb646a-fe98-413c-862d-157af5035c7b" containerName="revoke-keys"
Jul 24 14:37:44.733536 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:44.733487    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b976202c-44e9-4213-9971-b98c7955fd1a" containerName="maas-api"
Jul 24 14:37:44.733536 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:44.733496    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b976202c-44e9-4213-9971-b98c7955fd1a" containerName="maas-api"
Jul 24 14:37:44.733697 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:44.733590    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0cb646a-fe98-413c-862d-157af5035c7b" containerName="revoke-keys"
Jul 24 14:37:44.733697 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:44.733604    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b976202c-44e9-4213-9971-b98c7955fd1a" containerName="maas-api"
Jul 24 14:37:44.737744 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:44.737724    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8"
Jul 24 14:37:44.740569 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:44.740549    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:37:44.747909 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:44.747884    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8"]
Jul 24 14:37:44.788085 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:44.788050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/848f43b2-994d-41f9-bf9c-ec51c5ccae8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8\" (UID: \"848f43b2-994d-41f9-bf9c-ec51c5ccae8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8"
Jul 24 14:37:44.888975 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:44.888933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/848f43b2-994d-41f9-bf9c-ec51c5ccae8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8\" (UID: \"848f43b2-994d-41f9-bf9c-ec51c5ccae8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8"
Jul 24 14:37:44.889617 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:44.889597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/848f43b2-994d-41f9-bf9c-ec51c5ccae8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8\" (UID: \"848f43b2-994d-41f9-bf9c-ec51c5ccae8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8"
Jul 24 14:37:45.048865 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:45.048778    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8"
Jul 24 14:37:45.183732 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:45.183706    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8"]
Jul 24 14:37:45.185356 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:37:45.185326    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848f43b2_994d_41f9_bf9c_ec51c5ccae8c.slice/crio-7342909a413323cd9acddeed18958c9cf7a204dfe675982ddf2b5b728e717b49 WatchSource:0}: Error finding container 7342909a413323cd9acddeed18958c9cf7a204dfe675982ddf2b5b728e717b49: Status 404 returned error can't find the container with id 7342909a413323cd9acddeed18958c9cf7a204dfe675982ddf2b5b728e717b49
Jul 24 14:37:45.832387 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:45.832349    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8" event={"ID":"848f43b2-994d-41f9-bf9c-ec51c5ccae8c","Type":"ContainerStarted","Data":"ce0cc411c755faa7e5bbbffcd5004f50c25f3f628a1b8bb463dce0cfc916f54a"}
Jul 24 14:37:45.832687 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:45.832417    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8" event={"ID":"848f43b2-994d-41f9-bf9c-ec51c5ccae8c","Type":"ContainerStarted","Data":"7342909a413323cd9acddeed18958c9cf7a204dfe675982ddf2b5b728e717b49"}
Jul 24 14:37:45.848139 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:45.848088    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8" podStartSLOduration=1.84807033 podStartE2EDuration="1.84807033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:45.847217325 +0000 UTC m=+3174.082568683" watchObservedRunningTime="2026-07-24 14:37:45.84807033 +0000 UTC m=+3174.083421692"
Jul 24 14:37:46.838671 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:46.838637    2565 generic.go:356] "Generic (PLEG): container finished" podID="848f43b2-994d-41f9-bf9c-ec51c5ccae8c" containerID="ce0cc411c755faa7e5bbbffcd5004f50c25f3f628a1b8bb463dce0cfc916f54a" exitCode=0
Jul 24 14:37:46.839103 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:46.838730    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8" event={"ID":"848f43b2-994d-41f9-bf9c-ec51c5ccae8c","Type":"ContainerDied","Data":"ce0cc411c755faa7e5bbbffcd5004f50c25f3f628a1b8bb463dce0cfc916f54a"}
Jul 24 14:37:47.984013 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:47.983988    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8"
Jul 24 14:37:48.018907 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:48.018867    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/848f43b2-994d-41f9-bf9c-ec51c5ccae8c-maas-api-service-ca\") pod \"848f43b2-994d-41f9-bf9c-ec51c5ccae8c\" (UID: \"848f43b2-994d-41f9-bf9c-ec51c5ccae8c\") "
Jul 24 14:37:48.019305 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:48.019276    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/848f43b2-994d-41f9-bf9c-ec51c5ccae8c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "848f43b2-994d-41f9-bf9c-ec51c5ccae8c" (UID: "848f43b2-994d-41f9-bf9c-ec51c5ccae8c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:37:48.119877 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:48.119788    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/848f43b2-994d-41f9-bf9c-ec51c5ccae8c-maas-api-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:37:48.850632 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:48.850602    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8"
Jul 24 14:37:48.850811 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:48.850600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8" event={"ID":"848f43b2-994d-41f9-bf9c-ec51c5ccae8c","Type":"ContainerDied","Data":"7342909a413323cd9acddeed18958c9cf7a204dfe675982ddf2b5b728e717b49"}
Jul 24 14:37:48.850811 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:37:48.850733    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7342909a413323cd9acddeed18958c9cf7a204dfe675982ddf2b5b728e717b49"
Jul 24 14:38:01.345276 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:01.345235    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:38:04.806545 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:04.806501    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8"]
Jul 24 14:38:04.808035 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:04.808014    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-106097-t2sv8"]
Jul 24 14:38:06.194717 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:06.194683    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="848f43b2-994d-41f9-bf9c-ec51c5ccae8c" path="/var/lib/kubelet/pods/848f43b2-994d-41f9-bf9c-ec51c5ccae8c/volumes"
Jul 24 14:38:10.184661 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:10.184624    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"]
Jul 24 14:38:12.348846 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:12.348808    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:38:25.205198 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.205123    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6" podUID="977bd24d-a41d-4a5b-b8cf-84b98d2366ae" containerName="main" containerID="cri-o://3a7bb6e35b83da2e06975f884747db852fedc2480536a91c313d60bf4212e25c" gracePeriod=45
Jul 24 14:38:25.462342 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.462266    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:38:25.573586 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.573549    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-dshm\") pod \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") "
Jul 24 14:38:25.573807 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.573607    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-model-cache\") pod \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") "
Jul 24 14:38:25.573807 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.573653    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-tmp-dir\") pod \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") "
Jul 24 14:38:25.573807 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.573675    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-home\") pod \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") "
Jul 24 14:38:25.573807 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.573767    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4j6q\" (UniqueName: \"kubernetes.io/projected/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-kube-api-access-r4j6q\") pod \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") "
Jul 24 14:38:25.573807 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.573803    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-tls-certs\") pod \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\" (UID: \"977bd24d-a41d-4a5b-b8cf-84b98d2366ae\") "
Jul 24 14:38:25.574073 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.573939    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-model-cache" (OuterVolumeSpecName: "model-cache") pod "977bd24d-a41d-4a5b-b8cf-84b98d2366ae" (UID: "977bd24d-a41d-4a5b-b8cf-84b98d2366ae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:38:25.574073 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.573957    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "977bd24d-a41d-4a5b-b8cf-84b98d2366ae" (UID: "977bd24d-a41d-4a5b-b8cf-84b98d2366ae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:38:25.574073 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.573991    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-home" (OuterVolumeSpecName: "home") pod "977bd24d-a41d-4a5b-b8cf-84b98d2366ae" (UID: "977bd24d-a41d-4a5b-b8cf-84b98d2366ae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:38:25.574221 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.574161    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-model-cache\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:38:25.574221 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.574199    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-tmp-dir\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:38:25.574221 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.574211    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-home\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:38:25.576048 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.576018    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-dshm" (OuterVolumeSpecName: "dshm") pod "977bd24d-a41d-4a5b-b8cf-84b98d2366ae" (UID: "977bd24d-a41d-4a5b-b8cf-84b98d2366ae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:38:25.576158 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.576125    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "977bd24d-a41d-4a5b-b8cf-84b98d2366ae" (UID: "977bd24d-a41d-4a5b-b8cf-84b98d2366ae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:38:25.576253 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.576235    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-kube-api-access-r4j6q" (OuterVolumeSpecName: "kube-api-access-r4j6q") pod "977bd24d-a41d-4a5b-b8cf-84b98d2366ae" (UID: "977bd24d-a41d-4a5b-b8cf-84b98d2366ae"). InnerVolumeSpecName "kube-api-access-r4j6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:38:25.675447 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.675405    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4j6q\" (UniqueName: \"kubernetes.io/projected/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-kube-api-access-r4j6q\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:38:25.675447 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.675438    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-tls-certs\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:38:25.675447 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:25.675449    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/977bd24d-a41d-4a5b-b8cf-84b98d2366ae-dshm\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:38:26.037566 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:26.037526    2565 generic.go:356] "Generic (PLEG): container finished" podID="977bd24d-a41d-4a5b-b8cf-84b98d2366ae" containerID="3a7bb6e35b83da2e06975f884747db852fedc2480536a91c313d60bf4212e25c" exitCode=0
Jul 24 14:38:26.037757 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:26.037577    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"
Jul 24 14:38:26.037757 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:26.037616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6" event={"ID":"977bd24d-a41d-4a5b-b8cf-84b98d2366ae","Type":"ContainerDied","Data":"3a7bb6e35b83da2e06975f884747db852fedc2480536a91c313d60bf4212e25c"}
Jul 24 14:38:26.037757 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:26.037658    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6" event={"ID":"977bd24d-a41d-4a5b-b8cf-84b98d2366ae","Type":"ContainerDied","Data":"9fef1c44851c5b51c4f13990ea68dec794f9c22234626981e6c63e64cbe2f6bf"}
Jul 24 14:38:26.037757 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:26.037678    2565 scope.go:117] "RemoveContainer" containerID="3a7bb6e35b83da2e06975f884747db852fedc2480536a91c313d60bf4212e25c"
Jul 24 14:38:26.047269 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:26.047244    2565 scope.go:117] "RemoveContainer" containerID="3a7bb6e35b83da2e06975f884747db852fedc2480536a91c313d60bf4212e25c"
Jul 24 14:38:26.047616 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:38:26.047599    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a7bb6e35b83da2e06975f884747db852fedc2480536a91c313d60bf4212e25c\": container with ID starting with 3a7bb6e35b83da2e06975f884747db852fedc2480536a91c313d60bf4212e25c not found: ID does not exist" containerID="3a7bb6e35b83da2e06975f884747db852fedc2480536a91c313d60bf4212e25c"
Jul 24 14:38:26.047661 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:26.047626    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a7bb6e35b83da2e06975f884747db852fedc2480536a91c313d60bf4212e25c"} err="failed to get container status \"3a7bb6e35b83da2e06975f884747db852fedc2480536a91c313d60bf4212e25c\": rpc error: code = NotFound desc = could not find container \"3a7bb6e35b83da2e06975f884747db852fedc2480536a91c313d60bf4212e25c\": container with ID starting with 3a7bb6e35b83da2e06975f884747db852fedc2480536a91c313d60bf4212e25c not found: ID does not exist"
Jul 24 14:38:26.061684 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:26.061651    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"]
Jul 24 14:38:26.067221 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:26.067194    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-106097/ipp-route-106097-kserve-77d6c9865f-mc7r6"]
Jul 24 14:38:26.195328 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:26.195297    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="977bd24d-a41d-4a5b-b8cf-84b98d2366ae" path="/var/lib/kubelet/pods/977bd24d-a41d-4a5b-b8cf-84b98d2366ae/volumes"
Jul 24 14:38:59.614736 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:59.614704    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv"]
Jul 24 14:38:59.615259 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:59.615063    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="848f43b2-994d-41f9-bf9c-ec51c5ccae8c" containerName="revoke-keys"
Jul 24 14:38:59.615259 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:59.615074    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="848f43b2-994d-41f9-bf9c-ec51c5ccae8c" containerName="revoke-keys"
Jul 24 14:38:59.615259 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:59.615098    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="977bd24d-a41d-4a5b-b8cf-84b98d2366ae" containerName="main"
Jul 24 14:38:59.615259 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:59.615105    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="977bd24d-a41d-4a5b-b8cf-84b98d2366ae" containerName="main"
Jul 24 14:38:59.615259 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:59.615186    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="848f43b2-994d-41f9-bf9c-ec51c5ccae8c" containerName="revoke-keys"
Jul 24 14:38:59.615259 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:59.615195    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="977bd24d-a41d-4a5b-b8cf-84b98d2366ae" containerName="main"
Jul 24 14:38:59.619578 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:59.619554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv"
Jul 24 14:38:59.622132 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:59.622106    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:38:59.627258 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:59.627226    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv"]
Jul 24 14:38:59.692633 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:59.692579    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d24334b6-d537-4825-b664-92f36b8a5448-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv\" (UID: \"d24334b6-d537-4825-b664-92f36b8a5448\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv"
Jul 24 14:38:59.793656 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:59.793614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d24334b6-d537-4825-b664-92f36b8a5448-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv\" (UID: \"d24334b6-d537-4825-b664-92f36b8a5448\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv"
Jul 24 14:38:59.794297 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:59.794276    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d24334b6-d537-4825-b664-92f36b8a5448-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv\" (UID: \"d24334b6-d537-4825-b664-92f36b8a5448\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv"
Jul 24 14:38:59.933207 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:38:59.933081    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv"
Jul 24 14:39:00.076417 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:00.076394    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv"]
Jul 24 14:39:00.077764 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:39:00.077735    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd24334b6_d537_4825_b664_92f36b8a5448.slice/crio-2f0adc2d7b6b4043a625773a0c6c92307b8bd0232b4eb685a5f954ef6d6e7371 WatchSource:0}: Error finding container 2f0adc2d7b6b4043a625773a0c6c92307b8bd0232b4eb685a5f954ef6d6e7371: Status 404 returned error can't find the container with id 2f0adc2d7b6b4043a625773a0c6c92307b8bd0232b4eb685a5f954ef6d6e7371
Jul 24 14:39:00.225959 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:00.225859    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv" event={"ID":"d24334b6-d537-4825-b664-92f36b8a5448","Type":"ContainerStarted","Data":"2f0adc2d7b6b4043a625773a0c6c92307b8bd0232b4eb685a5f954ef6d6e7371"}
Jul 24 14:39:01.233482 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:01.233445    2565 generic.go:356] "Generic (PLEG): container finished" podID="d24334b6-d537-4825-b664-92f36b8a5448" containerID="9e1c3c32fdebbdc4c9ba7d9fc46693f2dbaf959713ba479186641e6a61900cb8" exitCode=0
Jul 24 14:39:01.234088 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:01.233495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv" event={"ID":"d24334b6-d537-4825-b664-92f36b8a5448","Type":"ContainerDied","Data":"9e1c3c32fdebbdc4c9ba7d9fc46693f2dbaf959713ba479186641e6a61900cb8"}
Jul 24 14:39:02.379816 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:02.379790    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv"
Jul 24 14:39:02.419441 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:02.419402    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d24334b6-d537-4825-b664-92f36b8a5448-maas-api-service-ca\") pod \"d24334b6-d537-4825-b664-92f36b8a5448\" (UID: \"d24334b6-d537-4825-b664-92f36b8a5448\") "
Jul 24 14:39:02.419804 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:02.419776    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d24334b6-d537-4825-b664-92f36b8a5448-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d24334b6-d537-4825-b664-92f36b8a5448" (UID: "d24334b6-d537-4825-b664-92f36b8a5448"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:39:02.520347 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:02.520255    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d24334b6-d537-4825-b664-92f36b8a5448-maas-api-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:39:03.244080 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:03.244053    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv"
Jul 24 14:39:03.244080 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:03.244062    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv" event={"ID":"d24334b6-d537-4825-b664-92f36b8a5448","Type":"ContainerDied","Data":"2f0adc2d7b6b4043a625773a0c6c92307b8bd0232b4eb685a5f954ef6d6e7371"}
Jul 24 14:39:03.244324 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:03.244107    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f0adc2d7b6b4043a625773a0c6c92307b8bd0232b4eb685a5f954ef6d6e7371"
Jul 24 14:39:10.199395 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:10.199347    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"]
Jul 24 14:39:10.199865 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:10.199586    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29" podUID="ad47c729-cfc7-435b-94a4-87c9b542306c" containerName="maas-api" containerID="cri-o://bb2593a6e38f4eb32b50309d55cf57fd8e190a2da4b1578e1db50ad9c867f753" gracePeriod=30
Jul 24 14:39:10.456409 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:10.456342    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:39:10.595805 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:10.595762    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad47c729-cfc7-435b-94a4-87c9b542306c-openshift-service-ca\") pod \"ad47c729-cfc7-435b-94a4-87c9b542306c\" (UID: \"ad47c729-cfc7-435b-94a4-87c9b542306c\") "
Jul 24 14:39:10.595805 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:10.595809    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptwtv\" (UniqueName: \"kubernetes.io/projected/ad47c729-cfc7-435b-94a4-87c9b542306c-kube-api-access-ptwtv\") pod \"ad47c729-cfc7-435b-94a4-87c9b542306c\" (UID: \"ad47c729-cfc7-435b-94a4-87c9b542306c\") "
Jul 24 14:39:10.596064 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:10.595924    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad47c729-cfc7-435b-94a4-87c9b542306c-maas-api-tls\") pod \"ad47c729-cfc7-435b-94a4-87c9b542306c\" (UID: \"ad47c729-cfc7-435b-94a4-87c9b542306c\") "
Jul 24 14:39:10.596288 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:10.596261    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad47c729-cfc7-435b-94a4-87c9b542306c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad47c729-cfc7-435b-94a4-87c9b542306c" (UID: "ad47c729-cfc7-435b-94a4-87c9b542306c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:39:10.598251 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:10.598218    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad47c729-cfc7-435b-94a4-87c9b542306c-kube-api-access-ptwtv" (OuterVolumeSpecName: "kube-api-access-ptwtv") pod "ad47c729-cfc7-435b-94a4-87c9b542306c" (UID: "ad47c729-cfc7-435b-94a4-87c9b542306c"). InnerVolumeSpecName "kube-api-access-ptwtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:39:10.598362 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:10.598320    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad47c729-cfc7-435b-94a4-87c9b542306c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad47c729-cfc7-435b-94a4-87c9b542306c" (UID: "ad47c729-cfc7-435b-94a4-87c9b542306c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:39:10.696934 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:10.696888    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad47c729-cfc7-435b-94a4-87c9b542306c-openshift-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:39:10.696934 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:10.696926    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptwtv\" (UniqueName: \"kubernetes.io/projected/ad47c729-cfc7-435b-94a4-87c9b542306c-kube-api-access-ptwtv\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:39:10.696934 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:10.696940    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad47c729-cfc7-435b-94a4-87c9b542306c-maas-api-tls\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:39:11.287658 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:11.287621    2565 generic.go:356] "Generic (PLEG): container finished" podID="ad47c729-cfc7-435b-94a4-87c9b542306c" containerID="bb2593a6e38f4eb32b50309d55cf57fd8e190a2da4b1578e1db50ad9c867f753" exitCode=0
Jul 24 14:39:11.287658 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:11.287661    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"
Jul 24 14:39:11.288156 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:11.287741    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29" event={"ID":"ad47c729-cfc7-435b-94a4-87c9b542306c","Type":"ContainerDied","Data":"bb2593a6e38f4eb32b50309d55cf57fd8e190a2da4b1578e1db50ad9c867f753"}
Jul 24 14:39:11.288156 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:11.287804    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29" event={"ID":"ad47c729-cfc7-435b-94a4-87c9b542306c","Type":"ContainerDied","Data":"80c323a4f4e0e400684cedc66cc4c00cbdee53f9c52407ce51753657fea9e5a6"}
Jul 24 14:39:11.288156 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:11.287834    2565 scope.go:117] "RemoveContainer" containerID="bb2593a6e38f4eb32b50309d55cf57fd8e190a2da4b1578e1db50ad9c867f753"
Jul 24 14:39:11.297680 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:11.297661    2565 scope.go:117] "RemoveContainer" containerID="bb2593a6e38f4eb32b50309d55cf57fd8e190a2da4b1578e1db50ad9c867f753"
Jul 24 14:39:11.297991 ip-10-0-132-200 kubenswrapper[2565]: E0724 14:39:11.297970    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb2593a6e38f4eb32b50309d55cf57fd8e190a2da4b1578e1db50ad9c867f753\": container with ID starting with bb2593a6e38f4eb32b50309d55cf57fd8e190a2da4b1578e1db50ad9c867f753 not found: ID does not exist" containerID="bb2593a6e38f4eb32b50309d55cf57fd8e190a2da4b1578e1db50ad9c867f753"
Jul 24 14:39:11.298058 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:11.298005    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb2593a6e38f4eb32b50309d55cf57fd8e190a2da4b1578e1db50ad9c867f753"} err="failed to get container status \"bb2593a6e38f4eb32b50309d55cf57fd8e190a2da4b1578e1db50ad9c867f753\": rpc error: code = NotFound desc = could not find container \"bb2593a6e38f4eb32b50309d55cf57fd8e190a2da4b1578e1db50ad9c867f753\": container with ID starting with bb2593a6e38f4eb32b50309d55cf57fd8e190a2da4b1578e1db50ad9c867f753 not found: ID does not exist"
Jul 24 14:39:11.310033 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:11.310004    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"]
Jul 24 14:39:11.313413 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:11.313384    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fde43a-65cf746bc7-jll29"]
Jul 24 14:39:12.196779 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:12.196744    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad47c729-cfc7-435b-94a4-87c9b542306c" path="/var/lib/kubelet/pods/ad47c729-cfc7-435b-94a4-87c9b542306c/volumes"
Jul 24 14:39:13.547510 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:13.547471    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:39:14.688524 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:14.688477    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv"]
Jul 24 14:39:14.690084 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:14.690061    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fde43a-46nlv"]
Jul 24 14:39:16.195688 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:16.195648    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d24334b6-d537-4825-b664-92f36b8a5448" path="/var/lib/kubelet/pods/d24334b6-d537-4825-b664-92f36b8a5448/volumes"
Jul 24 14:39:21.496663 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.496627    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4"]
Jul 24 14:39:21.497063 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.496987    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad47c729-cfc7-435b-94a4-87c9b542306c" containerName="maas-api"
Jul 24 14:39:21.497063 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.496998    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad47c729-cfc7-435b-94a4-87c9b542306c" containerName="maas-api"
Jul 24 14:39:21.497063 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.497019    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d24334b6-d537-4825-b664-92f36b8a5448" containerName="revoke-keys"
Jul 24 14:39:21.497063 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.497025    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d24334b6-d537-4825-b664-92f36b8a5448" containerName="revoke-keys"
Jul 24 14:39:21.497206 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.497080    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d24334b6-d537-4825-b664-92f36b8a5448" containerName="revoke-keys"
Jul 24 14:39:21.497206 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.497089    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad47c729-cfc7-435b-94a4-87c9b542306c" containerName="maas-api"
Jul 24 14:39:21.501384 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.501363    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4"
Jul 24 14:39:21.503883 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.503867    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:39:21.503968 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.503870    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 14:39:21.510072 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.509708    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4"]
Jul 24 14:39:21.600489 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.600441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf9a635-2eb6-41cc-a8ca-7d60a58c55db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4\" (UID: \"acf9a635-2eb6-41cc-a8ca-7d60a58c55db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4"
Jul 24 14:39:21.701397 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.701356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf9a635-2eb6-41cc-a8ca-7d60a58c55db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4\" (UID: \"acf9a635-2eb6-41cc-a8ca-7d60a58c55db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4"
Jul 24 14:39:21.702009 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.701987    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf9a635-2eb6-41cc-a8ca-7d60a58c55db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4\" (UID: \"acf9a635-2eb6-41cc-a8ca-7d60a58c55db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4"
Jul 24 14:39:21.813756 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.813720    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4"
Jul 24 14:39:21.957085 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:21.957050    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4"]
Jul 24 14:39:21.960459 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:39:21.960414    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf9a635_2eb6_41cc_a8ca_7d60a58c55db.slice/crio-d19c15f9381ccb4635caac17add82a5913c8163e5870ddb74af199c05a5ea5a8 WatchSource:0}: Error finding container d19c15f9381ccb4635caac17add82a5913c8163e5870ddb74af199c05a5ea5a8: Status 404 returned error can't find the container with id d19c15f9381ccb4635caac17add82a5913c8163e5870ddb74af199c05a5ea5a8
Jul 24 14:39:22.346437 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:22.346395    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4" event={"ID":"acf9a635-2eb6-41cc-a8ca-7d60a58c55db","Type":"ContainerStarted","Data":"73ea1ca87f9a5f4b1e90a67ba5e50b9a1a97cd6387634d0c8645e7c769417adf"}
Jul 24 14:39:22.346650 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:22.346454    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4" event={"ID":"acf9a635-2eb6-41cc-a8ca-7d60a58c55db","Type":"ContainerStarted","Data":"d19c15f9381ccb4635caac17add82a5913c8163e5870ddb74af199c05a5ea5a8"}
Jul 24 14:39:22.364032 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:22.363979    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4" podStartSLOduration=1.363959828 podStartE2EDuration="1.363959828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:39:22.361216065 +0000 UTC m=+3270.596567427" watchObservedRunningTime="2026-07-24 14:39:22.363959828 +0000 UTC m=+3270.599311190"
Jul 24 14:39:23.354599 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:23.354559    2565 generic.go:356] "Generic (PLEG): container finished" podID="acf9a635-2eb6-41cc-a8ca-7d60a58c55db" containerID="73ea1ca87f9a5f4b1e90a67ba5e50b9a1a97cd6387634d0c8645e7c769417adf" exitCode=0
Jul 24 14:39:23.355078 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:23.354628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4" event={"ID":"acf9a635-2eb6-41cc-a8ca-7d60a58c55db","Type":"ContainerDied","Data":"73ea1ca87f9a5f4b1e90a67ba5e50b9a1a97cd6387634d0c8645e7c769417adf"}
Jul 24 14:39:24.497933 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:24.497898    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4"
Jul 24 14:39:24.628238 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:24.628105    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf9a635-2eb6-41cc-a8ca-7d60a58c55db-maas-api-service-ca\") pod \"acf9a635-2eb6-41cc-a8ca-7d60a58c55db\" (UID: \"acf9a635-2eb6-41cc-a8ca-7d60a58c55db\") "
Jul 24 14:39:24.628512 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:24.628485    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acf9a635-2eb6-41cc-a8ca-7d60a58c55db-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "acf9a635-2eb6-41cc-a8ca-7d60a58c55db" (UID: "acf9a635-2eb6-41cc-a8ca-7d60a58c55db"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:39:24.729392 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:24.729351    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf9a635-2eb6-41cc-a8ca-7d60a58c55db-maas-api-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:39:25.366294 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:25.366265    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4"
Jul 24 14:39:25.366468 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:25.366259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4" event={"ID":"acf9a635-2eb6-41cc-a8ca-7d60a58c55db","Type":"ContainerDied","Data":"d19c15f9381ccb4635caac17add82a5913c8163e5870ddb74af199c05a5ea5a8"}
Jul 24 14:39:25.366468 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:25.366388    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d19c15f9381ccb4635caac17add82a5913c8163e5870ddb74af199c05a5ea5a8"
Jul 24 14:39:35.247613 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:35.247574    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:39:36.572091 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:36.572044    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4"]
Jul 24 14:39:36.578785 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:36.578745    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94af13-lsfc4"]
Jul 24 14:39:38.195290 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:38.195255    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acf9a635-2eb6-41cc-a8ca-7d60a58c55db" path="/var/lib/kubelet/pods/acf9a635-2eb6-41cc-a8ca-7d60a58c55db/volumes"
Jul 24 14:39:43.676819 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:43.676779    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n"]
Jul 24 14:39:43.677243 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:43.677142    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acf9a635-2eb6-41cc-a8ca-7d60a58c55db" containerName="revoke-keys"
Jul 24 14:39:43.677243 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:43.677153    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf9a635-2eb6-41cc-a8ca-7d60a58c55db" containerName="revoke-keys"
Jul 24 14:39:43.677243 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:43.677228    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="acf9a635-2eb6-41cc-a8ca-7d60a58c55db" containerName="revoke-keys"
Jul 24 14:39:43.680863 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:43.680844    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n"
Jul 24 14:39:43.683549 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:43.683520    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 14:39:43.683549 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:43.683540    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w9gn7\""
Jul 24 14:39:43.688647 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:43.688365    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n"]
Jul 24 14:39:43.690694 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:43.690669    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f9ae57-c616-4c3c-8a05-f8782ed98c97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-938af8-szc2n\" (UID: \"d4f9ae57-c616-4c3c-8a05-f8782ed98c97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n"
Jul 24 14:39:43.791582 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:43.791535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f9ae57-c616-4c3c-8a05-f8782ed98c97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-938af8-szc2n\" (UID: \"d4f9ae57-c616-4c3c-8a05-f8782ed98c97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n"
Jul 24 14:39:43.792207 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:43.792157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f9ae57-c616-4c3c-8a05-f8782ed98c97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-938af8-szc2n\" (UID: \"d4f9ae57-c616-4c3c-8a05-f8782ed98c97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n"
Jul 24 14:39:43.993017 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:43.992922    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n"
Jul 24 14:39:44.132341 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:44.132315    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n"]
Jul 24 14:39:44.134627 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:39:44.134601    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f9ae57_c616_4c3c_8a05_f8782ed98c97.slice/crio-c0c07f668b2dc54fda9d47939112f6d6ef77cb0db18df31afa597bfb6571da49 WatchSource:0}: Error finding container c0c07f668b2dc54fda9d47939112f6d6ef77cb0db18df31afa597bfb6571da49: Status 404 returned error can't find the container with id c0c07f668b2dc54fda9d47939112f6d6ef77cb0db18df31afa597bfb6571da49
Jul 24 14:39:44.466214 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:44.466164    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n" event={"ID":"d4f9ae57-c616-4c3c-8a05-f8782ed98c97","Type":"ContainerStarted","Data":"fbefb79b6ce3373c65f181644392505c2d104b24cc60f650da7279ea93fddfba"}
Jul 24 14:39:44.466418 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:44.466241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n" event={"ID":"d4f9ae57-c616-4c3c-8a05-f8782ed98c97","Type":"ContainerStarted","Data":"c0c07f668b2dc54fda9d47939112f6d6ef77cb0db18df31afa597bfb6571da49"}
Jul 24 14:39:44.485141 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:44.485086    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n" podStartSLOduration=1.485070163 podStartE2EDuration="1.485070163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:39:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:39:44.483357158 +0000 UTC m=+3292.718708519" watchObservedRunningTime="2026-07-24 14:39:44.485070163 +0000 UTC m=+3292.720421524"
Jul 24 14:39:45.472443 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:45.472404    2565 generic.go:356] "Generic (PLEG): container finished" podID="d4f9ae57-c616-4c3c-8a05-f8782ed98c97" containerID="fbefb79b6ce3373c65f181644392505c2d104b24cc60f650da7279ea93fddfba" exitCode=0
Jul 24 14:39:45.472846 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:45.472485    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n" event={"ID":"d4f9ae57-c616-4c3c-8a05-f8782ed98c97","Type":"ContainerDied","Data":"fbefb79b6ce3373c65f181644392505c2d104b24cc60f650da7279ea93fddfba"}
Jul 24 14:39:46.612587 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:46.612554    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n"
Jul 24 14:39:46.718575 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:46.718530    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f9ae57-c616-4c3c-8a05-f8782ed98c97-maas-api-service-ca\") pod \"d4f9ae57-c616-4c3c-8a05-f8782ed98c97\" (UID: \"d4f9ae57-c616-4c3c-8a05-f8782ed98c97\") "
Jul 24 14:39:46.718919 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:46.718894    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f9ae57-c616-4c3c-8a05-f8782ed98c97-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d4f9ae57-c616-4c3c-8a05-f8782ed98c97" (UID: "d4f9ae57-c616-4c3c-8a05-f8782ed98c97"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:39:46.819340 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:46.819306    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f9ae57-c616-4c3c-8a05-f8782ed98c97-maas-api-service-ca\") on node \"ip-10-0-132-200.ec2.internal\" DevicePath \"\""
Jul 24 14:39:47.483640 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:47.483615    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n"
Jul 24 14:39:47.483850 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:47.483662    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n" event={"ID":"d4f9ae57-c616-4c3c-8a05-f8782ed98c97","Type":"ContainerDied","Data":"c0c07f668b2dc54fda9d47939112f6d6ef77cb0db18df31afa597bfb6571da49"}
Jul 24 14:39:47.483850 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:47.483712    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0c07f668b2dc54fda9d47939112f6d6ef77cb0db18df31afa597bfb6571da49"
Jul 24 14:39:52.428484 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:52.428451    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:39:52.437700 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:52.437674    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:39:54.281039 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:54.281000    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-938af8-29748390-nrbg4"]
Jul 24 14:39:54.290049 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:54.284622    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-938af8-29748390-nrbg4"]
Jul 24 14:39:56.195289 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:56.195251    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9265561-0bd3-4567-9bf7-55af5c0d5b3d" path="/var/lib/kubelet/pods/f9265561-0bd3-4567-9bf7-55af5c0d5b3d/volumes"
Jul 24 14:39:57.042647 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:57.042610    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8mw6"]
Jul 24 14:39:58.757573 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:58.757534    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n"]
Jul 24 14:39:58.760001 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:39:58.759973    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-938af8-szc2n"]
Jul 24 14:40:00.195018 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:00.194968    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4f9ae57-c616-4c3c-8a05-f8782ed98c97" path="/var/lib/kubelet/pods/d4f9ae57-c616-4c3c-8a05-f8782ed98c97/volumes"
Jul 24 14:40:12.357902 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:12.357869    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c_e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6/copy-manifests/0.log"
Jul 24 14:40:12.371065 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:12.371032    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c_e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6/manager/0.log"
Jul 24 14:40:13.349397 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:13.349365    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748390-nps29_f479de47-5864-426d-9f73-9b79e0346b93/cleanup/0.log"
Jul 24 14:40:15.564161 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:15.564124    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-m8mw6_09c12881-7166-4bf5-a0fb-ccdf74441675/limitador/0.log"
Jul 24 14:40:15.688637 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:15.688601    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-px5lk_75b1c394-47cb-4b23-99c9-0ee39f528949/manager/0.log"
Jul 24 14:40:16.278314 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:16.278283    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dc46bdfb5-94swf_f9c9e5a1-9bc4-45bb-9780-bfef75c77f88/kube-auth-proxy/0.log"
Jul 24 14:40:16.883574 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:16.883533    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c6777bc7-kmtdh_419e2dcc-9848-46b9-a353-00ff6d78be07/router/0.log"
Jul 24 14:40:17.752147 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:17.752114    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-mqrv4_ef9828da-317a-4cfb-9312-cacb9b5f6867/main/0.log"
Jul 24 14:40:17.873321 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:17.873288    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-vxbl2_7c8d8313-d5e9-48c3-a9c8-d7db668a05d1/main/0.log"
Jul 24 14:40:26.020445 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:26.020417    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j2hpq_57dfab3c-f8a9-4e6f-b953-6bfd7036ded0/global-pull-secret-syncer/0.log"
Jul 24 14:40:26.230310 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:26.230278    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v2vhl_eca23889-1269-4438-a4a6-6f6b81b08dbc/konnectivity-agent/0.log"
Jul 24 14:40:26.277446 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:26.277362    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-200.ec2.internal_3e716dbf694181dd98fd7be7ff31819b/haproxy/0.log"
Jul 24 14:40:31.317920 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:31.317883    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-m8mw6_09c12881-7166-4bf5-a0fb-ccdf74441675/limitador/0.log"
Jul 24 14:40:31.397091 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:31.397059    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-px5lk_75b1c394-47cb-4b23-99c9-0ee39f528949/manager/0.log"
Jul 24 14:40:33.181788 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.181749    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-c65s8_fd0443ae-eb84-4f00-b367-10c51e5813fe/kube-state-metrics/0.log"
Jul 24 14:40:33.203312 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.203272    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-c65s8_fd0443ae-eb84-4f00-b367-10c51e5813fe/kube-rbac-proxy-main/0.log"
Jul 24 14:40:33.226141 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.226112    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-c65s8_fd0443ae-eb84-4f00-b367-10c51e5813fe/kube-rbac-proxy-self/0.log"
Jul 24 14:40:33.288807 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.288779    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-slpb2_d62201f7-3c1b-4400-83c0-28878f34dcf5/monitoring-plugin/0.log"
Jul 24 14:40:33.496823 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.496740    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fb6fn_a1b01660-8f01-48b8-b204-596da3d8c289/node-exporter/0.log"
Jul 24 14:40:33.520193 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.520145    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fb6fn_a1b01660-8f01-48b8-b204-596da3d8c289/kube-rbac-proxy/0.log"
Jul 24 14:40:33.549392 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.549361    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fb6fn_a1b01660-8f01-48b8-b204-596da3d8c289/init-textfile/0.log"
Jul 24 14:40:33.582447 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.582422    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-lrsnt_d53546a5-4dd7-4f90-83af-fe0dbc6aeae7/kube-rbac-proxy-main/0.log"
Jul 24 14:40:33.616400 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.616367    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-lrsnt_d53546a5-4dd7-4f90-83af-fe0dbc6aeae7/kube-rbac-proxy-self/0.log"
Jul 24 14:40:33.638370 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.638339    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-lrsnt_d53546a5-4dd7-4f90-83af-fe0dbc6aeae7/openshift-state-metrics/0.log"
Jul 24 14:40:33.691047 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.691015    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0cfe2328-3765-459e-b3e3-5a4ccf1f4332/prometheus/0.log"
Jul 24 14:40:33.716205 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.716159    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0cfe2328-3765-459e-b3e3-5a4ccf1f4332/config-reloader/0.log"
Jul 24 14:40:33.742430 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.742400    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0cfe2328-3765-459e-b3e3-5a4ccf1f4332/thanos-sidecar/0.log"
Jul 24 14:40:33.768000 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.767926    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0cfe2328-3765-459e-b3e3-5a4ccf1f4332/kube-rbac-proxy-web/0.log"
Jul 24 14:40:33.792125 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.792101    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0cfe2328-3765-459e-b3e3-5a4ccf1f4332/kube-rbac-proxy/0.log"
Jul 24 14:40:33.818675 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.818650    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0cfe2328-3765-459e-b3e3-5a4ccf1f4332/kube-rbac-proxy-thanos/0.log"
Jul 24 14:40:33.842297 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.842274    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0cfe2328-3765-459e-b3e3-5a4ccf1f4332/init-config-reloader/0.log"
Jul 24 14:40:33.872821 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.872794    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-v7dnp_27d91672-602e-4979-b9a4-73af74fa8820/prometheus-operator/0.log"
Jul 24 14:40:33.896784 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.896750    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-v7dnp_27d91672-602e-4979-b9a4-73af74fa8820/kube-rbac-proxy/0.log"
Jul 24 14:40:33.922319 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:33.922288    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-wzk5d_648b234f-3b14-412a-86a6-c53eae54e36f/prometheus-operator-admission-webhook/0.log"
Jul 24 14:40:35.651390 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:35.651354    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-mm49r_f1fcef7a-6518-4fc3-89c0-201e2d08b506/networking-console-plugin/0.log"
Jul 24 14:40:36.310621 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.310569    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/2.log"
Jul 24 14:40:36.315034 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.315009    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-tpj42_0f6021e5-db06-4a65-9008-8515a852ba0f/console-operator/3.log"
Jul 24 14:40:36.646794 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.646713    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"]
Jul 24 14:40:36.647106 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.647092    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f9ae57-c616-4c3c-8a05-f8782ed98c97" containerName="revoke-keys"
Jul 24 14:40:36.647155 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.647109    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f9ae57-c616-4c3c-8a05-f8782ed98c97" containerName="revoke-keys"
Jul 24 14:40:36.647207 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.647190    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f9ae57-c616-4c3c-8a05-f8782ed98c97" containerName="revoke-keys"
Jul 24 14:40:36.650390 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.650371    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.654264 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.654232    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mmxsf\"/\"openshift-service-ca.crt\""
Jul 24 14:40:36.654264 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.654244    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mmxsf\"/\"kube-root-ca.crt\""
Jul 24 14:40:36.655340 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.655323    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mmxsf\"/\"default-dockercfg-jjn97\""
Jul 24 14:40:36.665405 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.665378    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"]
Jul 24 14:40:36.776308 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.776270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caafca09-90b2-48ea-9c1d-f4e223b3cade-sys\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.776308 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.776305    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caafca09-90b2-48ea-9c1d-f4e223b3cade-lib-modules\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.776567 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.776368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caafca09-90b2-48ea-9c1d-f4e223b3cade-podres\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.776567 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.776417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vklf\" (UniqueName: \"kubernetes.io/projected/caafca09-90b2-48ea-9c1d-f4e223b3cade-kube-api-access-2vklf\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.776567 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.776467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caafca09-90b2-48ea-9c1d-f4e223b3cade-proc\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.877206 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.877142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caafca09-90b2-48ea-9c1d-f4e223b3cade-proc\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.877428 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.877272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caafca09-90b2-48ea-9c1d-f4e223b3cade-proc\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.877428 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.877279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caafca09-90b2-48ea-9c1d-f4e223b3cade-sys\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.877428 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.877304    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caafca09-90b2-48ea-9c1d-f4e223b3cade-lib-modules\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.877428 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.877327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caafca09-90b2-48ea-9c1d-f4e223b3cade-sys\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.877428 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.877346    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caafca09-90b2-48ea-9c1d-f4e223b3cade-podres\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.877428 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.877382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vklf\" (UniqueName: \"kubernetes.io/projected/caafca09-90b2-48ea-9c1d-f4e223b3cade-kube-api-access-2vklf\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.877645 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.877460    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caafca09-90b2-48ea-9c1d-f4e223b3cade-lib-modules\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.877645 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.877478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caafca09-90b2-48ea-9c1d-f4e223b3cade-podres\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.886035 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.886009    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vklf\" (UniqueName: \"kubernetes.io/projected/caafca09-90b2-48ea-9c1d-f4e223b3cade-kube-api-access-2vklf\") pod \"perf-node-gather-daemonset-k5qvw\" (UID: \"caafca09-90b2-48ea-9c1d-f4e223b3cade\") " pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:36.961011 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:36.960923    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:37.101723 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:37.101691    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"]
Jul 24 14:40:37.104393 ip-10-0-132-200 kubenswrapper[2565]: W0724 14:40:37.104363    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcaafca09_90b2_48ea_9c1d_f4e223b3cade.slice/crio-199f7a293f1d30b5adbc0eb3566101d7e2a7611fa25777fa6d43c7d3fff4486b WatchSource:0}: Error finding container 199f7a293f1d30b5adbc0eb3566101d7e2a7611fa25777fa6d43c7d3fff4486b: Status 404 returned error can't find the container with id 199f7a293f1d30b5adbc0eb3566101d7e2a7611fa25777fa6d43c7d3fff4486b
Jul 24 14:40:37.587711 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:37.587683    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-2wphn_3418ef40-7177-4cd3-973a-702387be8288/volume-data-source-validator/0.log"
Jul 24 14:40:37.757100 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:37.757063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw" event={"ID":"caafca09-90b2-48ea-9c1d-f4e223b3cade","Type":"ContainerStarted","Data":"b67399172df98c2fe087a3f45ab37cf7385594d13d62a7038fc876b5ebe6ed2b"}
Jul 24 14:40:37.757668 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:37.757154    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw" event={"ID":"caafca09-90b2-48ea-9c1d-f4e223b3cade","Type":"ContainerStarted","Data":"199f7a293f1d30b5adbc0eb3566101d7e2a7611fa25777fa6d43c7d3fff4486b"}
Jul 24 14:40:37.757668 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:37.757209    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:37.773620 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:37.773569    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw" podStartSLOduration=1.773553176 podStartE2EDuration="1.773553176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:37.772415303 +0000 UTC m=+3346.007766690" watchObservedRunningTime="2026-07-24 14:40:37.773553176 +0000 UTC m=+3346.008904537"
Jul 24 14:40:38.648317 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:38.648287    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qgfbv_8c85b14b-79da-476c-b403-dcf9a30fa473/dns/0.log"
Jul 24 14:40:38.668948 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:38.668923    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qgfbv_8c85b14b-79da-476c-b403-dcf9a30fa473/kube-rbac-proxy/0.log"
Jul 24 14:40:38.764109 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:38.764080    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gb6xn_aa8826d0-c493-4bbe-85ad-998e7785fb69/dns-node-resolver/0.log"
Jul 24 14:40:39.389559 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:39.389531    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5q8zz_9b846200-4036-4055-ad01-f563a8beed2e/node-ca/0.log"
Jul 24 14:40:40.577294 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:40.577262    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dc46bdfb5-94swf_f9c9e5a1-9bc4-45bb-9780-bfef75c77f88/kube-auth-proxy/0.log"
Jul 24 14:40:40.804887 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:40.804863    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c6777bc7-kmtdh_419e2dcc-9848-46b9-a353-00ff6d78be07/router/0.log"
Jul 24 14:40:41.649511 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:41.649463    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x7w45_97d637b1-98c3-4f98-9555-08a28bcf744e/serve-healthcheck-canary/0.log"
Jul 24 14:40:42.174111 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:42.174080    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-qrsrx_75d9eb42-05d9-4729-9382-85f04774bf0f/insights-operator/0.log"
Jul 24 14:40:42.174816 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:42.174795    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-qrsrx_75d9eb42-05d9-4729-9382-85f04774bf0f/insights-operator/1.log"
Jul 24 14:40:42.325938 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:42.325895    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lbwkg_083c3a90-e6e7-4e19-9373-025836eed01a/kube-rbac-proxy/0.log"
Jul 24 14:40:42.363720 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:42.363692    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lbwkg_083c3a90-e6e7-4e19-9373-025836eed01a/exporter/0.log"
Jul 24 14:40:42.404260 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:42.404219    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lbwkg_083c3a90-e6e7-4e19-9373-025836eed01a/extractor/0.log"
Jul 24 14:40:43.773241 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:43.773209    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mmxsf/perf-node-gather-daemonset-k5qvw"
Jul 24 14:40:45.203695 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:45.203652    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c_e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6/manager/0.log"
Jul 24 14:40:45.223289 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:45.223262    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd96dfd5f-mpk2c_e69d2ad6-b925-4f06-b4e0-ab4a84bc65a6/copy-manifests/0.log"
Jul 24 14:40:46.754114 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:46.754086    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-84df8c9cc-64xh6_54249ca6-3227-4c9d-9f08-38a5d0ea089b/manager/0.log"
Jul 24 14:40:47.430674 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:47.430639    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dc46bdfb5-94swf_f9c9e5a1-9bc4-45bb-9780-bfef75c77f88/kube-auth-proxy/0.log"
Jul 24 14:40:47.640719 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:47.640682    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c6777bc7-kmtdh_419e2dcc-9848-46b9-a353-00ff6d78be07/router/0.log"
Jul 24 14:40:49.390556 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:49.390525    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dc46bdfb5-94swf_f9c9e5a1-9bc4-45bb-9780-bfef75c77f88/kube-auth-proxy/0.log"
Jul 24 14:40:49.536973 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:49.536946    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c6777bc7-kmtdh_419e2dcc-9848-46b9-a353-00ff6d78be07/router/0.log"
Jul 24 14:40:52.393316 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:52.393278    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c_c905979c-221e-4583-9394-646302006355/kube-storage-version-migrator-operator/1.log"
Jul 24 14:40:52.394197 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:52.394165    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-tr76c_c905979c-221e-4583-9394-646302006355/kube-storage-version-migrator-operator/0.log"
Jul 24 14:40:52.659339 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:52.659160    2565 scope.go:117] "RemoveContainer" containerID="1cbeaf468265995f9e175001f06200f728cff1c3b0ab63633da275f254e233d0"
Jul 24 14:40:53.761271 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:53.761246    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-scx8p_6bf1d1e1-8363-4e34-bf6a-920e175bfd7f/kube-multus-additional-cni-plugins/0.log"
Jul 24 14:40:53.783085 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:53.783037    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-scx8p_6bf1d1e1-8363-4e34-bf6a-920e175bfd7f/egress-router-binary-copy/0.log"
Jul 24 14:40:53.809331 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:53.809301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-scx8p_6bf1d1e1-8363-4e34-bf6a-920e175bfd7f/cni-plugins/0.log"
Jul 24 14:40:53.831277 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:53.831252    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-scx8p_6bf1d1e1-8363-4e34-bf6a-920e175bfd7f/bond-cni-plugin/0.log"
Jul 24 14:40:53.855081 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:53.855047    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-scx8p_6bf1d1e1-8363-4e34-bf6a-920e175bfd7f/routeoverride-cni/0.log"
Jul 24 14:40:53.877275 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:53.877243    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-scx8p_6bf1d1e1-8363-4e34-bf6a-920e175bfd7f/whereabouts-cni-bincopy/0.log"
Jul 24 14:40:53.901385 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:53.901357    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-scx8p_6bf1d1e1-8363-4e34-bf6a-920e175bfd7f/whereabouts-cni/0.log"
Jul 24 14:40:53.975268 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:53.975230    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tvw8p_615bc648-ab8d-4fac-8871-297d0c40c620/kube-multus/0.log"
Jul 24 14:40:54.093865 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:54.093834    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l7qzc_6ec1c31e-6c92-4f1d-a9e3-0228915d6893/network-metrics-daemon/0.log"
Jul 24 14:40:54.116568 ip-10-0-132-200 kubenswrapper[2565]: I0724 14:40:54.116520    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l7qzc_6ec1c31e-6c92-4f1d-a9e3-0228915d6893/kube-rbac-proxy/0.log"