Jul 15 14:28:29.918986 ip-10-0-131-157 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 14:28:29.918997 ip-10-0-131-157 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 14:28:29.919007 ip-10-0-131-157 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 14:28:29.919321 ip-10-0-131-157 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 14:28:40.056668 ip-10-0-131-157 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 14:28:40.056689 ip-10-0-131-157 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8f94fece696d4f5fb632c185d9f4d5bb --
Jul 15 14:30:37.538601 ip-10-0-131-157 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 14:30:38.105579 ip-10-0-131-157 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 14:30:38.105579 ip-10-0-131-157 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 14:30:38.105579 ip-10-0-131-157 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 14:30:38.105579 ip-10-0-131-157 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 14:30:38.105579 ip-10-0-131-157 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 14:30:38.105579 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.913160    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 14:30:38.105579 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917221    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:30:38.105579 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917232    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:30:38.105579 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917236    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:30:38.105579 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917239    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:30:38.105579 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917242    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:30:38.105579 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917245    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:30:38.105579 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917248    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:30:38.105579 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917250    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:30:37.987580 ip-10-0-131-157 systemd[1]: Started Kubernetes Kubelet.
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917253    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917256    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917258    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917261    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917264    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917268    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917271    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917273    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917276    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917279    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917282    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917285    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917287    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917290    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917293    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917296    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917298    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917301    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917304    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:30:38.115547 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917306    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917309    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917312    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917314    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917317    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917320    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917322    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917325    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917328    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917330    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917333    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917335    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917349    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917352    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917355    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917357    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917360    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917362    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917365    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917368    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:30:38.116251 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917370    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917373    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917377    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917381    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917384    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917387    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917390    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917393    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917397    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917399    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917402    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917405    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917407    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917411    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917414    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917416    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917419    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917422    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917425    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:30:38.116904 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917427    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917430    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917432    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917435    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917437    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917441    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917445    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917448    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917451    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917453    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917457    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917461    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917464    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917467    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917470    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917472    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917475    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917478    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917481    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:30:38.117472 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917484    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917486    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917489    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917492    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917495    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917497    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917500    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917503    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917506    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917509    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917511    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917514    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917516    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.917519    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918179    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918185    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918188    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918191    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918194    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918196    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:30:38.118035 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918199    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918202    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918204    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918207    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918209    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918212    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918214    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918217    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918219    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918222    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918225    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918227    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918230    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918232    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918234    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918237    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918239    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918242    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918245    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918247    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:30:38.118616 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918250    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918254    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918257    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918260    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918263    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918266    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918269    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918272    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918274    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918276    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918279    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918282    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918285    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918287    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918293    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918296    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918299    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918302    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918304    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:30:38.119362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918307    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918310    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918313    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918315    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918318    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918320    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918323    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918326    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918329    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918331    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918334    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918351    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918354    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918357    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918360    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918363    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918366    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918368    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918371    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918374    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:30:38.120031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918377    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918380    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918384    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918386    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918389    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918391    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918395    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918397    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918400    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918402    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918405    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918407    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918410    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918412    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918415    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918417    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918420    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918422    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918425    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:30:38.120751 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918427    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918430    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918432    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918435    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918438    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918440    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918443    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918445    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918448    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918450    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918453    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918455    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918458    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918461    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918463    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918844    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918849    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918853    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918856    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918860    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:30:38.121611 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918863    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918866    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918868    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918871    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918874    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918876    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918879    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918882    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918886    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918889    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918891    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918894    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918897    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918899    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918902    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918904    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918907    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918910    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918914    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918916    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:30:38.122666 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918919    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918921    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918924    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918927    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918929    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918932    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918935    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918938    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918940    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918942    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918945    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918947    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918950    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918954    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918957    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918960    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918963    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918966    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918970    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:30:38.123681 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918973    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918977    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918979    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918982    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918984    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918987    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918989    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918992    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918995    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.918997    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919000    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919004    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919007    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919009    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919012    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919015    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919017    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919020    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919022    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919032    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:30:38.124610 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919036    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919039    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919042    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919044    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919047    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919050    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919054    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919057    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919060    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919062    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919065    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919067    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919070    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919073    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919076    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919078    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919081    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919084    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919086    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919089    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:30:38.125158 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919091    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919093    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919096    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919100    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919103    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919105    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919108    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919110    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919113    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919115    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919118    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919120    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919124    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919126    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919129    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919190    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919196    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919202    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919206    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919210    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919215    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 14:30:38.125739 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919220    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919227    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919231    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919235    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919243    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919246    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919249    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919252    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919255    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919258    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919261    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919263    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919267    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919270    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919275    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919278    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919281    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919284    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919287    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919290    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919293    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919296    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919299    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919302    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 14:30:38.126269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919306    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919309    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919313    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919316    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919319    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919321    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919324    2581 flags.go:64] FLAG: --enable-server="true"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919327    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919331    2581 flags.go:64] FLAG: --event-burst="100"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919334    2581 flags.go:64] FLAG: --event-qps="50"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919350    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919353    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919357    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919361    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919364    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919367    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919370    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919373    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919376    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919379    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919382    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919385    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919390    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919393    2581 flags.go:64] FLAG: --feature-gates=""
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919396    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 14:30:38.126942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919399    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919402    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919405    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919408    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919411    2581 flags.go:64] FLAG: --help="false"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919414    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-131-157.ec2.internal"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919417    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919420    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919424    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919427    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919430    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919433    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919436    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919439    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919441    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919444    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919447    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919450    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919453    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919457    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919460    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919463    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919465    2581 flags.go:64] FLAG: --lock-file=""
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919468    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 14:30:38.127732 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919471    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919474    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919479    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919482    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919485    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919492    2581 flags.go:64] FLAG: --logging-format="text"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919494    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919498    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919501    2581 flags.go:64] FLAG: --manifest-url=""
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919503    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919508    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919511    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919514    2581 flags.go:64] FLAG: --max-pods="110"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919517    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919520    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919523    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919526    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919529    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919532    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919535    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919542    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919545    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919548    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 14:30:38.128425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919551    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919554    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919559    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919562    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919565    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919569    2581 flags.go:64] FLAG: --port="10250"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919572    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919575    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00cbb7baf8fa55bc2"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919578    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919581    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919584    2581 flags.go:64] FLAG: --register-node="true"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919587    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919590    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919593    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919597    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919600    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919604    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919606    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919609    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919612    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919615    2581 flags.go:64] FLAG: --runonce="false"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919618    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919621    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919624    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919627    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 14:30:38.129333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919629    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919632    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919636    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919639    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919642    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919645    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919648    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919651    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919653    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919656    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919659    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919664    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919669    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919671    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919675    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919677    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919680    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919683    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919686    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919689    2581 flags.go:64] FLAG: --v="2"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919693    2581 flags.go:64] FLAG: --version="false"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919699    2581 flags.go:64] FLAG: --vmodule=""
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919703    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.919706    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919814    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:30:38.130036 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919818    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919835    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919839    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919842    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919845    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919849    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919851    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919856    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919859    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919862    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919866    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919868    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919871    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919874    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919877    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919880    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919883    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919886    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919890    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919894    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:30:39.601156 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919897    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919900    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919902    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919905    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919908    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919911    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919914    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919917    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919921    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919923    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919926    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919929    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919931    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919934    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919936    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919939    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919943    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919947    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919949    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:30:39.602372 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919952    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919967    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919969    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919972    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919975    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919978    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919980    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919983    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919985    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919988    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919991    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919993    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.919998    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920000    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920003    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920005    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920008    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920010    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920013    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920015    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:30:39.603005 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920018    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920022    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920024    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920027    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920029    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920032    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920034    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920037    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920039    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920042    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920045    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920047    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920050    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920052    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920056    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920059    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920062    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920065    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920067    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:30:39.603619 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920070    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920072    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920075    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920078    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920080    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920084    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920086    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920089    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920092    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920094    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920096    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920099    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920101    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920104    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920108    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920110    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920113    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920115    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920118    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:30:39.604159 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.920120    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.920651    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.930479    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.930494    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.931253    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.931261    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931318    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931324    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931327    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931331    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931334    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931337    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931351    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931355    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931358    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:30:39.604823 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931361    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931364    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931367    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931370    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931373    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931377    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931381    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931384    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931387    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931390    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931393    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931396    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931398    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931401    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931405    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931409    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931413    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931418    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:30:39.605257 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931429    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931434    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931437    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931440    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931443    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931445    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931448    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931451    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931454    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931456    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931459    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931462    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931465    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931467    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931470    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931472    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931475    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931477    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931480    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931483    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:30:39.605780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931486    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931488    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931491    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931493    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931496    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931499    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931501    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931504    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931506    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931509    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931512    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931515    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931519    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931522    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931524    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931527    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931530    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931533    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931535    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931538    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:30:39.606302 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931540    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931543    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931546    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931548    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931551    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931554    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931556    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931559    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931562    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931564    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931566    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931569    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931572    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931574    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931577    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931579    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931582    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931584    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931587    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931590    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:30:39.606862 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931592    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931595    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931597    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931601    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931606    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931608    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931610    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931613    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931616    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931618    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931621    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931623    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.931628    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931773    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931779    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931782    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:30:39.607355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931785    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931788    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931791    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931794    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931796    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931798    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931802    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931805    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931807    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931810    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931813    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931815    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931818    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931820    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931823    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931826    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931829    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931831    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931834    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:30:39.607835 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931836    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931841    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931844    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931846    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931849    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931852    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931854    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931857    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931860    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931863    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931866    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931870    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931874    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931876    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931879    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931882    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931884    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931887    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931889    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931892    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:30:39.608309 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931895    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931897    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931900    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931903    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931906    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931910    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931913    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931916    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931920    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931923    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931926    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931929    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931931    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931937    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931940    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931956    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931959    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931962    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931965    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931967    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:30:39.608913 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931970    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931973    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931976    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931978    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931981    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931983    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931987    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931990    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931993    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931996    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.931999    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932002    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932004    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932007    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932009    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932011    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932018    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932020    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932023    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932025    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:30:39.609446 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932027    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932030    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932032    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932035    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932037    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932042    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932045    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932047    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932050    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932052    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932055    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932058    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932060    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932063    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932065    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932068    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:30:39.610042 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:37.932071    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:30:39.610484 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.932075    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 14:30:39.610484 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.932170    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 14:30:39.610484 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.934736    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 14:30:39.610484 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.935930    2581 server.go:1019] "Starting client certificate rotation"
Jul 15 14:30:39.610484 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.936026    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 14:30:39.610484 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.936061    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 14:30:39.610484 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.938155    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 14:30:39.610484 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.939334    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 14:30:39.610484 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.954952    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 15 14:30:39.610484 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.956719    2581 log.go:25] "Validated CRI v1 image API"
Jul 15 14:30:39.610484 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.957493    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 14:30:39.610484 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.960461    2581 fs.go:135] Filesystem UUIDs: map[40b40f95-5108-4e7c-a094-01ae0619d02e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 84bb1c35-512b-401b-b5bb-63381969ad32:/dev/nvme0n1p3]
Jul 15 14:30:39.610893 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.960480    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 14:30:39.610893 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.965983    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.968117    2581 manager.go:216] Machine: {Timestamp:2026-07-15 14:30:37.965828506 +0000 UTC m=+0.318900919 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105764 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec265d5cd32ef98ff176eb19210c3067 SystemUUID:ec265d5c-d32e-f98f-f176-eb19210c3067 BootID:8f94fece-696d-4f5f-b632-c185d9f4d5bb Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b0:d9:ca:9b:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b0:d9:ca:9b:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:ca:6e:66:b5:e4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.968213    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.968280    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.970863    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.970890    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-157.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.971624    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.971634    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.971641    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.972239    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.973359    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.977217    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.977319    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.977355    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.977363    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.977376    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.977385    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.977393    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 14:30:39.611056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.977660    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.977679    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.979597    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.981133    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.981159    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.981308    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.981320    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.981325    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.981330    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.981356    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.981362    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.981786    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.981792    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.981799    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.981804    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.981812    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.981820    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.982448    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.982455    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.985785    2581 server.go:1268] "Started kubelet"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.985868    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.986361    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.986422    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.987436    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.988846    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:37.991370    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-157.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:37.991373    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.991502    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-157.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.992221    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.992239    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:37.992359    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-157.ec2.internal\" not found"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.992833    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.992962    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.992976    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.993054    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.993065    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:37.993051    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-157.ec2.internal.18c27cff37bccb74  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-157.ec2.internal,UID:ip-10-0-131-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-157.ec2.internal,},FirstTimestamp:2026-07-15 14:30:37.985762164 +0000 UTC m=+0.338834572,LastTimestamp:2026-07-15 14:30:37.985762164 +0000 UTC m=+0.338834572,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-157.ec2.internal,}"
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.997062    2581 factory.go:55] Registering systemd factory
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.997103    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.998493    2581 factory.go:153] Registering CRI-O factory
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.998657    2581 factory.go:223] Registration of the crio container factory successfully
Jul 15 14:30:39.831171 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.998749    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:37.998756    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.998776    2581 factory.go:103] Registering Raw factory
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:37.998799    2581 manager.go:1196] Started watching for new ooms in manager
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.000162    2581 manager.go:349] Starting recovery of all containers
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:38.008949    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:38.010094    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-157.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.013450    2581 manager.go:354] Recovery completed
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:38.014756    2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.017420    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.019257    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.019672    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.019683    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.020158    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.020168    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.020170    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.020181    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.020878    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.020904    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.020915    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.021331    2581 policy_none.go:49] "None policy: Start"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.021358    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.021368    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:38.021983    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-157.ec2.internal.18c27cff39c1ff81  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-157.ec2.internal,UID:ip-10-0-131-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-157.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-157.ec2.internal,},FirstTimestamp:2026-07-15 14:30:38.019657601 +0000 UTC m=+0.372730012,LastTimestamp:2026-07-15 14:30:38.019657601 +0000 UTC m=+0.372730012,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-157.ec2.internal,}"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.022184    2581 policy_none.go:47] "Start"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:38.034637    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-157.ec2.internal.18c27cff39c24c66  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-157.ec2.internal,UID:ip-10-0-131-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-157.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-157.ec2.internal,},FirstTimestamp:2026-07-15 14:30:38.019677286 +0000 UTC m=+0.372749697,LastTimestamp:2026-07-15 14:30:38.019677286 +0000 UTC m=+0.372749697,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-157.ec2.internal,}"
Jul 15 14:30:39.832918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.040280    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xp5pp"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:38.046801    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-157.ec2.internal.18c27cff39c2734e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-157.ec2.internal,UID:ip-10-0-131-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-157.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-157.ec2.internal,},FirstTimestamp:2026-07-15 14:30:38.019687246 +0000 UTC m=+0.372759656,LastTimestamp:2026-07-15 14:30:38.019687246 +0000 UTC m=+0.372759656,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-157.ec2.internal,}"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.048408    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xp5pp"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.056257    2581 manager.go:337] "Starting Device Plugin manager"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:38.056286    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.056298    2581 server.go:87] "Starting device plugin registration server"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.056564    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.056586    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.056774    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.056839    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.056846    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:38.057194    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:38.057242    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-157.ec2.internal\" not found"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.157261    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.158201    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.158224    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.158234    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:38.158255    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.372618    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.373968    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.374004    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.374022    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:39.374056    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.374659    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:39.374674    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-157.ec2.internal\": node \"ip-10-0-131-157.ec2.internal\" not found"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.377782    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:39.448655    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-157.ec2.internal\" not found"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.474750    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-157.ec2.internal"]
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.474813    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.476048    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.476076    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.476086    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.477154    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.477254    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.477278    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.477770    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.477788    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:39.836583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.477795    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.477807    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.477810    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.477824    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.478948    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.478968    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.479608    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.479632    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.479645    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:39.498238    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-157.ec2.internal\" not found" node="ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.503909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8f8f53af122be6d892057d1be7162858-config\") pod \"kube-apiserver-proxy-ip-10-0-131-157.ec2.internal\" (UID: \"8f8f53af122be6d892057d1be7162858\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.503934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7519191ca94ca8a3e6baaf4a6b48fb3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal\" (UID: \"b7519191ca94ca8a3e6baaf4a6b48fb3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.503950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7519191ca94ca8a3e6baaf4a6b48fb3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal\" (UID: \"b7519191ca94ca8a3e6baaf4a6b48fb3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:39.503964    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-157.ec2.internal\" not found" node="ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:39.549305    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-157.ec2.internal\" not found"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.604433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7519191ca94ca8a3e6baaf4a6b48fb3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal\" (UID: \"b7519191ca94ca8a3e6baaf4a6b48fb3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.604480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7519191ca94ca8a3e6baaf4a6b48fb3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal\" (UID: \"b7519191ca94ca8a3e6baaf4a6b48fb3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.604506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8f8f53af122be6d892057d1be7162858-config\") pod \"kube-apiserver-proxy-ip-10-0-131-157.ec2.internal\" (UID: \"8f8f53af122be6d892057d1be7162858\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.604526    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7519191ca94ca8a3e6baaf4a6b48fb3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal\" (UID: \"b7519191ca94ca8a3e6baaf4a6b48fb3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.604552    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8f8f53af122be6d892057d1be7162858-config\") pod \"kube-apiserver-proxy-ip-10-0-131-157.ec2.internal\" (UID: \"8f8f53af122be6d892057d1be7162858\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.604573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7519191ca94ca8a3e6baaf4a6b48fb3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal\" (UID: \"b7519191ca94ca8a3e6baaf4a6b48fb3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:39.649393    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-157.ec2.internal\" not found"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:39.749935    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-157.ec2.internal\" not found"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.800192    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:39.837680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:39.806216    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:40.076350 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:39.850678    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-157.ec2.internal\" not found"
Jul 15 14:30:40.076350 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:39.951109    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-157.ec2.internal\" not found"
Jul 15 14:30:40.076350 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.047534    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:30:40.191874 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.099693    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:40.191874 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.115240    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 14:30:40.191874 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.116841    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-157.ec2.internal"
Jul 15 14:30:40.191874 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.127031    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 14:30:40.191874 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.142149    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 14:30:40.191874 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.142259    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 14:30:40.191874 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.142301    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 14:30:40.192781 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.192677    2581 apiserver.go:52] "Watching apiserver"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.198764    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.212472    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.212814    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms","openshift-image-registry/node-ca-857pm","openshift-multus/multus-additional-cni-plugins-njjqk","openshift-multus/network-metrics-daemon-pplz5","openshift-network-diagnostics/network-check-target-f8nw2","openshift-ovn-kubernetes/ovnkube-node-dj6k9","kube-system/global-pull-secret-syncer-2kgfr","kube-system/konnectivity-agent-nd4r9","kube-system/kube-apiserver-proxy-ip-10-0-131-157.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qcw9r","openshift-dns/node-resolver-5hmbj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal","openshift-multus/multus-zf8qc","openshift-network-operator/iptables-alerter-7lvqz"]
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.214391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.214446    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.215288    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.218050    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.218169    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.218566    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.218612    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.218627    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.218645    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9xwxm\""
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.218672    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.219473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.219535    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.220454    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.220510    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.221044    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.221653    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.221779    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.222035    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dt96v\""
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.225983    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7lvqz"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.227334    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.227772    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.227893    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.228553    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-857pm"
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.228668    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.228959    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.229098    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b256m\""
Jul 15 14:30:40.330015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.229110    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.229260    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.229313    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.229330    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.229338    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.229399    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.229427    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d529f\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.229877    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.230345    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.230351    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.230425    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d85l6\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.230906    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7w6lm\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.231091    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.231113    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.231357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5hmbj"
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.232033    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.232078    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.232761    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nd4r9"
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.235086    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.235129    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s8dvn\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.235217    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cwd8r\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.235316    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.235316    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.235807    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tj2x2\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.236077    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.236165    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.244842    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h6l2j"
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.252916    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h6l2j"
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.258126    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 14:25:39 +0000 UTC" deadline="2028-01-21 19:06:21.566937637 +0000 UTC"
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.258210    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13324h35m41.308733979s"
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.300901    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309433    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs\") pod \"network-metrics-daemon-pplz5\" (UID: \"b7806d08-47f3-4fd8-beb2-e0f052c0be1b\") " pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-os-release\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.332158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309530    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-kubernetes\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309557    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-system-cni-dir\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309618    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-slash\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309635    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-etc-openvswitch\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-cni-bin\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-sys\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-lib-modules\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c7030e2-bf92-4317-98ef-a5caa8ecaaa7-tmp-dir\") pod \"node-resolver-5hmbj\" (UID: \"2c7030e2-bf92-4317-98ef-a5caa8ecaaa7\") " pod="openshift-dns/node-resolver-5hmbj"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/735ad593-2f87-4697-97d1-ffececf10a85-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-log-socket\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/648659d5-4cd0-42a2-a674-a46a7479565f-ovnkube-config\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309811    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-host\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12719e05-c9b1-4af9-b23c-29e28a1e99e5-iptables-alerter-script\") pod \"iptables-alerter-7lvqz\" (UID: \"12719e05-c9b1-4af9-b23c-29e28a1e99e5\") " pod="openshift-network-operator/iptables-alerter-7lvqz"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4jcj\" (UniqueName: \"kubernetes.io/projected/12719e05-c9b1-4af9-b23c-29e28a1e99e5-kube-api-access-t4jcj\") pod \"iptables-alerter-7lvqz\" (UID: \"12719e05-c9b1-4af9-b23c-29e28a1e99e5\") " pod="openshift-network-operator/iptables-alerter-7lvqz"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-run-netns\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.342056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-sysctl-conf\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-run\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/735ad593-2f87-4697-97d1-ffececf10a85-tuning-conf-dir\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.309988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx2h6\" (UniqueName: \"kubernetes.io/projected/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-kube-api-access-fx2h6\") pod \"network-metrics-daemon-pplz5\" (UID: \"b7806d08-47f3-4fd8-beb2-e0f052c0be1b\") " pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-registration-dir\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a92dd54-6e84-48b4-a212-dae44ef52544-cni-binary-copy\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/735ad593-2f87-4697-97d1-ffececf10a85-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9h27\" (UniqueName: \"kubernetes.io/projected/735ad593-2f87-4697-97d1-ffececf10a85-kube-api-access-s9h27\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310114    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs5mr\" (UniqueName: \"kubernetes.io/projected/2a92dd54-6e84-48b4-a212-dae44ef52544-kube-api-access-zs5mr\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310129    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-sysctl-d\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-cnibin\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-run-systemd\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-systemd\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310219    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/735ad593-2f87-4697-97d1-ffececf10a85-cnibin\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-kubelet-dir\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.342797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310250    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-systemd-units\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-node-log\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310282    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d073343-d7d8-4355-b336-8aa922f542da-serviceca\") pod \"node-ca-857pm\" (UID: \"3d073343-d7d8-4355-b336-8aa922f542da\") " pod="openshift-image-registry/node-ca-857pm"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c7030e2-bf92-4317-98ef-a5caa8ecaaa7-hosts-file\") pod \"node-resolver-5hmbj\" (UID: \"2c7030e2-bf92-4317-98ef-a5caa8ecaaa7\") " pod="openshift-dns/node-resolver-5hmbj"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5384830-56ce-4427-a090-d8cd1ba933f0-dbus\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzdzm\" (UniqueName: \"kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm\") pod \"network-check-target-f8nw2\" (UID: \"6aab3e1e-de27-4522-adfe-86f01ef40d19\") " pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310355    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-run-k8s-cni-cncf-io\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2a92dd54-6e84-48b4-a212-dae44ef52544-multus-daemon-config\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-run-openvswitch\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31ea0019-3407-494b-a17a-6786e2a8e48f-tmp\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310419    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/735ad593-2f87-4697-97d1-ffececf10a85-os-release\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/735ad593-2f87-4697-97d1-ffececf10a85-cni-binary-copy\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310468    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-socket-dir\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-device-dir\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310511    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-run-multus-certs\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmdj7\" (UniqueName: \"kubernetes.io/projected/648659d5-4cd0-42a2-a674-a46a7479565f-kube-api-access-gmdj7\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.343539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310547    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-modprobe-d\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12719e05-c9b1-4af9-b23c-29e28a1e99e5-host-slash\") pod \"iptables-alerter-7lvqz\" (UID: \"12719e05-c9b1-4af9-b23c-29e28a1e99e5\") " pod="openshift-network-operator/iptables-alerter-7lvqz"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310596    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-multus-cni-dir\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310611    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-multus-conf-dir\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-cni-netd\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5384830-56ce-4427-a090-d8cd1ba933f0-kubelet-config\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fnrw\" (UniqueName: \"kubernetes.io/projected/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-kube-api-access-2fnrw\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310691    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-hostroot\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310719    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84q84\" (UniqueName: \"kubernetes.io/projected/3d073343-d7d8-4355-b336-8aa922f542da-kube-api-access-84q84\") pod \"node-ca-857pm\" (UID: \"3d073343-d7d8-4355-b336-8aa922f542da\") " pod="openshift-image-registry/node-ca-857pm"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-tuned\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cc8465e-77b7-48a5-9c9f-03264ec77526-agent-certs\") pod \"konnectivity-agent-nd4r9\" (UID: \"0cc8465e-77b7-48a5-9c9f-03264ec77526\") " pod="kube-system/konnectivity-agent-nd4r9"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-sys-fs\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310818    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-var-lib-cni-bin\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310838    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-var-lib-cni-multus\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310857    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-var-lib-kubelet\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-etc-kubernetes\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310888    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-run-netns\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.344249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-run-ovn\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm7qf\" (UniqueName: \"kubernetes.io/projected/2c7030e2-bf92-4317-98ef-a5caa8ecaaa7-kube-api-access-mm7qf\") pod \"node-resolver-5hmbj\" (UID: \"2c7030e2-bf92-4317-98ef-a5caa8ecaaa7\") " pod="openshift-dns/node-resolver-5hmbj"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310937    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-multus-socket-dir-parent\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/648659d5-4cd0-42a2-a674-a46a7479565f-ovnkube-script-lib\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.310986    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d073343-d7d8-4355-b336-8aa922f542da-host\") pod \"node-ca-857pm\" (UID: \"3d073343-d7d8-4355-b336-8aa922f542da\") " pod="openshift-image-registry/node-ca-857pm"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.311002    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-sysconfig\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.311021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-etc-selinux\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.311035    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-kubelet\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.311051    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-var-lib-openvswitch\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.311067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-run-ovn-kubernetes\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.311086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/648659d5-4cd0-42a2-a674-a46a7479565f-env-overrides\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.311101    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxjxz\" (UniqueName: \"kubernetes.io/projected/31ea0019-3407-494b-a17a-6786e2a8e48f-kube-api-access-wxjxz\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.311119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/735ad593-2f87-4697-97d1-ffececf10a85-system-cni-dir\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.311134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/648659d5-4cd0-42a2-a674-a46a7479565f-ovn-node-metrics-cert\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.311149    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-var-lib-kubelet\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.344982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.311162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cc8465e-77b7-48a5-9c9f-03264ec77526-konnectivity-ca\") pod \"konnectivity-agent-nd4r9\" (UID: \"0cc8465e-77b7-48a5-9c9f-03264ec77526\") " pod="kube-system/konnectivity-agent-nd4r9"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-sys-fs\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-var-lib-cni-bin\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-var-lib-cni-multus\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-var-lib-kubelet\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-etc-kubernetes\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-run-netns\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-run-ovn\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412379    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-var-lib-cni-multus\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412389    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-var-lib-kubelet\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412383    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm7qf\" (UniqueName: \"kubernetes.io/projected/2c7030e2-bf92-4317-98ef-a5caa8ecaaa7-kube-api-access-mm7qf\") pod \"node-resolver-5hmbj\" (UID: \"2c7030e2-bf92-4317-98ef-a5caa8ecaaa7\") " pod="openshift-dns/node-resolver-5hmbj"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412439    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-etc-kubernetes\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412440    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-var-lib-cni-bin\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412442    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-run-netns\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-multus-socket-dir-parent\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-run-ovn\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/648659d5-4cd0-42a2-a674-a46a7479565f-ovnkube-script-lib\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-sys-fs\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.438014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412523    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d073343-d7d8-4355-b336-8aa922f542da-host\") pod \"node-ca-857pm\" (UID: \"3d073343-d7d8-4355-b336-8aa922f542da\") " pod="openshift-image-registry/node-ca-857pm"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d073343-d7d8-4355-b336-8aa922f542da-host\") pod \"node-ca-857pm\" (UID: \"3d073343-d7d8-4355-b336-8aa922f542da\") " pod="openshift-image-registry/node-ca-857pm"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412577    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-sysconfig\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-multus-socket-dir-parent\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-etc-selinux\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-kubelet\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412639    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-sysconfig\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412666    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-var-lib-openvswitch\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-kubelet\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412668    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-etc-selinux\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-run-ovn-kubernetes\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412707    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-var-lib-openvswitch\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412716    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/648659d5-4cd0-42a2-a674-a46a7479565f-env-overrides\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412750    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxjxz\" (UniqueName: \"kubernetes.io/projected/31ea0019-3407-494b-a17a-6786e2a8e48f-kube-api-access-wxjxz\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412758    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-run-ovn-kubernetes\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412768    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/735ad593-2f87-4697-97d1-ffececf10a85-system-cni-dir\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/648659d5-4cd0-42a2-a674-a46a7479565f-ovn-node-metrics-cert\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.438782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-var-lib-kubelet\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cc8465e-77b7-48a5-9c9f-03264ec77526-konnectivity-ca\") pod \"konnectivity-agent-nd4r9\" (UID: \"0cc8465e-77b7-48a5-9c9f-03264ec77526\") " pod="kube-system/konnectivity-agent-nd4r9"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs\") pod \"network-metrics-daemon-pplz5\" (UID: \"b7806d08-47f3-4fd8-beb2-e0f052c0be1b\") " pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412838    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/735ad593-2f87-4697-97d1-ffececf10a85-system-cni-dir\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-os-release\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412878    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-var-lib-kubelet\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.412915    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412926    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-os-release\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.412980    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs podName:b7806d08-47f3-4fd8-beb2-e0f052c0be1b nodeName:}" failed. No retries permitted until 2026-07-15 14:30:40.912955081 +0000 UTC m=+2.059635819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs") pod "network-metrics-daemon-pplz5" (UID: "b7806d08-47f3-4fd8-beb2-e0f052c0be1b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.412993    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-kubernetes\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413010    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-system-cni-dir\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-slash\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-etc-openvswitch\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413086    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-system-cni-dir\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413092    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-cni-bin\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-sys\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.439486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-slash\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413144    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-kubernetes\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.413097    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-lib-modules\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c7030e2-bf92-4317-98ef-a5caa8ecaaa7-tmp-dir\") pod \"node-resolver-5hmbj\" (UID: \"2c7030e2-bf92-4317-98ef-a5caa8ecaaa7\") " pod="openshift-dns/node-resolver-5hmbj"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413201    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-etc-openvswitch\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.413214    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret podName:f5384830-56ce-4427-a090-d8cd1ba933f0 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:40.913198207 +0000 UTC m=+2.059878944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret") pod "global-pull-secret-syncer-2kgfr" (UID: "f5384830-56ce-4427-a090-d8cd1ba933f0") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413202    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-sys\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/735ad593-2f87-4697-97d1-ffececf10a85-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413272    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-lib-modules\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-log-socket\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/648659d5-4cd0-42a2-a674-a46a7479565f-ovnkube-config\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-host\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12719e05-c9b1-4af9-b23c-29e28a1e99e5-iptables-alerter-script\") pod \"iptables-alerter-7lvqz\" (UID: \"12719e05-c9b1-4af9-b23c-29e28a1e99e5\") " pod="openshift-network-operator/iptables-alerter-7lvqz"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413728    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/735ad593-2f87-4697-97d1-ffececf10a85-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413302    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-cni-bin\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-log-socket\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.413844    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-host\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.440653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414106    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414204    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c7030e2-bf92-4317-98ef-a5caa8ecaaa7-tmp-dir\") pod \"node-resolver-5hmbj\" (UID: \"2c7030e2-bf92-4317-98ef-a5caa8ecaaa7\") " pod="openshift-dns/node-resolver-5hmbj"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414261    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4jcj\" (UniqueName: \"kubernetes.io/projected/12719e05-c9b1-4af9-b23c-29e28a1e99e5-kube-api-access-t4jcj\") pod \"iptables-alerter-7lvqz\" (UID: \"12719e05-c9b1-4af9-b23c-29e28a1e99e5\") " pod="openshift-network-operator/iptables-alerter-7lvqz"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414291    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-run-netns\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-sysctl-conf\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-run\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/735ad593-2f87-4697-97d1-ffececf10a85-tuning-conf-dir\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414362    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/648659d5-4cd0-42a2-a674-a46a7479565f-env-overrides\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414384    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2h6\" (UniqueName: \"kubernetes.io/projected/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-kube-api-access-fx2h6\") pod \"network-metrics-daemon-pplz5\" (UID: \"b7806d08-47f3-4fd8-beb2-e0f052c0be1b\") " pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414405    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/648659d5-4cd0-42a2-a674-a46a7479565f-ovnkube-script-lib\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-registration-dir\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414434    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a92dd54-6e84-48b4-a212-dae44ef52544-cni-binary-copy\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414443    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/648659d5-4cd0-42a2-a674-a46a7479565f-ovnkube-config\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/735ad593-2f87-4697-97d1-ffececf10a85-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9h27\" (UniqueName: \"kubernetes.io/projected/735ad593-2f87-4697-97d1-ffececf10a85-kube-api-access-s9h27\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414508    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cc8465e-77b7-48a5-9c9f-03264ec77526-konnectivity-ca\") pod \"konnectivity-agent-nd4r9\" (UID: \"0cc8465e-77b7-48a5-9c9f-03264ec77526\") " pod="kube-system/konnectivity-agent-nd4r9"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414528    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12719e05-c9b1-4af9-b23c-29e28a1e99e5-iptables-alerter-script\") pod \"iptables-alerter-7lvqz\" (UID: \"12719e05-c9b1-4af9-b23c-29e28a1e99e5\") " pod="openshift-network-operator/iptables-alerter-7lvqz"
Jul 15 14:30:40.446878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414514    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-registration-dir\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs5mr\" (UniqueName: \"kubernetes.io/projected/2a92dd54-6e84-48b4-a212-dae44ef52544-kube-api-access-zs5mr\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414588    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-run-netns\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-sysctl-d\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/735ad593-2f87-4697-97d1-ffececf10a85-tuning-conf-dir\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414635    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414640    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-run\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-cnibin\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414677    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-cnibin\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-run-systemd\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-systemd\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/735ad593-2f87-4697-97d1-ffececf10a85-cnibin\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414767    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-kubelet-dir\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414773    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-sysctl-conf\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414801    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-sysctl-d\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414806    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-kubelet-dir\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.447758 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414802    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-systemd-units\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414829    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-systemd\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414836    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-systemd-units\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414844    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/735ad593-2f87-4697-97d1-ffececf10a85-cnibin\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414840    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-node-log\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414870    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-run-systemd\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-node-log\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414874    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d073343-d7d8-4355-b336-8aa922f542da-serviceca\") pod \"node-ca-857pm\" (UID: \"3d073343-d7d8-4355-b336-8aa922f542da\") " pod="openshift-image-registry/node-ca-857pm"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414908    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c7030e2-bf92-4317-98ef-a5caa8ecaaa7-hosts-file\") pod \"node-resolver-5hmbj\" (UID: \"2c7030e2-bf92-4317-98ef-a5caa8ecaaa7\") " pod="openshift-dns/node-resolver-5hmbj"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5384830-56ce-4427-a090-d8cd1ba933f0-dbus\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzdzm\" (UniqueName: \"kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm\") pod \"network-check-target-f8nw2\" (UID: \"6aab3e1e-de27-4522-adfe-86f01ef40d19\") " pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.414982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-run-k8s-cni-cncf-io\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415004    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2a92dd54-6e84-48b4-a212-dae44ef52544-multus-daemon-config\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-run-openvswitch\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31ea0019-3407-494b-a17a-6786e2a8e48f-tmp\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415083    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/735ad593-2f87-4697-97d1-ffececf10a85-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/735ad593-2f87-4697-97d1-ffececf10a85-os-release\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.449193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/735ad593-2f87-4697-97d1-ffececf10a85-cni-binary-copy\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415153    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/735ad593-2f87-4697-97d1-ffececf10a85-os-release\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415157    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-socket-dir\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c7030e2-bf92-4317-98ef-a5caa8ecaaa7-hosts-file\") pod \"node-resolver-5hmbj\" (UID: \"2c7030e2-bf92-4317-98ef-a5caa8ecaaa7\") " pod="openshift-dns/node-resolver-5hmbj"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-device-dir\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-run-multus-certs\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415213    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-run-k8s-cni-cncf-io\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415212    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a92dd54-6e84-48b4-a212-dae44ef52544-cni-binary-copy\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmdj7\" (UniqueName: \"kubernetes.io/projected/648659d5-4cd0-42a2-a674-a46a7479565f-kube-api-access-gmdj7\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-modprobe-d\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415272    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-device-dir\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12719e05-c9b1-4af9-b23c-29e28a1e99e5-host-slash\") pod \"iptables-alerter-7lvqz\" (UID: \"12719e05-c9b1-4af9-b23c-29e28a1e99e5\") " pod="openshift-network-operator/iptables-alerter-7lvqz"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415050    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5384830-56ce-4427-a090-d8cd1ba933f0-dbus\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415292    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-socket-dir\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-multus-cni-dir\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-multus-conf-dir\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-cni-netd\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.449921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5384830-56ce-4427-a090-d8cd1ba933f0-kubelet-config\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415390    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d073343-d7d8-4355-b336-8aa922f542da-serviceca\") pod \"node-ca-857pm\" (UID: \"3d073343-d7d8-4355-b336-8aa922f542da\") " pod="openshift-image-registry/node-ca-857pm"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fnrw\" (UniqueName: \"kubernetes.io/projected/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-kube-api-access-2fnrw\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415466    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-multus-cni-dir\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415477    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-host-run-multus-certs\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415487    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-hostroot\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84q84\" (UniqueName: \"kubernetes.io/projected/3d073343-d7d8-4355-b336-8aa922f542da-kube-api-access-84q84\") pod \"node-ca-857pm\" (UID: \"3d073343-d7d8-4355-b336-8aa922f542da\") " pod="openshift-image-registry/node-ca-857pm"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415526    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-host-cni-netd\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415527    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2a92dd54-6e84-48b4-a212-dae44ef52544-multus-daemon-config\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415538    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-tuned\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415551    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-modprobe-d\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415563    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-multus-conf-dir\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415575    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cc8465e-77b7-48a5-9c9f-03264ec77526-agent-certs\") pod \"konnectivity-agent-nd4r9\" (UID: \"0cc8465e-77b7-48a5-9c9f-03264ec77526\") " pod="kube-system/konnectivity-agent-nd4r9"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415596    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12719e05-c9b1-4af9-b23c-29e28a1e99e5-host-slash\") pod \"iptables-alerter-7lvqz\" (UID: \"12719e05-c9b1-4af9-b23c-29e28a1e99e5\") " pod="openshift-network-operator/iptables-alerter-7lvqz"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415644    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2a92dd54-6e84-48b4-a212-dae44ef52544-hostroot\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415651    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5384830-56ce-4427-a090-d8cd1ba933f0-kubelet-config\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/648659d5-4cd0-42a2-a674-a46a7479565f-run-openvswitch\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.415722    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/735ad593-2f87-4697-97d1-ffececf10a85-cni-binary-copy\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.450996 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.417429    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/648659d5-4cd0-42a2-a674-a46a7479565f-ovn-node-metrics-cert\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.417772    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31ea0019-3407-494b-a17a-6786e2a8e48f-tmp\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.417815    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31ea0019-3407-494b-a17a-6786e2a8e48f-etc-tuned\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.417852    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cc8465e-77b7-48a5-9c9f-03264ec77526-agent-certs\") pod \"konnectivity-agent-nd4r9\" (UID: \"0cc8465e-77b7-48a5-9c9f-03264ec77526\") " pod="kube-system/konnectivity-agent-nd4r9"
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.431283    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.440076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4jcj\" (UniqueName: \"kubernetes.io/projected/12719e05-c9b1-4af9-b23c-29e28a1e99e5-kube-api-access-t4jcj\") pod \"iptables-alerter-7lvqz\" (UID: \"12719e05-c9b1-4af9-b23c-29e28a1e99e5\") " pod="openshift-network-operator/iptables-alerter-7lvqz"
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.441572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs5mr\" (UniqueName: \"kubernetes.io/projected/2a92dd54-6e84-48b4-a212-dae44ef52544-kube-api-access-zs5mr\") pod \"multus-zf8qc\" (UID: \"2a92dd54-6e84-48b4-a212-dae44ef52544\") " pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.443858    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm7qf\" (UniqueName: \"kubernetes.io/projected/2c7030e2-bf92-4317-98ef-a5caa8ecaaa7-kube-api-access-mm7qf\") pod \"node-resolver-5hmbj\" (UID: \"2c7030e2-bf92-4317-98ef-a5caa8ecaaa7\") " pod="openshift-dns/node-resolver-5hmbj"
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.444765    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.444786    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.444797    2581 projected.go:196] Error preparing data for projected volume kube-api-access-bzdzm for pod openshift-network-diagnostics/network-check-target-f8nw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.444849    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm podName:6aab3e1e-de27-4522-adfe-86f01ef40d19 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:40.94483529 +0000 UTC m=+2.091516025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bzdzm" (UniqueName: "kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm") pod "network-check-target-f8nw2" (UID: "6aab3e1e-de27-4522-adfe-86f01ef40d19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.445612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmdj7\" (UniqueName: \"kubernetes.io/projected/648659d5-4cd0-42a2-a674-a46a7479565f-kube-api-access-gmdj7\") pod \"ovnkube-node-dj6k9\" (UID: \"648659d5-4cd0-42a2-a674-a46a7479565f\") " pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.446634    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9h27\" (UniqueName: \"kubernetes.io/projected/735ad593-2f87-4697-97d1-ffececf10a85-kube-api-access-s9h27\") pod \"multus-additional-cni-plugins-njjqk\" (UID: \"735ad593-2f87-4697-97d1-ffececf10a85\") " pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.446845    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84q84\" (UniqueName: \"kubernetes.io/projected/3d073343-d7d8-4355-b336-8aa922f542da-kube-api-access-84q84\") pod \"node-ca-857pm\" (UID: \"3d073343-d7d8-4355-b336-8aa922f542da\") " pod="openshift-image-registry/node-ca-857pm"
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.447539    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx2h6\" (UniqueName: \"kubernetes.io/projected/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-kube-api-access-fx2h6\") pod \"network-metrics-daemon-pplz5\" (UID: \"b7806d08-47f3-4fd8-beb2-e0f052c0be1b\") " pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.447787    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxjxz\" (UniqueName: \"kubernetes.io/projected/31ea0019-3407-494b-a17a-6786e2a8e48f-kube-api-access-wxjxz\") pod \"tuned-qcw9r\" (UID: \"31ea0019-3407-494b-a17a-6786e2a8e48f\") " pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:40.451740 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.448530    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fnrw\" (UniqueName: \"kubernetes.io/projected/d5a4d33e-6261-4ff6-ac23-a9d85fbe7388-kube-api-access-2fnrw\") pod \"aws-ebs-csi-driver-node-852ms\" (UID: \"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:40.554401 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.551863    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zf8qc"
Jul 15 14:30:40.560374 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.559715    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-njjqk"
Jul 15 14:30:40.965023 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.919356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs\") pod \"network-metrics-daemon-pplz5\" (UID: \"b7806d08-47f3-4fd8-beb2-e0f052c0be1b\") " pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:40.965023 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:40.919384    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:40.965023 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.919494    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:40.965023 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.919547    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret podName:f5384830-56ce-4427-a090-d8cd1ba933f0 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:41.919533329 +0000 UTC m=+3.066214062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret") pod "global-pull-secret-syncer-2kgfr" (UID: "f5384830-56ce-4427-a090-d8cd1ba933f0") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:40.965023 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.919494    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:40.965023 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:40.919581    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs podName:b7806d08-47f3-4fd8-beb2-e0f052c0be1b nodeName:}" failed. No retries permitted until 2026-07-15 14:30:41.919572011 +0000 UTC m=+3.066252747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs") pod "network-metrics-daemon-pplz5" (UID: "b7806d08-47f3-4fd8-beb2-e0f052c0be1b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:41.077766 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.020366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzdzm\" (UniqueName: \"kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm\") pod \"network-check-target-f8nw2\" (UID: \"6aab3e1e-de27-4522-adfe-86f01ef40d19\") " pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:41.077766 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:41.020506    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:30:41.077766 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:41.020519    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:30:41.077766 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:41.020527    2581 projected.go:196] Error preparing data for projected volume kube-api-access-bzdzm for pod openshift-network-diagnostics/network-check-target-f8nw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:41.077766 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:41.020567    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm podName:6aab3e1e-de27-4522-adfe-86f01ef40d19 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:42.020556072 +0000 UTC m=+3.167236806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzdzm" (UniqueName: "kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm") pod "network-check-target-f8nw2" (UID: "6aab3e1e-de27-4522-adfe-86f01ef40d19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:41.288610 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.254963    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 14:25:40 +0000 UTC" deadline="2028-03-03 00:35:32.134065829 +0000 UTC"
Jul 15 14:30:41.288610 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.254992    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14314h4m50.879076378s"
Jul 15 14:30:41.460868 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.460181    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:30:41.462634 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.462570    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:30:41.476264 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.476244    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7lvqz"
Jul 15 14:30:41.493666 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.493646    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms"
Jul 15 14:30:41.511753 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:41.511702    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a4d33e_6261_4ff6_ac23_a9d85fbe7388.slice/crio-433966e5afe3e79730069c7d7a5422bf2864c06eec0fcfa492e6f5ce7d45320f WatchSource:0}: Error finding container 433966e5afe3e79730069c7d7a5422bf2864c06eec0fcfa492e6f5ce7d45320f: Status 404 returned error can't find the container with id 433966e5afe3e79730069c7d7a5422bf2864c06eec0fcfa492e6f5ce7d45320f
Jul 15 14:30:41.512433 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:41.512407    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7519191ca94ca8a3e6baaf4a6b48fb3.slice/crio-88921f5789cff64037717a6c066c600461566c8f5e1fbd18276cb407a7eaa045 WatchSource:0}: Error finding container 88921f5789cff64037717a6c066c600461566c8f5e1fbd18276cb407a7eaa045: Status 404 returned error can't find the container with id 88921f5789cff64037717a6c066c600461566c8f5e1fbd18276cb407a7eaa045
Jul 15 14:30:41.513002 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:41.512981    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f8f53af122be6d892057d1be7162858.slice/crio-95263fcc373b3cb01ff0e8da0c3df6dd0af845c47a8bfe3f3737c213448a13d3 WatchSource:0}: Error finding container 95263fcc373b3cb01ff0e8da0c3df6dd0af845c47a8bfe3f3737c213448a13d3: Status 404 returned error can't find the container with id 95263fcc373b3cb01ff0e8da0c3df6dd0af845c47a8bfe3f3737c213448a13d3
Jul 15 14:30:41.516500 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.516484    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 14:30:41.521860 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.521843    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-857pm"
Jul 15 14:30:41.527695 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.527677    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qcw9r"
Jul 15 14:30:41.529453 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:41.529434    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d073343_d7d8_4355_b336_8aa922f542da.slice/crio-8137893de345a18d2eb1a3b2dc8b2ae8dd6951456f94d672f4a5bacb1dac9a2d WatchSource:0}: Error finding container 8137893de345a18d2eb1a3b2dc8b2ae8dd6951456f94d672f4a5bacb1dac9a2d: Status 404 returned error can't find the container with id 8137893de345a18d2eb1a3b2dc8b2ae8dd6951456f94d672f4a5bacb1dac9a2d
Jul 15 14:30:41.535184 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:41.534983    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ea0019_3407_494b_a17a_6786e2a8e48f.slice/crio-94d228e12bf60d04f2b155f2a7506005cea65bf019ef3a8f479d4714849bc460 WatchSource:0}: Error finding container 94d228e12bf60d04f2b155f2a7506005cea65bf019ef3a8f479d4714849bc460: Status 404 returned error can't find the container with id 94d228e12bf60d04f2b155f2a7506005cea65bf019ef3a8f479d4714849bc460
Jul 15 14:30:41.535184 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.535090    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5hmbj"
Jul 15 14:30:41.540240 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.540225    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nd4r9"
Jul 15 14:30:41.542879 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:41.542862    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c7030e2_bf92_4317_98ef_a5caa8ecaaa7.slice/crio-465e01a247a07f2a79325b4de768d0e45147f099738ad2d5271762a21ceba12c WatchSource:0}: Error finding container 465e01a247a07f2a79325b4de768d0e45147f099738ad2d5271762a21ceba12c: Status 404 returned error can't find the container with id 465e01a247a07f2a79325b4de768d0e45147f099738ad2d5271762a21ceba12c
Jul 15 14:30:41.547308 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:41.547279    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc8465e_77b7_48a5_9c9f_03264ec77526.slice/crio-13f52137c992806da1187fc50f6ba203cb41ebdf8d6a8e557f8b4ae54b3c30dd WatchSource:0}: Error finding container 13f52137c992806da1187fc50f6ba203cb41ebdf8d6a8e557f8b4ae54b3c30dd: Status 404 returned error can't find the container with id 13f52137c992806da1187fc50f6ba203cb41ebdf8d6a8e557f8b4ae54b3c30dd
Jul 15 14:30:41.670352 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.670322    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:30:41.832339 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:41.832314    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a92dd54_6e84_48b4_a212_dae44ef52544.slice/crio-215350bec834304f408ef4930b69f052d14d028c8a7fc17d29aa807287f507e0 WatchSource:0}: Error finding container 215350bec834304f408ef4930b69f052d14d028c8a7fc17d29aa807287f507e0: Status 404 returned error can't find the container with id 215350bec834304f408ef4930b69f052d14d028c8a7fc17d29aa807287f507e0
Jul 15 14:30:41.844432 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:41.844407    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12719e05_c9b1_4af9_b23c_29e28a1e99e5.slice/crio-851671ca8b2296a78b6b09a74e8dc0611325a72fcbce4c2b94a106c86a3c3198 WatchSource:0}: Error finding container 851671ca8b2296a78b6b09a74e8dc0611325a72fcbce4c2b94a106c86a3c3198: Status 404 returned error can't find the container with id 851671ca8b2296a78b6b09a74e8dc0611325a72fcbce4c2b94a106c86a3c3198
Jul 15 14:30:41.896031 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:41.896008    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648659d5_4cd0_42a2_a674_a46a7479565f.slice/crio-0b8226bba20d38cd837e8286d3729289d93ec4904b999a40d450dca43f0185ae WatchSource:0}: Error finding container 0b8226bba20d38cd837e8286d3729289d93ec4904b999a40d450dca43f0185ae: Status 404 returned error can't find the container with id 0b8226bba20d38cd837e8286d3729289d93ec4904b999a40d450dca43f0185ae
Jul 15 14:30:41.926935 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.926914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs\") pod \"network-metrics-daemon-pplz5\" (UID: \"b7806d08-47f3-4fd8-beb2-e0f052c0be1b\") " pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:41.927059 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.926942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:41.927059 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:41.927034    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:41.927212 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:41.927068    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:41.927212 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:41.927074    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret podName:f5384830-56ce-4427-a090-d8cd1ba933f0 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:43.927063204 +0000 UTC m=+5.073743938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret") pod "global-pull-secret-syncer-2kgfr" (UID: "f5384830-56ce-4427-a090-d8cd1ba933f0") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:41.927212 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:41.927135    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs podName:b7806d08-47f3-4fd8-beb2-e0f052c0be1b nodeName:}" failed. No retries permitted until 2026-07-15 14:30:43.927118151 +0000 UTC m=+5.073798892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs") pod "network-metrics-daemon-pplz5" (UID: "b7806d08-47f3-4fd8-beb2-e0f052c0be1b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:41.957694 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:30:41.957673    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735ad593_2f87_4697_97d1_ffececf10a85.slice/crio-409d617cf73a1c745ba162583ff64c6f0bf0708dd34e490451fb7556c6919c65 WatchSource:0}: Error finding container 409d617cf73a1c745ba162583ff64c6f0bf0708dd34e490451fb7556c6919c65: Status 404 returned error can't find the container with id 409d617cf73a1c745ba162583ff64c6f0bf0708dd34e490451fb7556c6919c65
Jul 15 14:30:41.988828 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:41.988810    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:30:42.027888 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.027856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzdzm\" (UniqueName: \"kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm\") pod \"network-check-target-f8nw2\" (UID: \"6aab3e1e-de27-4522-adfe-86f01ef40d19\") " pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:42.028075 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:42.028053    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:30:42.028150 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:42.028083    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:30:42.028150 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:42.028096    2581 projected.go:196] Error preparing data for projected volume kube-api-access-bzdzm for pod openshift-network-diagnostics/network-check-target-f8nw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:42.028232 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:42.028159    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm podName:6aab3e1e-de27-4522-adfe-86f01ef40d19 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:44.028138533 +0000 UTC m=+5.174819268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzdzm" (UniqueName: "kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm") pod "network-check-target-f8nw2" (UID: "6aab3e1e-de27-4522-adfe-86f01ef40d19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:42.256267 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.256075    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 14:25:40 +0000 UTC" deadline="2028-01-31 01:26:56.398314919 +0000 UTC"
Jul 15 14:30:42.256267 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.256161    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13546h56m14.142158216s"
Jul 15 14:30:42.374302 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.374260    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:42.374479 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:42.374429    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:30:42.374724 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.374705    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:42.374866 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:42.374844    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:30:42.374947 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.374707    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:42.375001 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:42.374964    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:30:42.382196 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.382093    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-857pm" event={"ID":"3d073343-d7d8-4355-b336-8aa922f542da","Type":"ContainerStarted","Data":"8137893de345a18d2eb1a3b2dc8b2ae8dd6951456f94d672f4a5bacb1dac9a2d"}
Jul 15 14:30:42.386208 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.386105    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms" event={"ID":"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388","Type":"ContainerStarted","Data":"433966e5afe3e79730069c7d7a5422bf2864c06eec0fcfa492e6f5ce7d45320f"}
Jul 15 14:30:42.388354 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.388290    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal" event={"ID":"b7519191ca94ca8a3e6baaf4a6b48fb3","Type":"ContainerStarted","Data":"88921f5789cff64037717a6c066c600461566c8f5e1fbd18276cb407a7eaa045"}
Jul 15 14:30:42.390193 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.390126    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njjqk" event={"ID":"735ad593-2f87-4697-97d1-ffececf10a85","Type":"ContainerStarted","Data":"409d617cf73a1c745ba162583ff64c6f0bf0708dd34e490451fb7556c6919c65"}
Jul 15 14:30:42.394380 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.393577    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7lvqz" event={"ID":"12719e05-c9b1-4af9-b23c-29e28a1e99e5","Type":"ContainerStarted","Data":"851671ca8b2296a78b6b09a74e8dc0611325a72fcbce4c2b94a106c86a3c3198"}
Jul 15 14:30:42.396685 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.396172    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zf8qc" event={"ID":"2a92dd54-6e84-48b4-a212-dae44ef52544","Type":"ContainerStarted","Data":"215350bec834304f408ef4930b69f052d14d028c8a7fc17d29aa807287f507e0"}
Jul 15 14:30:42.398515 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.398493    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5hmbj" event={"ID":"2c7030e2-bf92-4317-98ef-a5caa8ecaaa7","Type":"ContainerStarted","Data":"465e01a247a07f2a79325b4de768d0e45147f099738ad2d5271762a21ceba12c"}
Jul 15 14:30:42.404418 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.404352    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qcw9r" event={"ID":"31ea0019-3407-494b-a17a-6786e2a8e48f","Type":"ContainerStarted","Data":"94d228e12bf60d04f2b155f2a7506005cea65bf019ef3a8f479d4714849bc460"}
Jul 15 14:30:42.410550 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.410523    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-157.ec2.internal" event={"ID":"8f8f53af122be6d892057d1be7162858","Type":"ContainerStarted","Data":"95263fcc373b3cb01ff0e8da0c3df6dd0af845c47a8bfe3f3737c213448a13d3"}
Jul 15 14:30:42.425053 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.425028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9" event={"ID":"648659d5-4cd0-42a2-a674-a46a7479565f","Type":"ContainerStarted","Data":"0b8226bba20d38cd837e8286d3729289d93ec4904b999a40d450dca43f0185ae"}
Jul 15 14:30:42.427233 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:42.427189    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nd4r9" event={"ID":"0cc8465e-77b7-48a5-9c9f-03264ec77526","Type":"ContainerStarted","Data":"13f52137c992806da1187fc50f6ba203cb41ebdf8d6a8e557f8b4ae54b3c30dd"}
Jul 15 14:30:43.944805 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:43.944714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs\") pod \"network-metrics-daemon-pplz5\" (UID: \"b7806d08-47f3-4fd8-beb2-e0f052c0be1b\") " pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:43.944805 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:43.944780    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:43.945303 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:43.944945    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:43.945303 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:43.945001    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret podName:f5384830-56ce-4427-a090-d8cd1ba933f0 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:47.944983259 +0000 UTC m=+9.091663999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret") pod "global-pull-secret-syncer-2kgfr" (UID: "f5384830-56ce-4427-a090-d8cd1ba933f0") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:43.945431 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:43.945369    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:43.945431 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:43.945416    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs podName:b7806d08-47f3-4fd8-beb2-e0f052c0be1b nodeName:}" failed. No retries permitted until 2026-07-15 14:30:47.945401268 +0000 UTC m=+9.092082007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs") pod "network-metrics-daemon-pplz5" (UID: "b7806d08-47f3-4fd8-beb2-e0f052c0be1b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:44.045645 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:44.045610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzdzm\" (UniqueName: \"kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm\") pod \"network-check-target-f8nw2\" (UID: \"6aab3e1e-de27-4522-adfe-86f01ef40d19\") " pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:44.045874 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:44.045849    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:30:44.045874 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:44.045874    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:30:44.046012 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:44.045886    2581 projected.go:196] Error preparing data for projected volume kube-api-access-bzdzm for pod openshift-network-diagnostics/network-check-target-f8nw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:44.046012 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:44.045940    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm podName:6aab3e1e-de27-4522-adfe-86f01ef40d19 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:48.045922832 +0000 UTC m=+9.192603566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzdzm" (UniqueName: "kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm") pod "network-check-target-f8nw2" (UID: "6aab3e1e-de27-4522-adfe-86f01ef40d19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:44.374589 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:44.374514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:44.374770 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:44.374640    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:30:44.374770 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:44.374699    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:44.374934 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:44.374870    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:30:44.375000 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:44.374934    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:44.375055 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:44.375017    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:30:46.374760 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:46.374715    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:46.375286 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:46.374854    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:30:46.375286 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:46.375237    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:46.375414 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:46.375384    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:30:46.375465 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:46.375447    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:46.375554 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:46.375533    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:30:47.977342 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:47.977200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs\") pod \"network-metrics-daemon-pplz5\" (UID: \"b7806d08-47f3-4fd8-beb2-e0f052c0be1b\") " pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:47.977342 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:47.977257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:47.977898 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:47.977385    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:47.977898 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:47.977427    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:47.977898 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:47.977485    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs podName:b7806d08-47f3-4fd8-beb2-e0f052c0be1b nodeName:}" failed. No retries permitted until 2026-07-15 14:30:55.977461764 +0000 UTC m=+17.124142508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs") pod "network-metrics-daemon-pplz5" (UID: "b7806d08-47f3-4fd8-beb2-e0f052c0be1b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:47.977898 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:47.977506    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret podName:f5384830-56ce-4427-a090-d8cd1ba933f0 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:55.977495496 +0000 UTC m=+17.124176235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret") pod "global-pull-secret-syncer-2kgfr" (UID: "f5384830-56ce-4427-a090-d8cd1ba933f0") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:48.078434 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:48.078328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzdzm\" (UniqueName: \"kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm\") pod \"network-check-target-f8nw2\" (UID: \"6aab3e1e-de27-4522-adfe-86f01ef40d19\") " pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:48.078615 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:48.078482    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:30:48.078615 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:48.078502    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:30:48.078615 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:48.078516    2581 projected.go:196] Error preparing data for projected volume kube-api-access-bzdzm for pod openshift-network-diagnostics/network-check-target-f8nw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:48.078615 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:48.078577    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm podName:6aab3e1e-de27-4522-adfe-86f01ef40d19 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:56.078558706 +0000 UTC m=+17.225239454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzdzm" (UniqueName: "kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm") pod "network-check-target-f8nw2" (UID: "6aab3e1e-de27-4522-adfe-86f01ef40d19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:48.375163 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:48.375093    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:48.375302 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:48.375227    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:30:48.375595 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:48.375578    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:48.375668 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:48.375051    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:48.375725 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:48.375684    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:30:48.375804 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:48.375774    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:30:50.375223 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:50.375183    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:50.375653 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:50.375303    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:30:50.375653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:50.375361    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:50.375653 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:50.375435    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:30:50.375653 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:50.375483    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:50.375653 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:50.375561    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:30:52.374591 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:52.374556    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:52.374591 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:52.374585    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:52.374997 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:52.374574    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:52.374997 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:52.374688    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:30:52.374997 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:52.374817    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:30:52.374997 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:52.374892    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:30:54.374803 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:54.374768    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:54.374803 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:54.374799    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:54.375268 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:54.374900    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:30:54.375268 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:54.374995    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:30:54.375268 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:54.375049    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:54.375268 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:54.375121    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:30:56.039716 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:56.039676    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs\") pod \"network-metrics-daemon-pplz5\" (UID: \"b7806d08-47f3-4fd8-beb2-e0f052c0be1b\") " pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:56.039716 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:56.039726    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:56.040290 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:56.039848    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:56.040290 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:56.039858    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:56.040290 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:56.039917    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret podName:f5384830-56ce-4427-a090-d8cd1ba933f0 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:12.039897132 +0000 UTC m=+33.186577870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret") pod "global-pull-secret-syncer-2kgfr" (UID: "f5384830-56ce-4427-a090-d8cd1ba933f0") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:56.040290 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:56.039936    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs podName:b7806d08-47f3-4fd8-beb2-e0f052c0be1b nodeName:}" failed. No retries permitted until 2026-07-15 14:31:12.039926403 +0000 UTC m=+33.186607144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs") pod "network-metrics-daemon-pplz5" (UID: "b7806d08-47f3-4fd8-beb2-e0f052c0be1b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:56.140220 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:56.140190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzdzm\" (UniqueName: \"kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm\") pod \"network-check-target-f8nw2\" (UID: \"6aab3e1e-de27-4522-adfe-86f01ef40d19\") " pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:56.140406 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:56.140342    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:30:56.140406 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:56.140361    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:30:56.140406 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:56.140371    2581 projected.go:196] Error preparing data for projected volume kube-api-access-bzdzm for pod openshift-network-diagnostics/network-check-target-f8nw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:56.140557 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:56.140431    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm podName:6aab3e1e-de27-4522-adfe-86f01ef40d19 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:12.140415592 +0000 UTC m=+33.287096345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzdzm" (UniqueName: "kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm") pod "network-check-target-f8nw2" (UID: "6aab3e1e-de27-4522-adfe-86f01ef40d19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:56.374411 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:56.374324    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:56.374558 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:56.374443    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:56.374627 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:56.374446    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:56.374675 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:56.374442    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:30:56.374675 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:56.374552    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:30:56.374764 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:56.374663    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:30:58.374237 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:58.374206    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:30:58.374679 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:58.374206    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:30:58.374679 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:58.374332    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:30:58.374679 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:30:58.374206    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:30:58.374679 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:58.374426    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:30:58.374679 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:30:58.374479    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:31:00.375206 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:00.375166    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:31:00.375569 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:00.375166    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:00.375569 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:00.375278    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:31:00.375569 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:00.375169    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:31:00.375569 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:00.375341    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:31:00.375569 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:00.375406    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:31:02.375141 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:02.374915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:02.375635 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:02.375221    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:31:02.375635 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:02.374955    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:31:02.375635 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:02.374916    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:31:02.375635 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:02.375324    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:31:02.375635 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:02.375391    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:31:02.468601 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:02.468575    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:31:02.469116 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:02.469078    2581 generic.go:356] "Generic (PLEG): container finished" podID="648659d5-4cd0-42a2-a674-a46a7479565f" containerID="6902e69dd1c62b2da17c4db542964774251f537006b54ecae5cd28a8f7245928" exitCode=1
Jul 15 14:31:02.469205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:02.469185    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9" event={"ID":"648659d5-4cd0-42a2-a674-a46a7479565f","Type":"ContainerDied","Data":"6902e69dd1c62b2da17c4db542964774251f537006b54ecae5cd28a8f7245928"}
Jul 15 14:31:02.469328 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:02.469308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9" event={"ID":"648659d5-4cd0-42a2-a674-a46a7479565f","Type":"ContainerStarted","Data":"9221813c4e2f57cc45811873d2adc6eaf99208f88f47134ca0209f367c4357c5"}
Jul 15 14:31:02.472089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:02.472052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zf8qc" event={"ID":"2a92dd54-6e84-48b4-a212-dae44ef52544","Type":"ContainerStarted","Data":"877e0bc1c473f8e900c8f8116c321aeaa650d3e8cdfa45db50b16e65323987b2"}
Jul 15 14:31:02.474864 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:02.474836    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qcw9r" event={"ID":"31ea0019-3407-494b-a17a-6786e2a8e48f","Type":"ContainerStarted","Data":"a2a4692a573c511e106b542c6f2885162d7e7cb49a1f480c879c7c97a1ec5984"}
Jul 15 14:31:02.476204 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:02.476184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-157.ec2.internal" event={"ID":"8f8f53af122be6d892057d1be7162858","Type":"ContainerStarted","Data":"7d11096579ef686b1d692ba11c0c3678d2471f3dccfb919940b49465c3ffb1b2"}
Jul 15 14:31:02.495076 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:02.495035    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zf8qc" podStartSLOduration=3.072963208 podStartE2EDuration="23.495022391s" totalImagesPullingTime="20.422059183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:02.494441195 +0000 UTC m=+23.641121966" watchObservedRunningTime="2026-07-15 14:31:02.495022391 +0000 UTC m=+23.641703146"
Jul 15 14:31:02.515557 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:02.515330    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qcw9r" podStartSLOduration=2.945291502 podStartE2EDuration="23.515309152s" totalImagesPullingTime="20.57001765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:02.515012071 +0000 UTC m=+23.661692827" watchObservedRunningTime="2026-07-15 14:31:02.515309152 +0000 UTC m=+23.661989909"
Jul 15 14:31:03.481068 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.480883    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:31:03.481681 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.481394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9" event={"ID":"648659d5-4cd0-42a2-a674-a46a7479565f","Type":"ContainerStarted","Data":"0853cfb2b9e00d54d23f05e9c0cdc5a41e7e8f86dd40ae4289034abe39bbbac0"}
Jul 15 14:31:03.481681 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.481466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9" event={"ID":"648659d5-4cd0-42a2-a674-a46a7479565f","Type":"ContainerStarted","Data":"a8db56bec2cdefc0dfeb23231f2bb97a74069dc97d78493a3e14679f178778d0"}
Jul 15 14:31:03.481681 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.481508    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9" event={"ID":"648659d5-4cd0-42a2-a674-a46a7479565f","Type":"ContainerStarted","Data":"4506013db171507e834645b5722f14d07a7b90e326d9a63bf7d76f18b155f6ae"}
Jul 15 14:31:03.481681 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.481543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9" event={"ID":"648659d5-4cd0-42a2-a674-a46a7479565f","Type":"ContainerStarted","Data":"d2f895202121c1048cba5d87c33c317b163de1125079af682737848a52ab17b5"}
Jul 15 14:31:03.482637 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.482619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nd4r9" event={"ID":"0cc8465e-77b7-48a5-9c9f-03264ec77526","Type":"ContainerStarted","Data":"d4f6efe17e5b22540732294b628961690025a14064f7b9db6c9b16e6faf6c675"}
Jul 15 14:31:03.483985 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.483961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-857pm" event={"ID":"3d073343-d7d8-4355-b336-8aa922f542da","Type":"ContainerStarted","Data":"afbed0a6d61a7ca2599cf5bab9015a6086648437eefa0ef908168adfdc31eda4"}
Jul 15 14:31:03.485293 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.485271    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms" event={"ID":"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388","Type":"ContainerStarted","Data":"a1d76fb49f2ff77259b2dc0dd0be56d93b57e3ca6779004bef9271ef86440c44"}
Jul 15 14:31:03.486570 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.486548    2581 generic.go:356] "Generic (PLEG): container finished" podID="b7519191ca94ca8a3e6baaf4a6b48fb3" containerID="394df74047f839fef04b1f7e22a91fa51bb8168525315d67f30dff822a62e8b4" exitCode=0
Jul 15 14:31:03.486662 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.486604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal" event={"ID":"b7519191ca94ca8a3e6baaf4a6b48fb3","Type":"ContainerDied","Data":"394df74047f839fef04b1f7e22a91fa51bb8168525315d67f30dff822a62e8b4"}
Jul 15 14:31:03.491064 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.491045    2581 generic.go:356] "Generic (PLEG): container finished" podID="735ad593-2f87-4697-97d1-ffececf10a85" containerID="c0722e5008da3b95b5a775bf1cddd48f42bc3eb2e57c8404c241f983543445fd" exitCode=0
Jul 15 14:31:03.491137 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.491107    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njjqk" event={"ID":"735ad593-2f87-4697-97d1-ffececf10a85","Type":"ContainerDied","Data":"c0722e5008da3b95b5a775bf1cddd48f42bc3eb2e57c8404c241f983543445fd"}
Jul 15 14:31:03.492461 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.492442    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7lvqz" event={"ID":"12719e05-c9b1-4af9-b23c-29e28a1e99e5","Type":"ContainerStarted","Data":"bedde6d3739396954f42f736668a4902bd03af86c58c4f65eeadb1c487466354"}
Jul 15 14:31:03.493658 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.493633    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5hmbj" event={"ID":"2c7030e2-bf92-4317-98ef-a5caa8ecaaa7","Type":"ContainerStarted","Data":"579956bcf94645a3346eb914a791fdc50eeb316655d1c62c7b4b5756434d6592"}
Jul 15 14:31:03.502291 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.502255    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-157.ec2.internal" podStartSLOduration=23.502244456 podStartE2EDuration="23.502244456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:02.533643776 +0000 UTC m=+23.680324533" watchObservedRunningTime="2026-07-15 14:31:03.502244456 +0000 UTC m=+24.648925212"
Jul 15 14:31:03.521442 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.521411    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-857pm" podStartSLOduration=8.695307044 podStartE2EDuration="24.521398117s" totalImagesPullingTime="15.826091073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:03.521279022 +0000 UTC m=+24.667959778" watchObservedRunningTime="2026-07-15 14:31:03.521398117 +0000 UTC m=+24.668078874"
Jul 15 14:31:03.521743 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.521710    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nd4r9" podStartSLOduration=4.021058938 podStartE2EDuration="24.521705919s" totalImagesPullingTime="20.500646981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:03.502437327 +0000 UTC m=+24.649118094" watchObservedRunningTime="2026-07-15 14:31:03.521705919 +0000 UTC m=+24.668386675"
Jul 15 14:31:03.541067 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.541018    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5hmbj" podStartSLOduration=4.400853761 podStartE2EDuration="24.541003748s" totalImagesPullingTime="20.140149987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:03.5405152 +0000 UTC m=+24.687195977" watchObservedRunningTime="2026-07-15 14:31:03.541003748 +0000 UTC m=+24.687684505"
Jul 15 14:31:03.811934 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:03.811907    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 14:31:04.215964 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:04.215809    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nd4r9"
Jul 15 14:31:04.216305 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:04.216291    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nd4r9"
Jul 15 14:31:04.275527 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:04.275454    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T14:31:03.811928562Z","UUID":"f078d949-0858-4f93-a9bd-ed9bfcfbbc4d","Handler":null,"Name":"","Endpoint":""}
Jul 15 14:31:04.277097 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:04.277082    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 14:31:04.277179 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:04.277122    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 14:31:04.375094 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:04.375067    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:04.375094 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:04.375085    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:31:04.375257 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:04.375067    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:31:04.375257 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:04.375173    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:31:04.375365 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:04.375260    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:31:04.375365 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:04.375332    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:31:04.496831 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:04.496778    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms" event={"ID":"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388","Type":"ContainerStarted","Data":"4e3e6a46ba25f913167aba98424364f8ee7de3489f5b52b6c995932d037eb95e"}
Jul 15 14:31:04.498597 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:04.498570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal" event={"ID":"b7519191ca94ca8a3e6baaf4a6b48fb3","Type":"ContainerStarted","Data":"641e01dbb06cb2f35b76ec8a468bbdcbdf551c0cb442bb74a50d42a29003048c"}
Jul 15 14:31:04.498992 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:04.498974    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nd4r9"
Jul 15 14:31:04.499343 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:04.499328    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nd4r9"
Jul 15 14:31:04.514305 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:04.514258    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-157.ec2.internal" podStartSLOduration=24.514244155 podStartE2EDuration="24.514244155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:04.514175651 +0000 UTC m=+25.660856404" watchObservedRunningTime="2026-07-15 14:31:04.514244155 +0000 UTC m=+25.660924912"
Jul 15 14:31:05.505380 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:05.505349    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:31:05.506021 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:05.505882    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9" event={"ID":"648659d5-4cd0-42a2-a674-a46a7479565f","Type":"ContainerStarted","Data":"aa16354034dce93acc6db21ac38872d719884e941abcc7a2a78515344542f778"}
Jul 15 14:31:06.375099 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:06.375011    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:06.375238 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:06.375136    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:31:06.375238 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:06.375213    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:31:06.375334 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:06.375234    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:31:06.375334 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:06.375317    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:31:06.375425 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:06.375391    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:31:06.510403 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:06.510359    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms" event={"ID":"d5a4d33e-6261-4ff6-ac23-a9d85fbe7388","Type":"ContainerStarted","Data":"eba98c8aaa48ed7872c007143535e9d49cc7c0ee033b1860f9f8d08079e99320"}
Jul 15 14:31:06.534672 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:06.534619    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7lvqz" podStartSLOduration=7.27493467 podStartE2EDuration="27.534598713s" totalImagesPullingTime="20.259664043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:04.544301415 +0000 UTC m=+25.690982172" watchObservedRunningTime="2026-07-15 14:31:06.534598713 +0000 UTC m=+27.681279467"
Jul 15 14:31:06.534843 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:06.534721    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-852ms" podStartSLOduration=3.65074671 podStartE2EDuration="27.534716066s" totalImagesPullingTime="23.883969356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:06.534434832 +0000 UTC m=+27.681115586" watchObservedRunningTime="2026-07-15 14:31:06.534716066 +0000 UTC m=+27.681396821"
Jul 15 14:31:08.374500 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:08.374466    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:08.374977 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:08.374559    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:31:08.374977 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:08.374566    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:31:08.374977 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:08.374641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:31:08.374977 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:08.374648    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:31:08.374977 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:08.374717    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:31:08.522542 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:08.522329    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:31:08.522999 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:08.522896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9" event={"ID":"648659d5-4cd0-42a2-a674-a46a7479565f","Type":"ContainerStarted","Data":"e60c20811fb3666d03e8f8a9baba6fdc7c7880c0cfea966382ee6b1da745af25"}
Jul 15 14:31:08.523341 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:08.523144    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:31:08.523418 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:08.523399    2581 scope.go:117] "RemoveContainer" containerID="6902e69dd1c62b2da17c4db542964774251f537006b54ecae5cd28a8f7245928"
Jul 15 14:31:08.539043 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:08.539001    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:31:09.527237 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:09.527204    2581 generic.go:356] "Generic (PLEG): container finished" podID="735ad593-2f87-4697-97d1-ffececf10a85" containerID="d1cb08a3a274af988a250d5d2d3731d6bde87691f2be279344fcf782284d902c" exitCode=0
Jul 15 14:31:09.527794 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:09.527286    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njjqk" event={"ID":"735ad593-2f87-4697-97d1-ffececf10a85","Type":"ContainerDied","Data":"d1cb08a3a274af988a250d5d2d3731d6bde87691f2be279344fcf782284d902c"}
Jul 15 14:31:09.531174 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:09.531143    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:31:09.531573 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:09.531550    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9" event={"ID":"648659d5-4cd0-42a2-a674-a46a7479565f","Type":"ContainerStarted","Data":"0cfcd13f31a521006b39ed600756d4c330ff2b0168d25f131c0dad4a1321bb63"}
Jul 15 14:31:09.531746 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:09.531713    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:31:09.531839 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:09.531787    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:31:09.547127 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:09.547108    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:31:09.577496 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:09.577451    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9" podStartSLOduration=10.329323611 podStartE2EDuration="30.577439238s" totalImagesPullingTime="20.248115627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:09.577180652 +0000 UTC m=+30.723861427" watchObservedRunningTime="2026-07-15 14:31:09.577439238 +0000 UTC m=+30.724119994"
Jul 15 14:31:10.374626 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:10.374597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:31:10.374790 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:10.374597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:31:10.374790 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:10.374715    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:31:10.374790 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:10.374597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:10.374959 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:10.374811    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:31:10.374959 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:10.374894    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:31:10.535826 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:10.535671    2581 generic.go:356] "Generic (PLEG): container finished" podID="735ad593-2f87-4697-97d1-ffececf10a85" containerID="d38b5ef24b5ee7ce53860ef99a19489e8fbfeefe2859995d53c8b67e72b92a2a" exitCode=0
Jul 15 14:31:10.536189 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:10.535749    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njjqk" event={"ID":"735ad593-2f87-4697-97d1-ffececf10a85","Type":"ContainerDied","Data":"d38b5ef24b5ee7ce53860ef99a19489e8fbfeefe2859995d53c8b67e72b92a2a"}
Jul 15 14:31:10.690002 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:10.689976    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2kgfr"]
Jul 15 14:31:10.690144 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:10.690055    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:31:10.690144 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:10.690130    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:31:10.693237 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:10.693217    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f8nw2"]
Jul 15 14:31:10.693329 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:10.693283    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:10.693493 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:10.693345    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:31:10.698157 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:10.698136    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pplz5"]
Jul 15 14:31:10.698263 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:10.698204    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:31:10.698312 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:10.698281    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:31:12.058352 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:12.058311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs\") pod \"network-metrics-daemon-pplz5\" (UID: \"b7806d08-47f3-4fd8-beb2-e0f052c0be1b\") " pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:31:12.058986 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:12.058662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:31:12.058986 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:12.058681    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:31:12.058986 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:12.058786    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs podName:b7806d08-47f3-4fd8-beb2-e0f052c0be1b nodeName:}" failed. No retries permitted until 2026-07-15 14:31:44.058763704 +0000 UTC m=+65.205444454 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs") pod "network-metrics-daemon-pplz5" (UID: "b7806d08-47f3-4fd8-beb2-e0f052c0be1b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:31:12.058986 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:12.058847    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:31:12.058986 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:12.058906    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret podName:f5384830-56ce-4427-a090-d8cd1ba933f0 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:44.058890415 +0000 UTC m=+65.205571153 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret") pod "global-pull-secret-syncer-2kgfr" (UID: "f5384830-56ce-4427-a090-d8cd1ba933f0") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:31:12.159229 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:12.159199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzdzm\" (UniqueName: \"kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm\") pod \"network-check-target-f8nw2\" (UID: \"6aab3e1e-de27-4522-adfe-86f01ef40d19\") " pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:12.159363 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:12.159316    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:31:12.159363 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:12.159334    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:31:12.159363 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:12.159343    2581 projected.go:196] Error preparing data for projected volume kube-api-access-bzdzm for pod openshift-network-diagnostics/network-check-target-f8nw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:31:12.159467 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:12.159384    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm podName:6aab3e1e-de27-4522-adfe-86f01ef40d19 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:44.159372034 +0000 UTC m=+65.306052769 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzdzm" (UniqueName: "kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm") pod "network-check-target-f8nw2" (UID: "6aab3e1e-de27-4522-adfe-86f01ef40d19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:31:12.374520 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:12.374499    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:31:12.374691 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:12.374499    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:12.374817 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:12.374690    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:31:12.374817 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:12.374769    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:31:12.374817 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:12.374504    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:31:12.374986 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:12.374847    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:31:12.542828 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:12.542800    2581 generic.go:356] "Generic (PLEG): container finished" podID="735ad593-2f87-4697-97d1-ffececf10a85" containerID="6663820dc5178e95a444986ce36975547450906389b69a48ff43ecfb3aa3f4a2" exitCode=0
Jul 15 14:31:12.542946 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:12.542861    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njjqk" event={"ID":"735ad593-2f87-4697-97d1-ffececf10a85","Type":"ContainerDied","Data":"6663820dc5178e95a444986ce36975547450906389b69a48ff43ecfb3aa3f4a2"}
Jul 15 14:31:14.374753 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:14.374711    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:14.375150 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:14.374814    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f8nw2" podUID="6aab3e1e-de27-4522-adfe-86f01ef40d19"
Jul 15 14:31:14.375150 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:14.374890    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:31:14.375150 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:14.374973    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kgfr" podUID="f5384830-56ce-4427-a090-d8cd1ba933f0"
Jul 15 14:31:14.375150 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:14.375062    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:31:14.375350 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:14.375220    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pplz5" podUID="b7806d08-47f3-4fd8-beb2-e0f052c0be1b"
Jul 15 14:31:15.132077 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.132016    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-157.ec2.internal" event="NodeReady"
Jul 15 14:31:15.132320 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.132122    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 14:31:15.169047 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.169018    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"]
Jul 15 14:31:15.171096 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.171013    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:15.176355 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.174564    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-dj7t5"]
Jul 15 14:31:15.177441 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.177417    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 14:31:15.177909 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.177886    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 14:31:15.178028 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.177962    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bbcd4f88f-lp87q"]
Jul 15 14:31:15.178028 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.177974    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 14:31:15.178145 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.178033    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 14:31:15.178145 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.178077    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5dgf6\""
Jul 15 14:31:15.178320 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.178290    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.180023 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.180002    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-566bf9cd7d-9z9sz"]
Jul 15 14:31:15.180131 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.180117    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.182012 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.181986    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"]
Jul 15 14:31:15.182191 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.182165    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.183379 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.183362    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 14:31:15.184019 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.183800    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-vpbs6"]
Jul 15 14:31:15.184230 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.184208    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"
Jul 15 14:31:15.185091 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.185065    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 14:31:15.185519 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.185225    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 14:31:15.185519 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.185298    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 14:31:15.185519 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.185312    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cf6wf\""
Jul 15 14:31:15.185519 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.185315    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 14:31:15.185519 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.185456    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 14:31:15.185519 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.185461    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl"]
Jul 15 14:31:15.185519 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.185457    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 14:31:15.185917 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.185594    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-njxss\""
Jul 15 14:31:15.185917 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.185674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:15.186269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.186249    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 14:31:15.186356 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.186259    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 14:31:15.186401 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.186372    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 14:31:15.186597 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.186584    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z6j7k\""
Jul 15 14:31:15.186857 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.186839    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 14:31:15.187060 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.187037    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 14:31:15.187120 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.187103    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 14:31:15.187297 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.187282    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st"]
Jul 15 14:31:15.187396 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.187383    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl"
Jul 15 14:31:15.188116 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.188096    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 15 14:31:15.188234 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.188218    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:31:15.189043 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.189025    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 15 14:31:15.189043 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.189040    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sjx4f\""
Jul 15 14:31:15.189523 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.189506    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st"
Jul 15 14:31:15.193968 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.193892    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:31:15.193968 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.193910    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 15 14:31:15.194559 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.194542    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 15 14:31:15.194667 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.194574    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 15 14:31:15.195946 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.195926    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9gsq5\""
Jul 15 14:31:15.196084 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.195928    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 15 14:31:15.196273 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.196237    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 15 14:31:15.196466 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.196445    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"]
Jul 15 14:31:15.196545 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.196467    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:31:15.196680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.196661    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 15 14:31:15.196680 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.196675    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6gzbb\""
Jul 15 14:31:15.197354 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.197303    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"]
Jul 15 14:31:15.199270 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.198593    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st"]
Jul 15 14:31:15.201830 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.199356    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 15 14:31:15.201830 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.199452    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h4rhk"]
Jul 15 14:31:15.201830 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.201129    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 15 14:31:15.203210 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.203187    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 15 14:31:15.203724 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.203703    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:31:15.207146 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.207122    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-dj7t5"]
Jul 15 14:31:15.207241 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.207178    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dgwmt"]
Jul 15 14:31:15.208132 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.208111    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h4rhk"
Jul 15 14:31:15.209404 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.209385    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 14:31:15.211961 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.211648    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jpslm\""
Jul 15 14:31:15.211961 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.211699    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 14:31:15.212633 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.212109    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-pm898"]
Jul 15 14:31:15.212953 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.212933    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dgwmt"
Jul 15 14:31:15.214662 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.213840    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:31:15.217984 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.217882    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 15 14:31:15.218546 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.218532    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2gtrs\""
Jul 15 14:31:15.218975 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.218951    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 14:31:15.220342 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.220325    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bbcd4f88f-lp87q"]
Jul 15 14:31:15.220437 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.220352    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-566bf9cd7d-9z9sz"]
Jul 15 14:31:15.220437 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.220366    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl"]
Jul 15 14:31:15.220437 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.220383    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h4rhk"]
Jul 15 14:31:15.220588 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.220445    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pm898"
Jul 15 14:31:15.220755 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.220717    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dgwmt"]
Jul 15 14:31:15.221021 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.221005    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 14:31:15.221706 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.221689    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-pm898"]
Jul 15 14:31:15.222371 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.222210    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 15 14:31:15.222537 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.222525    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z26g2\""
Jul 15 14:31:15.222922 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.222675    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 14:31:15.223243 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.223220    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-vpbs6"]
Jul 15 14:31:15.223443 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.223428    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 14:31:15.223525 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.223452    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 14:31:15.223583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.223527    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fdbl9\""
Jul 15 14:31:15.225698 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.225662    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fmzrb"]
Jul 15 14:31:15.227550 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.227534    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:15.230157 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.230142    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 14:31:15.230776 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.230760    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 14:31:15.230942 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.230925    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ns9wp\""
Jul 15 14:31:15.238103 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.238073    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fmzrb"]
Jul 15 14:31:15.288837 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.288812    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.288927 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.288844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f33ca220-779c-4d54-8c25-51ee1dacd4b8-snapshots\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.288927 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.288869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.289017 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.288938    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdn9h\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-kube-api-access-jdn9h\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.289017 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.288978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c804fc5f-df87-47b4-85a8-28d2c5823350-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8pkvl\" (UID: \"c804fc5f-df87-47b4-85a8-28d2c5823350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl"
Jul 15 14:31:15.289079 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289049    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ce30930-ad00-4d77-9b05-307c3f8d44e0-ca-trust-extracted\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.289125 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289080    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-default-certificate\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.289125 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/61c5ca60-f543-4ebe-82bd-9050c50647af-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:15.289185 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c804fc5f-df87-47b4-85a8-28d2c5823350-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8pkvl\" (UID: \"c804fc5f-df87-47b4-85a8-28d2c5823350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl"
Jul 15 14:31:15.289185 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txvvw\" (UniqueName: \"kubernetes.io/projected/f33ca220-779c-4d54-8c25-51ee1dacd4b8-kube-api-access-txvvw\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.289185 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.289310 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289187    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ce30930-ad00-4d77-9b05-307c3f8d44e0-trusted-ca\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.289310 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289203    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ce30930-ad00-4d77-9b05-307c3f8d44e0-installation-pull-secrets\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.289310 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9fmg\" (UniqueName: \"kubernetes.io/projected/61c5ca60-f543-4ebe-82bd-9050c50647af-kube-api-access-j9fmg\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:15.289310 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzr6l\" (UniqueName: \"kubernetes.io/projected/200cd50f-8b14-46fc-ba12-be63e6e62891-kube-api-access-bzr6l\") pod \"cluster-samples-operator-65db858894-pdf6q\" (UID: \"200cd50f-8b14-46fc-ba12-be63e6e62891\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"
Jul 15 14:31:15.289505 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3513a3d-3146-46f0-99b1-20a0dc6c0298-trusted-ca\") pod \"console-operator-7866497494-vpbs6\" (UID: \"b3513a3d-3146-46f0-99b1-20a0dc6c0298\") " pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:15.289505 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f33ca220-779c-4d54-8c25-51ee1dacd4b8-serving-cert\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.289505 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf7tm\" (UniqueName: \"kubernetes.io/projected/b3513a3d-3146-46f0-99b1-20a0dc6c0298-kube-api-access-zf7tm\") pod \"console-operator-7866497494-vpbs6\" (UID: \"b3513a3d-3146-46f0-99b1-20a0dc6c0298\") " pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:15.289505 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33ca220-779c-4d54-8c25-51ee1dacd4b8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.289505 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3513a3d-3146-46f0-99b1-20a0dc6c0298-serving-cert\") pod \"console-operator-7866497494-vpbs6\" (UID: \"b3513a3d-3146-46f0-99b1-20a0dc6c0298\") " pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:15.289505 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289450    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pdf6q\" (UID: \"200cd50f-8b14-46fc-ba12-be63e6e62891\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"
Jul 15 14:31:15.289505 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-bound-sa-token\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.289801 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289522    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s64br\" (UniqueName: \"kubernetes.io/projected/359f2b4a-a07b-435d-8298-a9261eec0627-kube-api-access-s64br\") pod \"volume-data-source-validator-78495597f6-h4rhk\" (UID: \"359f2b4a-a07b-435d-8298-a9261eec0627\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h4rhk"
Jul 15 14:31:15.289801 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289555    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33ca220-779c-4d54-8c25-51ee1dacd4b8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.289801 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-stats-auth\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.289801 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7r4h\" (UniqueName: \"kubernetes.io/projected/9e2b20d7-9a9b-43d7-81a6-d269bca2df7e-kube-api-access-s7r4h\") pod \"service-ca-operator-7695fc6c8c-fk2st\" (UID: \"9e2b20d7-9a9b-43d7-81a6-d269bca2df7e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st"
Jul 15 14:31:15.289801 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3513a3d-3146-46f0-99b1-20a0dc6c0298-config\") pod \"console-operator-7866497494-vpbs6\" (UID: \"b3513a3d-3146-46f0-99b1-20a0dc6c0298\") " pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:15.289801 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289652    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f33ca220-779c-4d54-8c25-51ee1dacd4b8-tmp\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.289801 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289676    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e2b20d7-9a9b-43d7-81a6-d269bca2df7e-config\") pod \"service-ca-operator-7695fc6c8c-fk2st\" (UID: \"9e2b20d7-9a9b-43d7-81a6-d269bca2df7e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st"
Jul 15 14:31:15.289801 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289702    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-certificates\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.289801 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e2b20d7-9a9b-43d7-81a6-d269bca2df7e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-fk2st\" (UID: \"9e2b20d7-9a9b-43d7-81a6-d269bca2df7e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st"
Jul 15 14:31:15.290052 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289804    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48d7h\" (UniqueName: \"kubernetes.io/projected/c804fc5f-df87-47b4-85a8-28d2c5823350-kube-api-access-48d7h\") pod \"kube-storage-version-migrator-operator-799cb7f958-8pkvl\" (UID: \"c804fc5f-df87-47b4-85a8-28d2c5823350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl"
Jul 15 14:31:15.290052 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289838    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ce30930-ad00-4d77-9b05-307c3f8d44e0-image-registry-private-configuration\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.290052 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6xcq\" (UniqueName: \"kubernetes.io/projected/f171a29b-11e8-4979-b29b-5ee79409c676-kube-api-access-h6xcq\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.290052 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.289871    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:15.390550 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.390489    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33ca220-779c-4d54-8c25-51ee1dacd4b8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.390550 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.390517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3513a3d-3146-46f0-99b1-20a0dc6c0298-serving-cert\") pod \"console-operator-7866497494-vpbs6\" (UID: \"b3513a3d-3146-46f0-99b1-20a0dc6c0298\") " pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:15.390550 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.390535    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pdf6q\" (UID: \"200cd50f-8b14-46fc-ba12-be63e6e62891\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"
Jul 15 14:31:15.391089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.390564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m55xj\" (UniqueName: \"kubernetes.io/projected/a954500d-c43e-4ffd-865c-1a9cb4a93394-kube-api-access-m55xj\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:15.391089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.390591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a954500d-c43e-4ffd-865c-1a9cb4a93394-tmp-dir\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:15.391089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.390623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22491f96-5047-4517-b73e-6982e1367d49-cert\") pod \"ingress-canary-dgwmt\" (UID: \"22491f96-5047-4517-b73e-6982e1367d49\") " pod="openshift-ingress-canary/ingress-canary-dgwmt"
Jul 15 14:31:15.391089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.390665    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r2qx\" (UniqueName: \"kubernetes.io/projected/77c62619-becd-4f33-a062-1a9190052c80-kube-api-access-4r2qx\") pod \"network-check-source-869dcfcdcd-pm898\" (UID: \"77c62619-becd-4f33-a062-1a9190052c80\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pm898"
Jul 15 14:31:15.391089 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.390684    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 14:31:15.391089 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.390763    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls podName:200cd50f-8b14-46fc-ba12-be63e6e62891 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:15.890726038 +0000 UTC m=+37.037406790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls") pod "cluster-samples-operator-65db858894-pdf6q" (UID: "200cd50f-8b14-46fc-ba12-be63e6e62891") : secret "samples-operator-tls" not found
Jul 15 14:31:15.391089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.390689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-bound-sa-token\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.391089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.390917    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s64br\" (UniqueName: \"kubernetes.io/projected/359f2b4a-a07b-435d-8298-a9261eec0627-kube-api-access-s64br\") pod \"volume-data-source-validator-78495597f6-h4rhk\" (UID: \"359f2b4a-a07b-435d-8298-a9261eec0627\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h4rhk"
Jul 15 14:31:15.391089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.390959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33ca220-779c-4d54-8c25-51ee1dacd4b8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.391089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.390983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-stats-auth\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.391089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391013    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7r4h\" (UniqueName: \"kubernetes.io/projected/9e2b20d7-9a9b-43d7-81a6-d269bca2df7e-kube-api-access-s7r4h\") pod \"service-ca-operator-7695fc6c8c-fk2st\" (UID: \"9e2b20d7-9a9b-43d7-81a6-d269bca2df7e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st"
Jul 15 14:31:15.391089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3513a3d-3146-46f0-99b1-20a0dc6c0298-config\") pod \"console-operator-7866497494-vpbs6\" (UID: \"b3513a3d-3146-46f0-99b1-20a0dc6c0298\") " pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:15.391089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4c4z\" (UniqueName: \"kubernetes.io/projected/22491f96-5047-4517-b73e-6982e1367d49-kube-api-access-v4c4z\") pod \"ingress-canary-dgwmt\" (UID: \"22491f96-5047-4517-b73e-6982e1367d49\") " pod="openshift-ingress-canary/ingress-canary-dgwmt"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f33ca220-779c-4d54-8c25-51ee1dacd4b8-tmp\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e2b20d7-9a9b-43d7-81a6-d269bca2df7e-config\") pod \"service-ca-operator-7695fc6c8c-fk2st\" (UID: \"9e2b20d7-9a9b-43d7-81a6-d269bca2df7e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-certificates\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e2b20d7-9a9b-43d7-81a6-d269bca2df7e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-fk2st\" (UID: \"9e2b20d7-9a9b-43d7-81a6-d269bca2df7e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48d7h\" (UniqueName: \"kubernetes.io/projected/c804fc5f-df87-47b4-85a8-28d2c5823350-kube-api-access-48d7h\") pod \"kube-storage-version-migrator-operator-799cb7f958-8pkvl\" (UID: \"c804fc5f-df87-47b4-85a8-28d2c5823350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ce30930-ad00-4d77-9b05-307c3f8d44e0-image-registry-private-configuration\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xcq\" (UniqueName: \"kubernetes.io/projected/f171a29b-11e8-4979-b29b-5ee79409c676-kube-api-access-h6xcq\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391306    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a954500d-c43e-4ffd-865c-1a9cb4a93394-config-volume\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f33ca220-779c-4d54-8c25-51ee1dacd4b8-snapshots\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdn9h\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-kube-api-access-jdn9h\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c804fc5f-df87-47b4-85a8-28d2c5823350-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8pkvl\" (UID: \"c804fc5f-df87-47b4-85a8-28d2c5823350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:15.391697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f33ca220-779c-4d54-8c25-51ee1dacd4b8-tmp\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33ca220-779c-4d54-8c25-51ee1dacd4b8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391525    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ce30930-ad00-4d77-9b05-307c3f8d44e0-ca-trust-extracted\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-default-certificate\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391605    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/61c5ca60-f543-4ebe-82bd-9050c50647af-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c804fc5f-df87-47b4-85a8-28d2c5823350-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8pkvl\" (UID: \"c804fc5f-df87-47b4-85a8-28d2c5823350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txvvw\" (UniqueName: \"kubernetes.io/projected/f33ca220-779c-4d54-8c25-51ee1dacd4b8-kube-api-access-txvvw\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ce30930-ad00-4d77-9b05-307c3f8d44e0-trusted-ca\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ce30930-ad00-4d77-9b05-307c3f8d44e0-installation-pull-secrets\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9fmg\" (UniqueName: \"kubernetes.io/projected/61c5ca60-f543-4ebe-82bd-9050c50647af-kube-api-access-j9fmg\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzr6l\" (UniqueName: \"kubernetes.io/projected/200cd50f-8b14-46fc-ba12-be63e6e62891-kube-api-access-bzr6l\") pod \"cluster-samples-operator-65db858894-pdf6q\" (UID: \"200cd50f-8b14-46fc-ba12-be63e6e62891\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3513a3d-3146-46f0-99b1-20a0dc6c0298-trusted-ca\") pod \"console-operator-7866497494-vpbs6\" (UID: \"b3513a3d-3146-46f0-99b1-20a0dc6c0298\") " pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391851    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f33ca220-779c-4d54-8c25-51ee1dacd4b8-serving-cert\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391877    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ce30930-ad00-4d77-9b05-307c3f8d44e0-ca-trust-extracted\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.392549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.391871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf7tm\" (UniqueName: \"kubernetes.io/projected/b3513a3d-3146-46f0-99b1-20a0dc6c0298-kube-api-access-zf7tm\") pod \"console-operator-7866497494-vpbs6\" (UID: \"b3513a3d-3146-46f0-99b1-20a0dc6c0298\") " pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:15.393275 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.392769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e2b20d7-9a9b-43d7-81a6-d269bca2df7e-config\") pod \"service-ca-operator-7695fc6c8c-fk2st\" (UID: \"9e2b20d7-9a9b-43d7-81a6-d269bca2df7e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st"
Jul 15 14:31:15.393275 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.392912    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-certificates\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.393275 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.392979    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33ca220-779c-4d54-8c25-51ee1dacd4b8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.393502 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.393477    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3513a3d-3146-46f0-99b1-20a0dc6c0298-config\") pod \"console-operator-7866497494-vpbs6\" (UID: \"b3513a3d-3146-46f0-99b1-20a0dc6c0298\") " pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:15.393894 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.393870    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f33ca220-779c-4d54-8c25-51ee1dacd4b8-snapshots\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.394246 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.394224    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 14:31:15.394347 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.394298    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls podName:61c5ca60-f543-4ebe-82bd-9050c50647af nodeName:}" failed. No retries permitted until 2026-07-15 14:31:15.894280205 +0000 UTC m=+37.040960956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vjbl2" (UID: "61c5ca60-f543-4ebe-82bd-9050c50647af") : secret "cluster-monitoring-operator-tls" not found
Jul 15 14:31:15.394421 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.394379    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:31:15.394421 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.394390    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bbcd4f88f-lp87q: secret "image-registry-tls" not found
Jul 15 14:31:15.394527 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.394430    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls podName:8ce30930-ad00-4d77-9b05-307c3f8d44e0 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:15.894418283 +0000 UTC m=+37.041099030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls") pod "image-registry-bbcd4f88f-lp87q" (UID: "8ce30930-ad00-4d77-9b05-307c3f8d44e0") : secret "image-registry-tls" not found
Jul 15 14:31:15.394527 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.394062    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c804fc5f-df87-47b4-85a8-28d2c5823350-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8pkvl\" (UID: \"c804fc5f-df87-47b4-85a8-28d2c5823350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl"
Jul 15 14:31:15.395533 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.394618    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 14:31:15.395533 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.394688    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs podName:f171a29b-11e8-4979-b29b-5ee79409c676 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:15.89467048 +0000 UTC m=+37.041351215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs") pod "router-default-566bf9cd7d-9z9sz" (UID: "f171a29b-11e8-4979-b29b-5ee79409c676") : secret "router-metrics-certs-default" not found
Jul 15 14:31:15.395533 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.395380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ce30930-ad00-4d77-9b05-307c3f8d44e0-trusted-ca\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.396374 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.396246    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle podName:f171a29b-11e8-4979-b29b-5ee79409c676 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:15.89571562 +0000 UTC m=+37.042396375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle") pod "router-default-566bf9cd7d-9z9sz" (UID: "f171a29b-11e8-4979-b29b-5ee79409c676") : configmap references non-existent config key: service-ca.crt
Jul 15 14:31:15.396374 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.396284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e2b20d7-9a9b-43d7-81a6-d269bca2df7e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-fk2st\" (UID: \"9e2b20d7-9a9b-43d7-81a6-d269bca2df7e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st"
Jul 15 14:31:15.396526 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.396484    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3513a3d-3146-46f0-99b1-20a0dc6c0298-serving-cert\") pod \"console-operator-7866497494-vpbs6\" (UID: \"b3513a3d-3146-46f0-99b1-20a0dc6c0298\") " pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:15.397041 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.396996    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-stats-auth\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.400467 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.397471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/61c5ca60-f543-4ebe-82bd-9050c50647af-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:15.400467 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.397984    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3513a3d-3146-46f0-99b1-20a0dc6c0298-trusted-ca\") pod \"console-operator-7866497494-vpbs6\" (UID: \"b3513a3d-3146-46f0-99b1-20a0dc6c0298\") " pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:15.401809 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.401791    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ce30930-ad00-4d77-9b05-307c3f8d44e0-installation-pull-secrets\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.401966 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.401944    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ce30930-ad00-4d77-9b05-307c3f8d44e0-image-registry-private-configuration\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.402301 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.402190    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c804fc5f-df87-47b4-85a8-28d2c5823350-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8pkvl\" (UID: \"c804fc5f-df87-47b4-85a8-28d2c5823350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl"
Jul 15 14:31:15.402895 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.402872    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-default-certificate\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.402973 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.402952    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f33ca220-779c-4d54-8c25-51ee1dacd4b8-serving-cert\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.408349 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.408323    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-bound-sa-token\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.410602 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.410026    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48d7h\" (UniqueName: \"kubernetes.io/projected/c804fc5f-df87-47b4-85a8-28d2c5823350-kube-api-access-48d7h\") pod \"kube-storage-version-migrator-operator-799cb7f958-8pkvl\" (UID: \"c804fc5f-df87-47b4-85a8-28d2c5823350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl"
Jul 15 14:31:15.411210 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.411182    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9fmg\" (UniqueName: \"kubernetes.io/projected/61c5ca60-f543-4ebe-82bd-9050c50647af-kube-api-access-j9fmg\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:15.412628 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.412238    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdn9h\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-kube-api-access-jdn9h\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.412722 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.412663    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7r4h\" (UniqueName: \"kubernetes.io/projected/9e2b20d7-9a9b-43d7-81a6-d269bca2df7e-kube-api-access-s7r4h\") pod \"service-ca-operator-7695fc6c8c-fk2st\" (UID: \"9e2b20d7-9a9b-43d7-81a6-d269bca2df7e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st"
Jul 15 14:31:15.413035 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.412851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzr6l\" (UniqueName: \"kubernetes.io/projected/200cd50f-8b14-46fc-ba12-be63e6e62891-kube-api-access-bzr6l\") pod \"cluster-samples-operator-65db858894-pdf6q\" (UID: \"200cd50f-8b14-46fc-ba12-be63e6e62891\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"
Jul 15 14:31:15.413035 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.412893    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s64br\" (UniqueName: \"kubernetes.io/projected/359f2b4a-a07b-435d-8298-a9261eec0627-kube-api-access-s64br\") pod \"volume-data-source-validator-78495597f6-h4rhk\" (UID: \"359f2b4a-a07b-435d-8298-a9261eec0627\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h4rhk"
Jul 15 14:31:15.413592 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.413553    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6xcq\" (UniqueName: \"kubernetes.io/projected/f171a29b-11e8-4979-b29b-5ee79409c676-kube-api-access-h6xcq\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.414066 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.414003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txvvw\" (UniqueName: \"kubernetes.io/projected/f33ca220-779c-4d54-8c25-51ee1dacd4b8-kube-api-access-txvvw\") pod \"insights-operator-68d9dd94cf-dj7t5\" (UID: \"f33ca220-779c-4d54-8c25-51ee1dacd4b8\") " pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.415514 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.415495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf7tm\" (UniqueName: \"kubernetes.io/projected/b3513a3d-3146-46f0-99b1-20a0dc6c0298-kube-api-access-zf7tm\") pod \"console-operator-7866497494-vpbs6\" (UID: \"b3513a3d-3146-46f0-99b1-20a0dc6c0298\") " pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:15.493592 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.493566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4c4z\" (UniqueName: \"kubernetes.io/projected/22491f96-5047-4517-b73e-6982e1367d49-kube-api-access-v4c4z\") pod \"ingress-canary-dgwmt\" (UID: \"22491f96-5047-4517-b73e-6982e1367d49\") " pod="openshift-ingress-canary/ingress-canary-dgwmt"
Jul 15 14:31:15.493766 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.493616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a954500d-c43e-4ffd-865c-1a9cb4a93394-config-volume\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:15.493766 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.493664    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:15.493766 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.493726    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m55xj\" (UniqueName: \"kubernetes.io/projected/a954500d-c43e-4ffd-865c-1a9cb4a93394-kube-api-access-m55xj\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:15.493992 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.493766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a954500d-c43e-4ffd-865c-1a9cb4a93394-tmp-dir\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:15.493992 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.493790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22491f96-5047-4517-b73e-6982e1367d49-cert\") pod \"ingress-canary-dgwmt\" (UID: \"22491f96-5047-4517-b73e-6982e1367d49\") " pod="openshift-ingress-canary/ingress-canary-dgwmt"
Jul 15 14:31:15.493992 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.493813    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:31:15.493992 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.493828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r2qx\" (UniqueName: \"kubernetes.io/projected/77c62619-becd-4f33-a062-1a9190052c80-kube-api-access-4r2qx\") pod \"network-check-source-869dcfcdcd-pm898\" (UID: \"77c62619-becd-4f33-a062-1a9190052c80\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pm898"
Jul 15 14:31:15.493992 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.493885    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls podName:a954500d-c43e-4ffd-865c-1a9cb4a93394 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:15.993865915 +0000 UTC m=+37.140546668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls") pod "dns-default-fmzrb" (UID: "a954500d-c43e-4ffd-865c-1a9cb4a93394") : secret "dns-default-metrics-tls" not found
Jul 15 14:31:15.494166 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.494149    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a954500d-c43e-4ffd-865c-1a9cb4a93394-tmp-dir\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:15.494288 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.494272    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a954500d-c43e-4ffd-865c-1a9cb4a93394-config-volume\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:15.495936 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.495920    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22491f96-5047-4517-b73e-6982e1367d49-cert\") pod \"ingress-canary-dgwmt\" (UID: \"22491f96-5047-4517-b73e-6982e1367d49\") " pod="openshift-ingress-canary/ingress-canary-dgwmt"
Jul 15 14:31:15.498841 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.498820    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5"
Jul 15 14:31:15.502452 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.502435    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r2qx\" (UniqueName: \"kubernetes.io/projected/77c62619-becd-4f33-a062-1a9190052c80-kube-api-access-4r2qx\") pod \"network-check-source-869dcfcdcd-pm898\" (UID: \"77c62619-becd-4f33-a062-1a9190052c80\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pm898"
Jul 15 14:31:15.502622 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.502604    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m55xj\" (UniqueName: \"kubernetes.io/projected/a954500d-c43e-4ffd-865c-1a9cb4a93394-kube-api-access-m55xj\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:15.503035 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.503007    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4c4z\" (UniqueName: \"kubernetes.io/projected/22491f96-5047-4517-b73e-6982e1367d49-kube-api-access-v4c4z\") pod \"ingress-canary-dgwmt\" (UID: \"22491f96-5047-4517-b73e-6982e1367d49\") " pod="openshift-ingress-canary/ingress-canary-dgwmt"
Jul 15 14:31:15.534820 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.534797    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:15.541482 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.541461    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl"
Jul 15 14:31:15.548439 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.548419    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st"
Jul 15 14:31:15.555822 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.555660    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h4rhk"
Jul 15 14:31:15.562417 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.561406    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dgwmt"
Jul 15 14:31:15.568382 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.568169    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pm898"
Jul 15 14:31:15.732522 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.731211    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-dj7t5"]
Jul 15 14:31:15.770640 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.770560    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-vpbs6"]
Jul 15 14:31:15.783963 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.783896    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl"]
Jul 15 14:31:15.806011 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.805968    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h4rhk"]
Jul 15 14:31:15.810968 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.810947    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-pm898"]
Jul 15 14:31:15.820634 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.820610    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st"]
Jul 15 14:31:15.824696 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.824678    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dgwmt"]
Jul 15 14:31:15.898470 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.898442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:15.898623 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.898482    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:15.898623 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.898510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.898623 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.898608    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 14:31:15.898788 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.898630    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 14:31:15.898788 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.898639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:15.898788 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.898612    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:31:15.898788 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.898673    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls podName:61c5ca60-f543-4ebe-82bd-9050c50647af nodeName:}" failed. No retries permitted until 2026-07-15 14:31:16.898655341 +0000 UTC m=+38.045336093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vjbl2" (UID: "61c5ca60-f543-4ebe-82bd-9050c50647af") : secret "cluster-monitoring-operator-tls" not found
Jul 15 14:31:15.898788 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.898676    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bbcd4f88f-lp87q: secret "image-registry-tls" not found
Jul 15 14:31:15.898788 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.898696    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs podName:f171a29b-11e8-4979-b29b-5ee79409c676 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:16.898685253 +0000 UTC m=+38.045365989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs") pod "router-default-566bf9cd7d-9z9sz" (UID: "f171a29b-11e8-4979-b29b-5ee79409c676") : secret "router-metrics-certs-default" not found
Jul 15 14:31:15.898788 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.898716    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle podName:f171a29b-11e8-4979-b29b-5ee79409c676 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:16.898704229 +0000 UTC m=+38.045384983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle") pod "router-default-566bf9cd7d-9z9sz" (UID: "f171a29b-11e8-4979-b29b-5ee79409c676") : configmap references non-existent config key: service-ca.crt
Jul 15 14:31:15.898788 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.898769    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls podName:8ce30930-ad00-4d77-9b05-307c3f8d44e0 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:16.898749786 +0000 UTC m=+38.045430528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls") pod "image-registry-bbcd4f88f-lp87q" (UID: "8ce30930-ad00-4d77-9b05-307c3f8d44e0") : secret "image-registry-tls" not found
Jul 15 14:31:15.899140 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.898836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pdf6q\" (UID: \"200cd50f-8b14-46fc-ba12-be63e6e62891\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"
Jul 15 14:31:15.899140 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.898938    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 14:31:15.899140 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.898985    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls podName:200cd50f-8b14-46fc-ba12-be63e6e62891 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:16.898973239 +0000 UTC m=+38.045653975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls") pod "cluster-samples-operator-65db858894-pdf6q" (UID: "200cd50f-8b14-46fc-ba12-be63e6e62891") : secret "samples-operator-tls" not found
Jul 15 14:31:15.999670 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:15.999589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:15.999831 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.999772    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:31:15.999831 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:15.999828    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls podName:a954500d-c43e-4ffd-865c-1a9cb4a93394 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:16.999811956 +0000 UTC m=+38.146492693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls") pod "dns-default-fmzrb" (UID: "a954500d-c43e-4ffd-865c-1a9cb4a93394") : secret "dns-default-metrics-tls" not found
Jul 15 14:31:16.374493 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:16.374398    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:16.374493 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:16.374425    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:31:16.374493 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:16.374425    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:31:16.377832 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:16.377807    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 14:31:16.378876 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:16.378700    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 14:31:16.378876 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:16.378726    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cj2n5\""
Jul 15 14:31:16.378876 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:16.378750    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cqtkh\""
Jul 15 14:31:16.907074 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:16.907047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:16.907466 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:16.907089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pdf6q\" (UID: \"200cd50f-8b14-46fc-ba12-be63e6e62891\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"
Jul 15 14:31:16.907466 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:16.907169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:16.907466 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:16.907198    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:16.907466 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:16.907215    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle podName:f171a29b-11e8-4979-b29b-5ee79409c676 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:18.90719634 +0000 UTC m=+40.053877073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle") pod "router-default-566bf9cd7d-9z9sz" (UID: "f171a29b-11e8-4979-b29b-5ee79409c676") : configmap references non-existent config key: service-ca.crt
Jul 15 14:31:16.907466 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:16.907250    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:16.907466 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:16.907269    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:31:16.907466 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:16.907276    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 14:31:16.907466 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:16.907289    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 14:31:16.907466 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:16.907282    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bbcd4f88f-lp87q: secret "image-registry-tls" not found
Jul 15 14:31:16.907466 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:16.907339    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 14:31:16.907466 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:16.907333    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls podName:200cd50f-8b14-46fc-ba12-be63e6e62891 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:18.907316521 +0000 UTC m=+40.053997257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls") pod "cluster-samples-operator-65db858894-pdf6q" (UID: "200cd50f-8b14-46fc-ba12-be63e6e62891") : secret "samples-operator-tls" not found
Jul 15 14:31:16.907466 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:16.907382    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls podName:61c5ca60-f543-4ebe-82bd-9050c50647af nodeName:}" failed. No retries permitted until 2026-07-15 14:31:18.907364524 +0000 UTC m=+40.054045269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vjbl2" (UID: "61c5ca60-f543-4ebe-82bd-9050c50647af") : secret "cluster-monitoring-operator-tls" not found
Jul 15 14:31:16.907466 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:16.907400    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls podName:8ce30930-ad00-4d77-9b05-307c3f8d44e0 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:18.907389335 +0000 UTC m=+40.054070074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls") pod "image-registry-bbcd4f88f-lp87q" (UID: "8ce30930-ad00-4d77-9b05-307c3f8d44e0") : secret "image-registry-tls" not found
Jul 15 14:31:16.907466 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:16.907424    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs podName:f171a29b-11e8-4979-b29b-5ee79409c676 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:18.90741646 +0000 UTC m=+40.054097197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs") pod "router-default-566bf9cd7d-9z9sz" (UID: "f171a29b-11e8-4979-b29b-5ee79409c676") : secret "router-metrics-certs-default" not found
Jul 15 14:31:17.008371 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:17.008340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:17.008520 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:17.008485    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:31:17.008596 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:17.008546    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls podName:a954500d-c43e-4ffd-865c-1a9cb4a93394 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:19.00852909 +0000 UTC m=+40.155209826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls") pod "dns-default-fmzrb" (UID: "a954500d-c43e-4ffd-865c-1a9cb4a93394") : secret "dns-default-metrics-tls" not found
Jul 15 14:31:17.214571 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:17.214536    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22491f96_5047_4517_b73e_6982e1367d49.slice/crio-10c1604b0212af72af75d211ece127540e05659c449ac4e75d131bb9c6585704 WatchSource:0}: Error finding container 10c1604b0212af72af75d211ece127540e05659c449ac4e75d131bb9c6585704: Status 404 returned error can't find the container with id 10c1604b0212af72af75d211ece127540e05659c449ac4e75d131bb9c6585704
Jul 15 14:31:17.215123 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:17.215095    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc804fc5f_df87_47b4_85a8_28d2c5823350.slice/crio-c0374cddfcbba7d403ed59241383601209c21d4c2eb0d3c52067f8bf62f32c01 WatchSource:0}: Error finding container c0374cddfcbba7d403ed59241383601209c21d4c2eb0d3c52067f8bf62f32c01: Status 404 returned error can't find the container with id c0374cddfcbba7d403ed59241383601209c21d4c2eb0d3c52067f8bf62f32c01
Jul 15 14:31:17.216449 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:17.216004    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c62619_becd_4f33_a062_1a9190052c80.slice/crio-95cd0e9bc9497391210c75af6ab0999b558ede3e96172dede45224e5422a0457 WatchSource:0}: Error finding container 95cd0e9bc9497391210c75af6ab0999b558ede3e96172dede45224e5422a0457: Status 404 returned error can't find the container with id 95cd0e9bc9497391210c75af6ab0999b558ede3e96172dede45224e5422a0457
Jul 15 14:31:17.217556 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:17.217126    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359f2b4a_a07b_435d_8298_a9261eec0627.slice/crio-ff40c472dac2ad643a6048922cc24b8bc3bb81afbfef0adf569b44ae3a5d36e9 WatchSource:0}: Error finding container ff40c472dac2ad643a6048922cc24b8bc3bb81afbfef0adf569b44ae3a5d36e9: Status 404 returned error can't find the container with id ff40c472dac2ad643a6048922cc24b8bc3bb81afbfef0adf569b44ae3a5d36e9
Jul 15 14:31:17.218358 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:17.218313    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2b20d7_9a9b_43d7_81a6_d269bca2df7e.slice/crio-107a274ea173d5e3cdc44f8750aa52a282a56089933fa166402b214141eb55c4 WatchSource:0}: Error finding container 107a274ea173d5e3cdc44f8750aa52a282a56089933fa166402b214141eb55c4: Status 404 returned error can't find the container with id 107a274ea173d5e3cdc44f8750aa52a282a56089933fa166402b214141eb55c4
Jul 15 14:31:17.223038 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:17.221694    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3513a3d_3146_46f0_99b1_20a0dc6c0298.slice/crio-eefd8b96c9a3df8f47346577455ba79fae8c7e189917b7388a7e72f0e0cd5f2d WatchSource:0}: Error finding container eefd8b96c9a3df8f47346577455ba79fae8c7e189917b7388a7e72f0e0cd5f2d: Status 404 returned error can't find the container with id eefd8b96c9a3df8f47346577455ba79fae8c7e189917b7388a7e72f0e0cd5f2d
Jul 15 14:31:17.223038 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:17.222228    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf33ca220_779c_4d54_8c25_51ee1dacd4b8.slice/crio-ef103ba6d2163cecc823b03b8a386602bf4d5fb860af6db3dcff1264310bfbff WatchSource:0}: Error finding container ef103ba6d2163cecc823b03b8a386602bf4d5fb860af6db3dcff1264310bfbff: Status 404 returned error can't find the container with id ef103ba6d2163cecc823b03b8a386602bf4d5fb860af6db3dcff1264310bfbff
Jul 15 14:31:17.557001 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:17.556675    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h4rhk" event={"ID":"359f2b4a-a07b-435d-8298-a9261eec0627","Type":"ContainerStarted","Data":"ff40c472dac2ad643a6048922cc24b8bc3bb81afbfef0adf569b44ae3a5d36e9"}
Jul 15 14:31:17.557901 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:17.557874    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st" event={"ID":"9e2b20d7-9a9b-43d7-81a6-d269bca2df7e","Type":"ContainerStarted","Data":"107a274ea173d5e3cdc44f8750aa52a282a56089933fa166402b214141eb55c4"}
Jul 15 14:31:17.558933 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:17.558907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl" event={"ID":"c804fc5f-df87-47b4-85a8-28d2c5823350","Type":"ContainerStarted","Data":"c0374cddfcbba7d403ed59241383601209c21d4c2eb0d3c52067f8bf62f32c01"}
Jul 15 14:31:17.560133 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:17.560110    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vpbs6" event={"ID":"b3513a3d-3146-46f0-99b1-20a0dc6c0298","Type":"ContainerStarted","Data":"eefd8b96c9a3df8f47346577455ba79fae8c7e189917b7388a7e72f0e0cd5f2d"}
Jul 15 14:31:17.561222 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:17.561197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5" event={"ID":"f33ca220-779c-4d54-8c25-51ee1dacd4b8","Type":"ContainerStarted","Data":"ef103ba6d2163cecc823b03b8a386602bf4d5fb860af6db3dcff1264310bfbff"}
Jul 15 14:31:17.562216 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:17.562193    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pm898" event={"ID":"77c62619-becd-4f33-a062-1a9190052c80","Type":"ContainerStarted","Data":"95cd0e9bc9497391210c75af6ab0999b558ede3e96172dede45224e5422a0457"}
Jul 15 14:31:17.563140 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:17.563121    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dgwmt" event={"ID":"22491f96-5047-4517-b73e-6982e1367d49","Type":"ContainerStarted","Data":"10c1604b0212af72af75d211ece127540e05659c449ac4e75d131bb9c6585704"}
Jul 15 14:31:17.565697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:17.565679    2581 generic.go:356] "Generic (PLEG): container finished" podID="735ad593-2f87-4697-97d1-ffececf10a85" containerID="b8139c381742d752d57fc50b6277e345cdc4315c2bcc0bdbfa552df4c1c16276" exitCode=0
Jul 15 14:31:17.565781 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:17.565704    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njjqk" event={"ID":"735ad593-2f87-4697-97d1-ffececf10a85","Type":"ContainerDied","Data":"b8139c381742d752d57fc50b6277e345cdc4315c2bcc0bdbfa552df4c1c16276"}
Jul 15 14:31:18.573743 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:18.573693    2581 generic.go:356] "Generic (PLEG): container finished" podID="735ad593-2f87-4697-97d1-ffececf10a85" containerID="91c41c0da0fe4bac79ac6b67eaadd9bde3e6a944b503305c84e7e4063253902e" exitCode=0
Jul 15 14:31:18.574186 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:18.573799    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njjqk" event={"ID":"735ad593-2f87-4697-97d1-ffececf10a85","Type":"ContainerDied","Data":"91c41c0da0fe4bac79ac6b67eaadd9bde3e6a944b503305c84e7e4063253902e"}
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:18.926334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:18.926400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:18.926429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:18.926492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:18.926538    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pdf6q\" (UID: \"200cd50f-8b14-46fc-ba12-be63e6e62891\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:18.926726    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:18.926882    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls podName:200cd50f-8b14-46fc-ba12-be63e6e62891 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:22.926851539 +0000 UTC m=+44.073532281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls") pod "cluster-samples-operator-65db858894-pdf6q" (UID: "200cd50f-8b14-46fc-ba12-be63e6e62891") : secret "samples-operator-tls" not found
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:18.927301    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:18.927353    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls podName:61c5ca60-f543-4ebe-82bd-9050c50647af nodeName:}" failed. No retries permitted until 2026-07-15 14:31:22.92733775 +0000 UTC m=+44.074018502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vjbl2" (UID: "61c5ca60-f543-4ebe-82bd-9050c50647af") : secret "cluster-monitoring-operator-tls" not found
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:18.927419    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:18.927431    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bbcd4f88f-lp87q: secret "image-registry-tls" not found
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:18.927469    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls podName:8ce30930-ad00-4d77-9b05-307c3f8d44e0 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:22.927454401 +0000 UTC m=+44.074135137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls") pod "image-registry-bbcd4f88f-lp87q" (UID: "8ce30930-ad00-4d77-9b05-307c3f8d44e0") : secret "image-registry-tls" not found
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:18.927526    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:18.927564    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs podName:f171a29b-11e8-4979-b29b-5ee79409c676 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:22.927553206 +0000 UTC m=+44.074233940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs") pod "router-default-566bf9cd7d-9z9sz" (UID: "f171a29b-11e8-4979-b29b-5ee79409c676") : secret "router-metrics-certs-default" not found
Jul 15 14:31:18.927674 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:18.927629    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle podName:f171a29b-11e8-4979-b29b-5ee79409c676 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:22.927618618 +0000 UTC m=+44.074299358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle") pod "router-default-566bf9cd7d-9z9sz" (UID: "f171a29b-11e8-4979-b29b-5ee79409c676") : configmap references non-existent config key: service-ca.crt
Jul 15 14:31:19.027936 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:19.027710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:19.027936 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:19.027878    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:31:19.028166 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:19.028003    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls podName:a954500d-c43e-4ffd-865c-1a9cb4a93394 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:23.027982121 +0000 UTC m=+44.174662854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls") pod "dns-default-fmzrb" (UID: "a954500d-c43e-4ffd-865c-1a9cb4a93394") : secret "dns-default-metrics-tls" not found
Jul 15 14:31:19.582375 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:19.582335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njjqk" event={"ID":"735ad593-2f87-4697-97d1-ffececf10a85","Type":"ContainerStarted","Data":"acd12fcf632b9e9fdfaf7b5658011ecb56c159a3377877414f48b74d35f3ce27"}
Jul 15 14:31:19.617825 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:19.617757    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-njjqk" podStartSLOduration=7.952424337 podStartE2EDuration="40.617717684s" totalImagesPullingTime="32.665293347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:19.616142965 +0000 UTC m=+40.762823741" watchObservedRunningTime="2026-07-15 14:31:19.617717684 +0000 UTC m=+40.764398442"
Jul 15 14:31:22.965252 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:22.965220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:22.965873 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:22.965261    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:22.965873 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:22.965281    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:22.965873 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:22.965334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:22.965873 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:22.965380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pdf6q\" (UID: \"200cd50f-8b14-46fc-ba12-be63e6e62891\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"
Jul 15 14:31:22.965873 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:22.965394    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 14:31:22.965873 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:22.965450    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 14:31:22.965873 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:22.965398    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:31:22.965873 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:22.965485    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bbcd4f88f-lp87q: secret "image-registry-tls" not found
Jul 15 14:31:22.965873 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:22.965472    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls podName:61c5ca60-f543-4ebe-82bd-9050c50647af nodeName:}" failed. No retries permitted until 2026-07-15 14:31:30.965450125 +0000 UTC m=+52.112130895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vjbl2" (UID: "61c5ca60-f543-4ebe-82bd-9050c50647af") : secret "cluster-monitoring-operator-tls" not found
Jul 15 14:31:22.965873 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:22.965515    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 14:31:22.965873 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:22.965523    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls podName:8ce30930-ad00-4d77-9b05-307c3f8d44e0 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:30.965507052 +0000 UTC m=+52.112187791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls") pod "image-registry-bbcd4f88f-lp87q" (UID: "8ce30930-ad00-4d77-9b05-307c3f8d44e0") : secret "image-registry-tls" not found
Jul 15 14:31:22.965873 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:22.965575    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle podName:f171a29b-11e8-4979-b29b-5ee79409c676 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:30.965564213 +0000 UTC m=+52.112244948 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle") pod "router-default-566bf9cd7d-9z9sz" (UID: "f171a29b-11e8-4979-b29b-5ee79409c676") : configmap references non-existent config key: service-ca.crt
Jul 15 14:31:22.965873 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:22.965592    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs podName:f171a29b-11e8-4979-b29b-5ee79409c676 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:30.965586488 +0000 UTC m=+52.112267222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs") pod "router-default-566bf9cd7d-9z9sz" (UID: "f171a29b-11e8-4979-b29b-5ee79409c676") : secret "router-metrics-certs-default" not found
Jul 15 14:31:22.965873 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:22.965610    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls podName:200cd50f-8b14-46fc-ba12-be63e6e62891 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:30.965602005 +0000 UTC m=+52.112282738 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls") pod "cluster-samples-operator-65db858894-pdf6q" (UID: "200cd50f-8b14-46fc-ba12-be63e6e62891") : secret "samples-operator-tls" not found
Jul 15 14:31:23.066589 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:23.066560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:23.066775 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:23.066720    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:31:23.066834 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:23.066786    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls podName:a954500d-c43e-4ffd-865c-1a9cb4a93394 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:31.066771343 +0000 UTC m=+52.213452095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls") pod "dns-default-fmzrb" (UID: "a954500d-c43e-4ffd-865c-1a9cb4a93394") : secret "dns-default-metrics-tls" not found
Jul 15 14:31:25.601523 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.600755    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pm898" event={"ID":"77c62619-becd-4f33-a062-1a9190052c80","Type":"ContainerStarted","Data":"8d5cacff6fb839b0a8ebc4a3e6cab7a221643746eb472ae21215cf8f44f25c7d"}
Jul 15 14:31:25.603693 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.603337    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dgwmt" event={"ID":"22491f96-5047-4517-b73e-6982e1367d49","Type":"ContainerStarted","Data":"02612585fe90c5c393dc7ae088ea52f89347112ca40f9ce362cb1ea294b1df7c"}
Jul 15 14:31:25.604984 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.604958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h4rhk" event={"ID":"359f2b4a-a07b-435d-8298-a9261eec0627","Type":"ContainerStarted","Data":"4c94dac91dc32405a1e72562a9a9d9e49cc789867ea7a9c9b4fc1f5631bf2ef1"}
Jul 15 14:31:25.606848 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.606800    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st" event={"ID":"9e2b20d7-9a9b-43d7-81a6-d269bca2df7e","Type":"ContainerStarted","Data":"a3a93b73aac1bb6056b410aad28e9955e7475cfc5782a0252c8dfc62679f2b8d"}
Jul 15 14:31:25.608625 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.608603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl" event={"ID":"c804fc5f-df87-47b4-85a8-28d2c5823350","Type":"ContainerStarted","Data":"65bab1c2225ef9dcd28af4912be27712868513aca28436511ecbe840b5136a25"}
Jul 15 14:31:25.610545 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.610398    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/0.log"
Jul 15 14:31:25.610545 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.610431    2581 generic.go:356] "Generic (PLEG): container finished" podID="b3513a3d-3146-46f0-99b1-20a0dc6c0298" containerID="c33eaa5607d4d195f2f02f235356327d6533e45ab816fba6d1576176026e3672" exitCode=255
Jul 15 14:31:25.610545 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.610502    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vpbs6" event={"ID":"b3513a3d-3146-46f0-99b1-20a0dc6c0298","Type":"ContainerDied","Data":"c33eaa5607d4d195f2f02f235356327d6533e45ab816fba6d1576176026e3672"}
Jul 15 14:31:25.610765 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.610656    2581 scope.go:117] "RemoveContainer" containerID="c33eaa5607d4d195f2f02f235356327d6533e45ab816fba6d1576176026e3672"
Jul 15 14:31:25.612489 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.612465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5" event={"ID":"f33ca220-779c-4d54-8c25-51ee1dacd4b8","Type":"ContainerStarted","Data":"00769954bc22ef64c90ecad3fc02633a8f7b1a981b8d1f8cd34f3079d89e1f34"}
Jul 15 14:31:25.631585 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.630450    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pm898" podStartSLOduration=18.560387301 podStartE2EDuration="26.63043374s" totalImagesPullingTime="8.070046439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:25.626783704 +0000 UTC m=+46.773464486" watchObservedRunningTime="2026-07-15 14:31:25.63043374 +0000 UTC m=+46.777114494"
Jul 15 14:31:25.672425 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.671957    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl" podStartSLOduration=22.612077755 podStartE2EDuration="30.671938204s" totalImagesPullingTime="8.059860449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:25.67036785 +0000 UTC m=+46.817048623" watchObservedRunningTime="2026-07-15 14:31:25.671938204 +0000 UTC m=+46.818618957"
Jul 15 14:31:25.712573 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.712512    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h4rhk" podStartSLOduration=22.655588775 podStartE2EDuration="30.712493817s" totalImagesPullingTime="8.056905042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:25.69109477 +0000 UTC m=+46.837775527" watchObservedRunningTime="2026-07-15 14:31:25.712493817 +0000 UTC m=+46.859174571"
Jul 15 14:31:25.713172 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.713127    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dgwmt" podStartSLOduration=2.652477767 podStartE2EDuration="10.713117377s" totalImagesPullingTime="8.06063961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:25.712328912 +0000 UTC m=+46.859009668" watchObservedRunningTime="2026-07-15 14:31:25.713117377 +0000 UTC m=+46.859798112"
Jul 15 14:31:25.741102 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.741051    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5" podStartSLOduration=22.689534734 podStartE2EDuration="30.741019934s" totalImagesPullingTime="8.0514852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:25.738549791 +0000 UTC m=+46.885230546" watchObservedRunningTime="2026-07-15 14:31:25.741019934 +0000 UTC m=+46.887700691"
Jul 15 14:31:25.772707 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:25.772591    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st" podStartSLOduration=22.719359114 podStartE2EDuration="30.772571983s" totalImagesPullingTime="8.053212869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:25.772142325 +0000 UTC m=+46.918823080" watchObservedRunningTime="2026-07-15 14:31:25.772571983 +0000 UTC m=+46.919252738"
Jul 15 14:31:26.442780 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.442722    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ctx8q"]
Jul 15 14:31:26.474904 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.474866    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ctx8q"]
Jul 15 14:31:26.474904 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.474915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:26.478457 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.478434    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qr4w9\""
Jul 15 14:31:26.478599 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.478480    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 14:31:26.479907 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.479888    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 14:31:26.496503 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.496480    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-data-volume\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:26.496577 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.496523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:26.496577 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.496571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-crio-socket\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:26.496655 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.496637    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:26.496703 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.496660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz7tv\" (UniqueName: \"kubernetes.io/projected/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-api-access-hz7tv\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:26.597478 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.597398    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-data-volume\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:26.597478 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.597450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:26.597678 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.597497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-crio-socket\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:26.597678 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:26.597616    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:26.597678 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.597638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:26.597678 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.597663    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz7tv\" (UniqueName: \"kubernetes.io/projected/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-api-access-hz7tv\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:26.597952 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:26.597688    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls podName:1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a nodeName:}" failed. No retries permitted until 2026-07-15 14:31:27.097666988 +0000 UTC m=+48.244347728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctx8q" (UID: "1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:26.597952 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.597708    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-crio-socket\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:26.597952 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:26.597807    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 14:31:26.597952 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:26.597859    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm podName:1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a nodeName:}" failed. No retries permitted until 2026-07-15 14:31:27.097841421 +0000 UTC m=+48.244522161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctx8q" (UID: "1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a") : configmap "kube-rbac-proxy" not found
Jul 15 14:31:26.597952 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.597881    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-data-volume\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:26.618331 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.618310    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 14:31:26.618786 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.618770    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/0.log"
Jul 15 14:31:26.618845 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.618806    2581 generic.go:356] "Generic (PLEG): container finished" podID="b3513a3d-3146-46f0-99b1-20a0dc6c0298" containerID="93fb8b8f80bcc1c9580b616ffffea7f1fa66042a710a748e434e16527ddf506b" exitCode=255
Jul 15 14:31:26.619699 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.619680    2581 scope.go:117] "RemoveContainer" containerID="93fb8b8f80bcc1c9580b616ffffea7f1fa66042a710a748e434e16527ddf506b"
Jul 15 14:31:26.619821 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.619804    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz7tv\" (UniqueName: \"kubernetes.io/projected/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-api-access-hz7tv\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:26.619887 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:26.619841    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vpbs6_openshift-console-operator(b3513a3d-3146-46f0-99b1-20a0dc6c0298)\"" pod="openshift-console-operator/console-operator-7866497494-vpbs6" podUID="b3513a3d-3146-46f0-99b1-20a0dc6c0298"
Jul 15 14:31:26.619887 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.619877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vpbs6" event={"ID":"b3513a3d-3146-46f0-99b1-20a0dc6c0298","Type":"ContainerDied","Data":"93fb8b8f80bcc1c9580b616ffffea7f1fa66042a710a748e434e16527ddf506b"}
Jul 15 14:31:26.619986 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:26.619916    2581 scope.go:117] "RemoveContainer" containerID="c33eaa5607d4d195f2f02f235356327d6533e45ab816fba6d1576176026e3672"
Jul 15 14:31:27.103627 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:27.103594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:27.103820 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:27.103686    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:27.103820 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:27.103762    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:27.103820 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:27.103774    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 14:31:27.103932 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:27.103826    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls podName:1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a nodeName:}" failed. No retries permitted until 2026-07-15 14:31:28.103810968 +0000 UTC m=+49.250491708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctx8q" (UID: "1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:27.103932 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:27.103840    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm podName:1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a nodeName:}" failed. No retries permitted until 2026-07-15 14:31:28.103834204 +0000 UTC m=+49.250514938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctx8q" (UID: "1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a") : configmap "kube-rbac-proxy" not found
Jul 15 14:31:27.628809 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:27.628784    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 14:31:27.629216 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:27.629114    2581 scope.go:117] "RemoveContainer" containerID="93fb8b8f80bcc1c9580b616ffffea7f1fa66042a710a748e434e16527ddf506b"
Jul 15 14:31:27.629277 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:27.629258    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vpbs6_openshift-console-operator(b3513a3d-3146-46f0-99b1-20a0dc6c0298)\"" pod="openshift-console-operator/console-operator-7866497494-vpbs6" podUID="b3513a3d-3146-46f0-99b1-20a0dc6c0298"
Jul 15 14:31:28.112034 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:28.112000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:28.112199 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:28.112068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:28.112199 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:28.112149    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:28.112267 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:28.112225    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls podName:1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a nodeName:}" failed. No retries permitted until 2026-07-15 14:31:30.112210267 +0000 UTC m=+51.258891000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctx8q" (UID: "1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:28.112267 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:28.112159    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 14:31:28.112346 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:28.112295    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm podName:1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a nodeName:}" failed. No retries permitted until 2026-07-15 14:31:30.112283309 +0000 UTC m=+51.258964042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctx8q" (UID: "1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a") : configmap "kube-rbac-proxy" not found
Jul 15 14:31:28.224254 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:28.224222    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5hmbj_2c7030e2-bf92-4317-98ef-a5caa8ecaaa7/dns-node-resolver/0.log"
Jul 15 14:31:29.224783 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:29.224757    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-857pm_3d073343-d7d8-4355-b336-8aa922f542da/node-ca/0.log"
Jul 15 14:31:30.025336 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:30.025305    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dgwmt_22491f96-5047-4517-b73e-6982e1367d49/serve-healthcheck-canary/0.log"
Jul 15 14:31:30.127840 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:30.127814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:30.127974 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:30.127895    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:30.127974 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:30.127952    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:30.128045 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:30.127978    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 14:31:30.128045 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:30.128009    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls podName:1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a nodeName:}" failed. No retries permitted until 2026-07-15 14:31:34.127995245 +0000 UTC m=+55.274675983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctx8q" (UID: "1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:30.128045 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:30.128022    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm podName:1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a nodeName:}" failed. No retries permitted until 2026-07-15 14:31:34.128016528 +0000 UTC m=+55.274697261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctx8q" (UID: "1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a") : configmap "kube-rbac-proxy" not found
Jul 15 14:31:31.034266 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:31.034233    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:31.034672 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:31.034277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pdf6q\" (UID: \"200cd50f-8b14-46fc-ba12-be63e6e62891\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"
Jul 15 14:31:31.034672 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:31.034354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:31.034672 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:31.034378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:31.034672 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:31.034404    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle podName:f171a29b-11e8-4979-b29b-5ee79409c676 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:47.034381955 +0000 UTC m=+68.181062705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle") pod "router-default-566bf9cd7d-9z9sz" (UID: "f171a29b-11e8-4979-b29b-5ee79409c676") : configmap references non-existent config key: service-ca.crt
Jul 15 14:31:31.034672 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:31.034434    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 14:31:31.034672 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:31.034442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:31.034672 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:31.034456    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:31:31.034672 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:31.034469    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bbcd4f88f-lp87q: secret "image-registry-tls" not found
Jul 15 14:31:31.034672 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:31.034481    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 14:31:31.034672 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:31.034482    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls podName:200cd50f-8b14-46fc-ba12-be63e6e62891 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:47.034470113 +0000 UTC m=+68.181150846 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls") pod "cluster-samples-operator-65db858894-pdf6q" (UID: "200cd50f-8b14-46fc-ba12-be63e6e62891") : secret "samples-operator-tls" not found
Jul 15 14:31:31.034672 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:31.034519    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 14:31:31.034672 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:31.034554    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls podName:8ce30930-ad00-4d77-9b05-307c3f8d44e0 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:47.034526332 +0000 UTC m=+68.181207070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls") pod "image-registry-bbcd4f88f-lp87q" (UID: "8ce30930-ad00-4d77-9b05-307c3f8d44e0") : secret "image-registry-tls" not found
Jul 15 14:31:31.034672 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:31.034578    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls podName:61c5ca60-f543-4ebe-82bd-9050c50647af nodeName:}" failed. No retries permitted until 2026-07-15 14:31:47.034567796 +0000 UTC m=+68.181248530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vjbl2" (UID: "61c5ca60-f543-4ebe-82bd-9050c50647af") : secret "cluster-monitoring-operator-tls" not found
Jul 15 14:31:31.034672 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:31.034594    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs podName:f171a29b-11e8-4979-b29b-5ee79409c676 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:47.034586843 +0000 UTC m=+68.181267578 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs") pod "router-default-566bf9cd7d-9z9sz" (UID: "f171a29b-11e8-4979-b29b-5ee79409c676") : secret "router-metrics-certs-default" not found
Jul 15 14:31:31.135439 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:31.135409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:31.135585 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:31.135521    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:31:31.135585 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:31.135579    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls podName:a954500d-c43e-4ffd-865c-1a9cb4a93394 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:47.135562488 +0000 UTC m=+68.282243221 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls") pod "dns-default-fmzrb" (UID: "a954500d-c43e-4ffd-865c-1a9cb4a93394") : secret "dns-default-metrics-tls" not found
Jul 15 14:31:34.158494 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:34.158459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:34.158948 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:34.158539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:34.158948 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:34.158619    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:34.158948 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:34.158693    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls podName:1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a nodeName:}" failed. No retries permitted until 2026-07-15 14:31:42.158672875 +0000 UTC m=+63.305353618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctx8q" (UID: "1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:34.159179 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:34.159161    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:35.535099 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:35.535057    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:35.535476 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:35.535118    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:35.535476 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:35.535422    2581 scope.go:117] "RemoveContainer" containerID="93fb8b8f80bcc1c9580b616ffffea7f1fa66042a710a748e434e16527ddf506b"
Jul 15 14:31:35.535569 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:35.535551    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vpbs6_openshift-console-operator(b3513a3d-3146-46f0-99b1-20a0dc6c0298)\"" pod="openshift-console-operator/console-operator-7866497494-vpbs6" podUID="b3513a3d-3146-46f0-99b1-20a0dc6c0298"
Jul 15 14:31:41.554882 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:41.554856    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dj6k9"
Jul 15 14:31:42.227705 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:42.227666    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:42.229952 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:42.229927    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctx8q\" (UID: \"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a\") " pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:42.388232 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:42.388205    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qr4w9\""
Jul 15 14:31:42.396476 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:42.396449    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ctx8q"
Jul 15 14:31:42.526627 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:42.526606    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ctx8q"]
Jul 15 14:31:42.529006 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:42.528981    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afaeaa3_9f74_4993_9cc2_e0c1888b7b9a.slice/crio-2a25c7b1efb2aa9b37b6f92687f6f57dea5df75a3a452418425682289edaa6f2 WatchSource:0}: Error finding container 2a25c7b1efb2aa9b37b6f92687f6f57dea5df75a3a452418425682289edaa6f2: Status 404 returned error can't find the container with id 2a25c7b1efb2aa9b37b6f92687f6f57dea5df75a3a452418425682289edaa6f2
Jul 15 14:31:42.672273 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:42.672241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctx8q" event={"ID":"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a","Type":"ContainerStarted","Data":"2a25c7b1efb2aa9b37b6f92687f6f57dea5df75a3a452418425682289edaa6f2"}
Jul 15 14:31:44.143982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.143948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs\") pod \"network-metrics-daemon-pplz5\" (UID: \"b7806d08-47f3-4fd8-beb2-e0f052c0be1b\") " pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:31:44.144443 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.143997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:31:44.147147 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.147127    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 14:31:44.147147 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.147137    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 14:31:44.156592 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.156570    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5384830-56ce-4427-a090-d8cd1ba933f0-original-pull-secret\") pod \"global-pull-secret-syncer-2kgfr\" (UID: \"f5384830-56ce-4427-a090-d8cd1ba933f0\") " pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:31:44.156714 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.156688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7806d08-47f3-4fd8-beb2-e0f052c0be1b-metrics-certs\") pod \"network-metrics-daemon-pplz5\" (UID: \"b7806d08-47f3-4fd8-beb2-e0f052c0be1b\") " pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:31:44.245241 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.245207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzdzm\" (UniqueName: \"kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm\") pod \"network-check-target-f8nw2\" (UID: \"6aab3e1e-de27-4522-adfe-86f01ef40d19\") " pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:44.247817 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.247792    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzdzm\" (UniqueName: \"kubernetes.io/projected/6aab3e1e-de27-4522-adfe-86f01ef40d19-kube-api-access-bzdzm\") pod \"network-check-target-f8nw2\" (UID: \"6aab3e1e-de27-4522-adfe-86f01ef40d19\") " pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:44.288721 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.288696    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cj2n5\""
Jul 15 14:31:44.293897 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.293878    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kgfr"
Jul 15 14:31:44.296602 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.296584    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:44.322106 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.322081    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cqtkh\""
Jul 15 14:31:44.329891 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.329795    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pplz5"
Jul 15 14:31:44.458745 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.458700    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f8nw2"]
Jul 15 14:31:44.463112 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:44.463054    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aab3e1e_de27_4522_adfe_86f01ef40d19.slice/crio-055d5ad9625f06f7c3ad9f2964e906b6913663440dc377db0a5e4610f22fd5c9 WatchSource:0}: Error finding container 055d5ad9625f06f7c3ad9f2964e906b6913663440dc377db0a5e4610f22fd5c9: Status 404 returned error can't find the container with id 055d5ad9625f06f7c3ad9f2964e906b6913663440dc377db0a5e4610f22fd5c9
Jul 15 14:31:44.471934 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.471913    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2kgfr"]
Jul 15 14:31:44.475464 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:44.475439    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5384830_56ce_4427_a090_d8cd1ba933f0.slice/crio-b4368744a4bf90da395f2546934b4e4b73a0df9bf099fde098379cfe0de8a6cc WatchSource:0}: Error finding container b4368744a4bf90da395f2546934b4e4b73a0df9bf099fde098379cfe0de8a6cc: Status 404 returned error can't find the container with id b4368744a4bf90da395f2546934b4e4b73a0df9bf099fde098379cfe0de8a6cc
Jul 15 14:31:44.496450 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.496431    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pplz5"]
Jul 15 14:31:44.499514 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:44.499489    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7806d08_47f3_4fd8_beb2_e0f052c0be1b.slice/crio-5bc454d634e10a26a2c20087a724f1d497388779e74a36dad23683933212de08 WatchSource:0}: Error finding container 5bc454d634e10a26a2c20087a724f1d497388779e74a36dad23683933212de08: Status 404 returned error can't find the container with id 5bc454d634e10a26a2c20087a724f1d497388779e74a36dad23683933212de08
Jul 15 14:31:44.681608 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.681569    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f8nw2" event={"ID":"6aab3e1e-de27-4522-adfe-86f01ef40d19","Type":"ContainerStarted","Data":"1b74d980e4ede81716c8f107a0de76c8f9dea7eab95e1dc087933e126828f536"}
Jul 15 14:31:44.681824 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.681634    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f8nw2" event={"ID":"6aab3e1e-de27-4522-adfe-86f01ef40d19","Type":"ContainerStarted","Data":"055d5ad9625f06f7c3ad9f2964e906b6913663440dc377db0a5e4610f22fd5c9"}
Jul 15 14:31:44.681824 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.681679    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:31:44.683005 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.682970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pplz5" event={"ID":"b7806d08-47f3-4fd8-beb2-e0f052c0be1b","Type":"ContainerStarted","Data":"5bc454d634e10a26a2c20087a724f1d497388779e74a36dad23683933212de08"}
Jul 15 14:31:44.684286 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.684257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2kgfr" event={"ID":"f5384830-56ce-4427-a090-d8cd1ba933f0","Type":"ContainerStarted","Data":"b4368744a4bf90da395f2546934b4e4b73a0df9bf099fde098379cfe0de8a6cc"}
Jul 15 14:31:44.699846 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:44.699806    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f8nw2" podStartSLOduration=65.699792423 podStartE2EDuration="1m5.699792423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:44.699316464 +0000 UTC m=+65.845997221" watchObservedRunningTime="2026-07-15 14:31:44.699792423 +0000 UTC m=+65.846473169"
Jul 15 14:31:47.069880 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.069838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:47.069880 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.069879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:47.070411 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.069900    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:47.070411 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.069950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:47.070411 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.069989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pdf6q\" (UID: \"200cd50f-8b14-46fc-ba12-be63e6e62891\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"
Jul 15 14:31:47.070683 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.070655    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f171a29b-11e8-4979-b29b-5ee79409c676-service-ca-bundle\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:47.072332 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.072303    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f171a29b-11e8-4979-b29b-5ee79409c676-metrics-certs\") pod \"router-default-566bf9cd7d-9z9sz\" (UID: \"f171a29b-11e8-4979-b29b-5ee79409c676\") " pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:47.072438 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.072304    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/61c5ca60-f543-4ebe-82bd-9050c50647af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vjbl2\" (UID: \"61c5ca60-f543-4ebe-82bd-9050c50647af\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:47.072479 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.072426    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls\") pod \"image-registry-bbcd4f88f-lp87q\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") " pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:47.073065 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.073038    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/200cd50f-8b14-46fc-ba12-be63e6e62891-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pdf6q\" (UID: \"200cd50f-8b14-46fc-ba12-be63e6e62891\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"
Jul 15 14:31:47.170592 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.170557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:47.172973 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.172947    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a954500d-c43e-4ffd-865c-1a9cb4a93394-metrics-tls\") pod \"dns-default-fmzrb\" (UID: \"a954500d-c43e-4ffd-865c-1a9cb4a93394\") " pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:47.292445 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.292413    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5dgf6\""
Jul 15 14:31:47.300014 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.299985    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"
Jul 15 14:31:47.311749 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.311718    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z6j7k\""
Jul 15 14:31:47.318548 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.318521    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:47.321070 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.321020    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cf6wf\""
Jul 15 14:31:47.328716 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.328690    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:47.331519 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.331503    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sjx4f\""
Jul 15 14:31:47.339007 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.338978    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"
Jul 15 14:31:47.376459 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.376415    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ns9wp\""
Jul 15 14:31:47.384090 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:47.384072    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:48.514682 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:48.514654    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fmzrb"]
Jul 15 14:31:48.653281 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:48.653247    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda954500d_c43e_4ffd_865c_1a9cb4a93394.slice/crio-356f86260dce6cd1a453d49d7829da5f0708f6f55b2afc31e250076ccd20ada2 WatchSource:0}: Error finding container 356f86260dce6cd1a453d49d7829da5f0708f6f55b2afc31e250076ccd20ada2: Status 404 returned error can't find the container with id 356f86260dce6cd1a453d49d7829da5f0708f6f55b2afc31e250076ccd20ada2
Jul 15 14:31:48.703189 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:48.703164    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fmzrb" event={"ID":"a954500d-c43e-4ffd-865c-1a9cb4a93394","Type":"ContainerStarted","Data":"356f86260dce6cd1a453d49d7829da5f0708f6f55b2afc31e250076ccd20ada2"}
Jul 15 14:31:48.704661 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:48.704638    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pplz5" event={"ID":"b7806d08-47f3-4fd8-beb2-e0f052c0be1b","Type":"ContainerStarted","Data":"4f636e8edb83f48ca2e8e9f1cb6ce88030be3a0646ca86dfd245d3677c449090"}
Jul 15 14:31:48.756123 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:48.756098    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bbcd4f88f-lp87q"]
Jul 15 14:31:48.759362 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:48.759313    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce30930_ad00_4d77_9b05_307c3f8d44e0.slice/crio-7c75f9f983b646c58e3623340d2eb9955cb3f3cabfa24f5bfc3a6d35bdd3b608 WatchSource:0}: Error finding container 7c75f9f983b646c58e3623340d2eb9955cb3f3cabfa24f5bfc3a6d35bdd3b608: Status 404 returned error can't find the container with id 7c75f9f983b646c58e3623340d2eb9955cb3f3cabfa24f5bfc3a6d35bdd3b608
Jul 15 14:31:48.762625 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:48.762601    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2"]
Jul 15 14:31:48.764061 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:48.764040    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q"]
Jul 15 14:31:48.765516 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:48.765484    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c5ca60_f543_4ebe_82bd_9050c50647af.slice/crio-a586560fa18c49d41183d48b0d8a1a199368e6755ffeccdf7e5328ef0f0b5136 WatchSource:0}: Error finding container a586560fa18c49d41183d48b0d8a1a199368e6755ffeccdf7e5328ef0f0b5136: Status 404 returned error can't find the container with id a586560fa18c49d41183d48b0d8a1a199368e6755ffeccdf7e5328ef0f0b5136
Jul 15 14:31:48.771230 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:48.771205    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-566bf9cd7d-9z9sz"]
Jul 15 14:31:48.777790 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:31:48.777766    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf171a29b_11e8_4979_b29b_5ee79409c676.slice/crio-fef86e49900edccc0f88f7c50d187fb155251de793459f820a036762c229a23a WatchSource:0}: Error finding container fef86e49900edccc0f88f7c50d187fb155251de793459f820a036762c229a23a: Status 404 returned error can't find the container with id fef86e49900edccc0f88f7c50d187fb155251de793459f820a036762c229a23a
Jul 15 14:31:49.714992 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:49.714948    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2" event={"ID":"61c5ca60-f543-4ebe-82bd-9050c50647af","Type":"ContainerStarted","Data":"a586560fa18c49d41183d48b0d8a1a199368e6755ffeccdf7e5328ef0f0b5136"}
Jul 15 14:31:49.717836 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:49.717716    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q" event={"ID":"200cd50f-8b14-46fc-ba12-be63e6e62891","Type":"ContainerStarted","Data":"d2b7b43a21ea7d403db486426130684b8e1de3a0d8f5957349f2e0efb8ede282"}
Jul 15 14:31:49.722130 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:49.721275    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q" event={"ID":"8ce30930-ad00-4d77-9b05-307c3f8d44e0","Type":"ContainerStarted","Data":"92abf889d0e370277de1891bfeee45c33d5220d268cb13e1a320e3f235d4efe9"}
Jul 15 14:31:49.722130 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:49.721319    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q" event={"ID":"8ce30930-ad00-4d77-9b05-307c3f8d44e0","Type":"ContainerStarted","Data":"7c75f9f983b646c58e3623340d2eb9955cb3f3cabfa24f5bfc3a6d35bdd3b608"}
Jul 15 14:31:49.722130 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:49.722075    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:31:49.725514 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:49.725447    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctx8q" event={"ID":"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a","Type":"ContainerStarted","Data":"11b1394cfa58530cae511752342c761bdd24e1c6904e769dc549c4d9f7e302bf"}
Jul 15 14:31:49.728719 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:49.728537    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pplz5" event={"ID":"b7806d08-47f3-4fd8-beb2-e0f052c0be1b","Type":"ContainerStarted","Data":"bd888513a19747736aaa3eb72f6f9be86c7acb864aa07df05b648dfee6d429c7"}
Jul 15 14:31:49.731994 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:49.731491    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-566bf9cd7d-9z9sz" event={"ID":"f171a29b-11e8-4979-b29b-5ee79409c676","Type":"ContainerStarted","Data":"9ceed282c01d758f6405055233a11ea5a1cf10656aae0f833a48c47a0f8be30b"}
Jul 15 14:31:49.731994 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:49.731529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-566bf9cd7d-9z9sz" event={"ID":"f171a29b-11e8-4979-b29b-5ee79409c676","Type":"ContainerStarted","Data":"fef86e49900edccc0f88f7c50d187fb155251de793459f820a036762c229a23a"}
Jul 15 14:31:49.754842 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:49.754301    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q" podStartSLOduration=70.754281804 podStartE2EDuration="1m10.754281804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:49.752329689 +0000 UTC m=+70.899010470" watchObservedRunningTime="2026-07-15 14:31:49.754281804 +0000 UTC m=+70.900962562"
Jul 15 14:31:49.796919 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:49.794229    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-566bf9cd7d-9z9sz" podStartSLOduration=54.794214349 podStartE2EDuration="54.794214349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:49.784814514 +0000 UTC m=+70.931495291" watchObservedRunningTime="2026-07-15 14:31:49.794214349 +0000 UTC m=+70.940895106"
Jul 15 14:31:49.848438 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:49.848093    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pplz5" podStartSLOduration=67.056271343 podStartE2EDuration="1m10.848074592s" totalImagesPullingTime="3.791803249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:49.844087102 +0000 UTC m=+70.990767859" watchObservedRunningTime="2026-07-15 14:31:49.848074592 +0000 UTC m=+70.994755351"
Jul 15 14:31:50.330472 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:50.329311    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:50.332559 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:50.332365    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:50.375884 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:50.375415    2581 scope.go:117] "RemoveContainer" containerID="93fb8b8f80bcc1c9580b616ffffea7f1fa66042a710a748e434e16527ddf506b"
Jul 15 14:31:50.738549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:50.738016    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:50.739718 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:50.739558    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-566bf9cd7d-9z9sz"
Jul 15 14:31:55.759945 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:55.759866    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q" event={"ID":"200cd50f-8b14-46fc-ba12-be63e6e62891","Type":"ContainerStarted","Data":"9acaa2bcfa53136094e9fe4d7a4787cf1309655b6bff025066edc899ae98c3f6"}
Jul 15 14:31:55.761458 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:55.761427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2kgfr" event={"ID":"f5384830-56ce-4427-a090-d8cd1ba933f0","Type":"ContainerStarted","Data":"164f2ddb46802d64c7c6526e1e3f39cef50745f48bd15df0600a91bbd1442e45"}
Jul 15 14:31:55.763451 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:55.763427    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 14:31:55.763564 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:55.763526    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vpbs6" event={"ID":"b3513a3d-3146-46f0-99b1-20a0dc6c0298","Type":"ContainerStarted","Data":"5cd589ada555318dde8912db8bd2a4cd526ebb8c26ee5703d637b482d78bd2e2"}
Jul 15 14:31:55.763817 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:55.763765    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:55.765359 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:55.765303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fmzrb" event={"ID":"a954500d-c43e-4ffd-865c-1a9cb4a93394","Type":"ContainerStarted","Data":"4e0a2cd9df9b48139077d7268368c4d8b893f3354bc6703dbeb18c88d6b3ed76"}
Jul 15 14:31:55.766885 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:55.766867    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2" event={"ID":"61c5ca60-f543-4ebe-82bd-9050c50647af","Type":"ContainerStarted","Data":"4cfab3268c504ab240197c23cfb2de98aa406e8f214dec5dbf44d4ee6ebc3fe0"}
Jul 15 14:31:55.780408 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:55.780365    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2kgfr" podStartSLOduration=66.008601299 podStartE2EDuration="1m16.78035244s" totalImagesPullingTime="10.771751141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:55.779303918 +0000 UTC m=+76.925984677" watchObservedRunningTime="2026-07-15 14:31:55.78035244 +0000 UTC m=+76.927033198"
Jul 15 14:31:55.799551 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:55.799490    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-vpbs6" podStartSLOduration=52.760390903 podStartE2EDuration="1m0.799471471s" totalImagesPullingTime="8.039080568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:55.797855726 +0000 UTC m=+76.944536488" watchObservedRunningTime="2026-07-15 14:31:55.799471471 +0000 UTC m=+76.946152230"
Jul 15 14:31:55.816925 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:55.816888    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vjbl2" podStartSLOduration=54.147684724 podStartE2EDuration="1m0.816877724s" totalImagesPullingTime="6.669193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:55.816050139 +0000 UTC m=+76.962730919" watchObservedRunningTime="2026-07-15 14:31:55.816877724 +0000 UTC m=+76.963558478"
Jul 15 14:31:56.110483 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.110413    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-96xgb"]
Jul 15 14:31:56.132828 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.132792    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-96xgb"]
Jul 15 14:31:56.132979 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.132888    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-96xgb"
Jul 15 14:31:56.136313 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.136292    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 15 14:31:56.136441 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.136329    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vgnw6\""
Jul 15 14:31:56.147627 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.147605    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-vpbs6"
Jul 15 14:31:56.247906 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.247875    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-96xgb\" (UID: \"6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-96xgb"
Jul 15 14:31:56.349135 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.349104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-96xgb\" (UID: \"6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-96xgb"
Jul 15 14:31:56.349296 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:56.349250    2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 15 14:31:56.349343 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:31:56.349317    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c-tls-certificates podName:6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c nodeName:}" failed. No retries permitted until 2026-07-15 14:31:56.849300119 +0000 UTC m=+77.995980852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-96xgb" (UID: "6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 15 14:31:56.773540 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.773502    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fmzrb" event={"ID":"a954500d-c43e-4ffd-865c-1a9cb4a93394","Type":"ContainerStarted","Data":"3d3f05fb3c0267f544eac09780ee09d389b31f13fc77dd4197d8d5621e518abc"}
Jul 15 14:31:56.774021 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.773618    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:31:56.775817 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.775621    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q" event={"ID":"200cd50f-8b14-46fc-ba12-be63e6e62891","Type":"ContainerStarted","Data":"d070e4e39f438a0ddba59a83cb70b3404d4e07adee4c7c5d40dce50569501f0f"}
Jul 15 14:31:56.777700 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.777642    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctx8q" event={"ID":"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a","Type":"ContainerStarted","Data":"4d6bc998f9743530fa8a56d361b63696e944416e33813dae316be795790de89c"}
Jul 15 14:31:56.793984 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.793933    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fmzrb" podStartSLOduration=35.031500725 podStartE2EDuration="41.793916921s" totalImagesPullingTime="6.762416196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:56.792076002 +0000 UTC m=+77.938756779" watchObservedRunningTime="2026-07-15 14:31:56.793916921 +0000 UTC m=+77.940597676"
Jul 15 14:31:56.815012 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.814968    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pdf6q" podStartSLOduration=55.217502574 podStartE2EDuration="1m1.814951816s" totalImagesPullingTime="6.597449242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:56.813622431 +0000 UTC m=+77.960303212" watchObservedRunningTime="2026-07-15 14:31:56.814951816 +0000 UTC m=+77.961632569"
Jul 15 14:31:56.853620 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.853590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-96xgb\" (UID: \"6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-96xgb"
Jul 15 14:31:56.856418 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:56.856391    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-96xgb\" (UID: \"6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-96xgb"
Jul 15 14:31:57.043286 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:57.043191    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-96xgb"
Jul 15 14:31:57.218576 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:57.218545    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-96xgb"]
Jul 15 14:31:57.782902 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:31:57.782855    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-96xgb" event={"ID":"6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c","Type":"ContainerStarted","Data":"a97b3b5f24b4ee68cdda07903989768eddbb11195440e1fd7309ebc460cc189b"}
Jul 15 14:32:00.795327 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:00.795292    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctx8q" event={"ID":"1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a","Type":"ContainerStarted","Data":"8a9203e10208fb0315ffd40a1ac5c7e33e284c4b0c49d3fb089ba17786678bb2"}
Jul 15 14:32:00.828521 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:00.828454    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ctx8q" podStartSLOduration=17.74809434 podStartE2EDuration="34.828439816s" totalImagesPullingTime="17.080345476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:31:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:00.826250463 +0000 UTC m=+81.972931230" watchObservedRunningTime="2026-07-15 14:32:00.828439816 +0000 UTC m=+81.975120570"
Jul 15 14:32:01.802622 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:01.802580    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-96xgb" event={"ID":"6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c","Type":"ContainerStarted","Data":"e07eee959ea403b3342f0f11b3b96db5da737cb2be8c95c74f40543988020fe7"}
Jul 15 14:32:01.803088 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:01.802916    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-96xgb"
Jul 15 14:32:01.807296 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:01.807275    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-96xgb"
Jul 15 14:32:01.825029 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:01.824990    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-96xgb" podStartSLOduration=2.171668279 podStartE2EDuration="5.824977047s" totalImagesPullingTime="3.653308768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:01.82343752 +0000 UTC m=+82.970118273" watchObservedRunningTime="2026-07-15 14:32:01.824977047 +0000 UTC m=+82.971657812"
Jul 15 14:32:06.785100 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:06.785068    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fmzrb"
Jul 15 14:32:07.323148 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:07.323114    2581 patch_prober.go:28] interesting pod/image-registry-bbcd4f88f-lp87q container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 14:32:07.323310 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:07.323166    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q" podUID="8ce30930-ad00-4d77-9b05-307c3f8d44e0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 14:32:08.578496 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.578465    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"]
Jul 15 14:32:08.581433 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.581414    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"
Jul 15 14:32:08.584502 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.584480    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g4klp\""
Jul 15 14:32:08.585778 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.585756    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 14:32:08.585778 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.585773    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 15 14:32:08.585940 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.585852    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 15 14:32:08.590505 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.590486    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5cm49"]
Jul 15 14:32:08.594462 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.594430    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.598338 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.598318    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 14:32:08.598442 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.598339    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9xfhr\""
Jul 15 14:32:08.598442 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.598347    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 14:32:08.598442 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.598324    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 14:32:08.598683 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.598667    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"]
Jul 15 14:32:08.600597 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.600576    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.604309 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.604290    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 15 14:32:08.604612 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.604592    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 15 14:32:08.604801 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.604784    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 15 14:32:08.605487 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.605469    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2pxnh\""
Jul 15 14:32:08.605969 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.605948    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"]
Jul 15 14:32:08.611132 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.611110    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"]
Jul 15 14:32:08.742705 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.742670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stktc\" (UniqueName: \"kubernetes.io/projected/ab494f96-2cd6-4a9e-b373-978498f0b604-kube-api-access-stktc\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.742912 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.742713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56bb1669-e472-4a3f-a859-5c36fc7c212e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-tfzpm\" (UID: \"56bb1669-e472-4a3f-a859-5c36fc7c212e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"
Jul 15 14:32:08.742912 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.742754    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.742912 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.742779    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40700db9-a43e-43ec-abcb-56ddc2b032ca-metrics-client-ca\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.742912 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.742820    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-textfile\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.742912 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.742847    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kbnm\" (UniqueName: \"kubernetes.io/projected/56bb1669-e472-4a3f-a859-5c36fc7c212e-kube-api-access-2kbnm\") pod \"openshift-state-metrics-84bd68b896-tfzpm\" (UID: \"56bb1669-e472-4a3f-a859-5c36fc7c212e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"
Jul 15 14:32:08.742912 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.742904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab494f96-2cd6-4a9e-b373-978498f0b604-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.743198 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.742935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-wtmp\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.743198 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.742970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab494f96-2cd6-4a9e-b373-978498f0b604-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.743198 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.743000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-tls\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.743198 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.743028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab494f96-2cd6-4a9e-b373-978498f0b604-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.743198 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.743062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56bb1669-e472-4a3f-a859-5c36fc7c212e-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-tfzpm\" (UID: \"56bb1669-e472-4a3f-a859-5c36fc7c212e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"
Jul 15 14:32:08.743198 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.743129    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40700db9-a43e-43ec-abcb-56ddc2b032ca-sys\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.743198 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.743168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56bb1669-e472-4a3f-a859-5c36fc7c212e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-tfzpm\" (UID: \"56bb1669-e472-4a3f-a859-5c36fc7c212e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"
Jul 15 14:32:08.743198 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.743193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.743452 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.743209    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab494f96-2cd6-4a9e-b373-978498f0b604-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.743452 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.743230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp2gm\" (UniqueName: \"kubernetes.io/projected/40700db9-a43e-43ec-abcb-56ddc2b032ca-kube-api-access-jp2gm\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.743452 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.743250    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab494f96-2cd6-4a9e-b373-978498f0b604-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.743452 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.743271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40700db9-a43e-43ec-abcb-56ddc2b032ca-root\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.844492 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844414    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp2gm\" (UniqueName: \"kubernetes.io/projected/40700db9-a43e-43ec-abcb-56ddc2b032ca-kube-api-access-jp2gm\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.844492 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab494f96-2cd6-4a9e-b373-978498f0b604-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.844492 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40700db9-a43e-43ec-abcb-56ddc2b032ca-root\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.844765 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stktc\" (UniqueName: \"kubernetes.io/projected/ab494f96-2cd6-4a9e-b373-978498f0b604-kube-api-access-stktc\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.844765 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56bb1669-e472-4a3f-a859-5c36fc7c212e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-tfzpm\" (UID: \"56bb1669-e472-4a3f-a859-5c36fc7c212e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"
Jul 15 14:32:08.844765 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844552    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40700db9-a43e-43ec-abcb-56ddc2b032ca-root\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.844765 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.844765 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40700db9-a43e-43ec-abcb-56ddc2b032ca-metrics-client-ca\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.844765 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844615    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-textfile\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.844765 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kbnm\" (UniqueName: \"kubernetes.io/projected/56bb1669-e472-4a3f-a859-5c36fc7c212e-kube-api-access-2kbnm\") pod \"openshift-state-metrics-84bd68b896-tfzpm\" (UID: \"56bb1669-e472-4a3f-a859-5c36fc7c212e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"
Jul 15 14:32:08.844765 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844679    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab494f96-2cd6-4a9e-b373-978498f0b604-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.844765 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-wtmp\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.845205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab494f96-2cd6-4a9e-b373-978498f0b604-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.845205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-tls\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.845205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab494f96-2cd6-4a9e-b373-978498f0b604-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.845205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844869    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56bb1669-e472-4a3f-a859-5c36fc7c212e-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-tfzpm\" (UID: \"56bb1669-e472-4a3f-a859-5c36fc7c212e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"
Jul 15 14:32:08.845205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844898    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40700db9-a43e-43ec-abcb-56ddc2b032ca-sys\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.845205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844927    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56bb1669-e472-4a3f-a859-5c36fc7c212e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-tfzpm\" (UID: \"56bb1669-e472-4a3f-a859-5c36fc7c212e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"
Jul 15 14:32:08.845205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844934    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-wtmp\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.845205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.845205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.844991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab494f96-2cd6-4a9e-b373-978498f0b604-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.845205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.845085    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-textfile\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.845205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.845157    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40700db9-a43e-43ec-abcb-56ddc2b032ca-sys\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.845765 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.845246    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40700db9-a43e-43ec-abcb-56ddc2b032ca-metrics-client-ca\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.845765 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.845256    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab494f96-2cd6-4a9e-b373-978498f0b604-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.845765 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.845627    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab494f96-2cd6-4a9e-b373-978498f0b604-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.845941 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.845903    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab494f96-2cd6-4a9e-b373-978498f0b604-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.845941 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.845930    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56bb1669-e472-4a3f-a859-5c36fc7c212e-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-tfzpm\" (UID: \"56bb1669-e472-4a3f-a859-5c36fc7c212e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"
Jul 15 14:32:08.846395 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.846368    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.847419 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.847395    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab494f96-2cd6-4a9e-b373-978498f0b604-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.847656 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.847638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-tls\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.847717 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.847657    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56bb1669-e472-4a3f-a859-5c36fc7c212e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-tfzpm\" (UID: \"56bb1669-e472-4a3f-a859-5c36fc7c212e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"
Jul 15 14:32:08.847903 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.847873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab494f96-2cd6-4a9e-b373-978498f0b604-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.848160 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.848142    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56bb1669-e472-4a3f-a859-5c36fc7c212e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-tfzpm\" (UID: \"56bb1669-e472-4a3f-a859-5c36fc7c212e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"
Jul 15 14:32:08.848297 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.848282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40700db9-a43e-43ec-abcb-56ddc2b032ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.853870 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.853847    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp2gm\" (UniqueName: \"kubernetes.io/projected/40700db9-a43e-43ec-abcb-56ddc2b032ca-kube-api-access-jp2gm\") pod \"node-exporter-5cm49\" (UID: \"40700db9-a43e-43ec-abcb-56ddc2b032ca\") " pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.854279 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.854250    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stktc\" (UniqueName: \"kubernetes.io/projected/ab494f96-2cd6-4a9e-b373-978498f0b604-kube-api-access-stktc\") pod \"kube-state-metrics-785778ff74-xrwcp\" (UID: \"ab494f96-2cd6-4a9e-b373-978498f0b604\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.854894 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.854878    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kbnm\" (UniqueName: \"kubernetes.io/projected/56bb1669-e472-4a3f-a859-5c36fc7c212e-kube-api-access-2kbnm\") pod \"openshift-state-metrics-84bd68b896-tfzpm\" (UID: \"56bb1669-e472-4a3f-a859-5c36fc7c212e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"
Jul 15 14:32:08.890872 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.890848    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"
Jul 15 14:32:08.903600 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.903573    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5cm49"
Jul 15 14:32:08.910918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:08.910895    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"
Jul 15 14:32:08.914218 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:32:08.914198    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40700db9_a43e_43ec_abcb_56ddc2b032ca.slice/crio-672bd4fa8111f6766063330c5c2b31850d8e76fd00603c65e6b58ca6dc74a4ab WatchSource:0}: Error finding container 672bd4fa8111f6766063330c5c2b31850d8e76fd00603c65e6b58ca6dc74a4ab: Status 404 returned error can't find the container with id 672bd4fa8111f6766063330c5c2b31850d8e76fd00603c65e6b58ca6dc74a4ab
Jul 15 14:32:09.061152 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.061123    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm"]
Jul 15 14:32:09.065007 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:32:09.064980    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56bb1669_e472_4a3f_a859_5c36fc7c212e.slice/crio-08cd7e9c23b7a1c404dc937b307f525a69f7d5ee219fa1eae69d45dd357da22d WatchSource:0}: Error finding container 08cd7e9c23b7a1c404dc937b307f525a69f7d5ee219fa1eae69d45dd357da22d: Status 404 returned error can't find the container with id 08cd7e9c23b7a1c404dc937b307f525a69f7d5ee219fa1eae69d45dd357da22d
Jul 15 14:32:09.078534 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.078503    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-xrwcp"]
Jul 15 14:32:09.080385 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:32:09.080361    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab494f96_2cd6_4a9e_b373_978498f0b604.slice/crio-ab14ac979424ac9e337d5c65e1516137b462d700a462d154a29b21b2f7699035 WatchSource:0}: Error finding container ab14ac979424ac9e337d5c65e1516137b462d700a462d154a29b21b2f7699035: Status 404 returned error can't find the container with id ab14ac979424ac9e337d5c65e1516137b462d700a462d154a29b21b2f7699035
Jul 15 14:32:09.100315 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.100254    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b8d49f79d-hmrhv"]
Jul 15 14:32:09.103057 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.103040    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.108871 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.108851    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 14:32:09.109599 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.109557    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 14:32:09.110159 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.110142    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 14:32:09.111045 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.111024    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 14:32:09.111132 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.111050    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 14:32:09.111132 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.111058    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 14:32:09.111593 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.111576    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8czzb\""
Jul 15 14:32:09.111644 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.111591    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 14:32:09.115428 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.115413    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 14:32:09.144283 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.144256    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8d49f79d-hmrhv"]
Jul 15 14:32:09.249774 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.249689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-console-config\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.249774 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.249724    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-trusted-ca-bundle\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.249972 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.249827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-service-ca\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.249972 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.249927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02ea6f2a-14f3-4fee-8d85-98308514c501-console-oauth-config\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.249972 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.249957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-oauth-serving-cert\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.250100 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.249981    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t4pc\" (UniqueName: \"kubernetes.io/projected/02ea6f2a-14f3-4fee-8d85-98308514c501-kube-api-access-7t4pc\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.250100 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.250018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02ea6f2a-14f3-4fee-8d85-98308514c501-console-serving-cert\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.350826 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.350758    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-console-config\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.350826 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.350796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-trusted-ca-bundle\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.351020 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.350928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-service-ca\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.351072 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.351039    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02ea6f2a-14f3-4fee-8d85-98308514c501-console-oauth-config\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.351122 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.351069    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-oauth-serving-cert\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.351122 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.351094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t4pc\" (UniqueName: \"kubernetes.io/projected/02ea6f2a-14f3-4fee-8d85-98308514c501-kube-api-access-7t4pc\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.351215 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.351134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02ea6f2a-14f3-4fee-8d85-98308514c501-console-serving-cert\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.351623 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.351596    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-console-config\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.351792 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.351684    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-service-ca\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.351910 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.351850    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-trusted-ca-bundle\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.352111 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.352089    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-oauth-serving-cert\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.354710 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.354667    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02ea6f2a-14f3-4fee-8d85-98308514c501-console-oauth-config\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.354710 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.354688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02ea6f2a-14f3-4fee-8d85-98308514c501-console-serving-cert\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.369866 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.369840    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t4pc\" (UniqueName: \"kubernetes.io/projected/02ea6f2a-14f3-4fee-8d85-98308514c501-kube-api-access-7t4pc\") pod \"console-6b8d49f79d-hmrhv\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") " pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.412433 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.412381    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:09.609179 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.609093    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8d49f79d-hmrhv"]
Jul 15 14:32:09.833803 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.833765    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp" event={"ID":"ab494f96-2cd6-4a9e-b373-978498f0b604","Type":"ContainerStarted","Data":"ab14ac979424ac9e337d5c65e1516137b462d700a462d154a29b21b2f7699035"}
Jul 15 14:32:09.835201 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.835144    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5cm49" event={"ID":"40700db9-a43e-43ec-abcb-56ddc2b032ca","Type":"ContainerStarted","Data":"672bd4fa8111f6766063330c5c2b31850d8e76fd00603c65e6b58ca6dc74a4ab"}
Jul 15 14:32:09.837541 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.837513    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm" event={"ID":"56bb1669-e472-4a3f-a859-5c36fc7c212e","Type":"ContainerStarted","Data":"03439a82d028b5235a4325ce77b39f0e47e435de39febc8cd51e669a8b1e194d"}
Jul 15 14:32:09.837646 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.837573    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm" event={"ID":"56bb1669-e472-4a3f-a859-5c36fc7c212e","Type":"ContainerStarted","Data":"3a7bad261ac5bad7e8adfeeeb792b74c0e7bf4ff6808b207f3f382f570b0fc1d"}
Jul 15 14:32:09.837646 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:09.837599    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm" event={"ID":"56bb1669-e472-4a3f-a859-5c36fc7c212e","Type":"ContainerStarted","Data":"08cd7e9c23b7a1c404dc937b307f525a69f7d5ee219fa1eae69d45dd357da22d"}
Jul 15 14:32:09.872252 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:32:09.872174    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ea6f2a_14f3_4fee_8d85_98308514c501.slice/crio-94438de16c8e50f9d672267159df7e6e32e06717f486e303e6fbff1c6a5e3def WatchSource:0}: Error finding container 94438de16c8e50f9d672267159df7e6e32e06717f486e303e6fbff1c6a5e3def: Status 404 returned error can't find the container with id 94438de16c8e50f9d672267159df7e6e32e06717f486e303e6fbff1c6a5e3def
Jul 15 14:32:10.844151 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:10.844068    2581 generic.go:356] "Generic (PLEG): container finished" podID="40700db9-a43e-43ec-abcb-56ddc2b032ca" containerID="55e3541527a7337009e78e7e66b4c141bf60442e4ebfe300089c5e16852ee28f" exitCode=0
Jul 15 14:32:10.844547 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:10.844161    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5cm49" event={"ID":"40700db9-a43e-43ec-abcb-56ddc2b032ca","Type":"ContainerDied","Data":"55e3541527a7337009e78e7e66b4c141bf60442e4ebfe300089c5e16852ee28f"}
Jul 15 14:32:10.845596 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:10.845569    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8d49f79d-hmrhv" event={"ID":"02ea6f2a-14f3-4fee-8d85-98308514c501","Type":"ContainerStarted","Data":"94438de16c8e50f9d672267159df7e6e32e06717f486e303e6fbff1c6a5e3def"}
Jul 15 14:32:10.851539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:10.851470    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm" event={"ID":"56bb1669-e472-4a3f-a859-5c36fc7c212e","Type":"ContainerStarted","Data":"151b7e1fb74298c475ef3e1525dde6f83a2cc1aa8938daeebcb3a6d1e89f7f13"}
Jul 15 14:32:10.855067 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:10.854938    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp" event={"ID":"ab494f96-2cd6-4a9e-b373-978498f0b604","Type":"ContainerStarted","Data":"364d51d2fbb5c5dd27256e6a4b428895eb572a052bdb24cafe5af2014536b6ff"}
Jul 15 14:32:10.855067 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:10.854989    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp" event={"ID":"ab494f96-2cd6-4a9e-b373-978498f0b604","Type":"ContainerStarted","Data":"ffd3f352ccaf15215a3cc3ff55d62fded3bf6ec7bad68802b8c8cdba6c182e41"}
Jul 15 14:32:10.855067 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:10.855015    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp" event={"ID":"ab494f96-2cd6-4a9e-b373-978498f0b604","Type":"ContainerStarted","Data":"06a46ac2a143a55c95b73a94492fefb03249362b86a459cd1c9b88f33e9be67e"}
Jul 15 14:32:10.894842 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:10.894794    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-xrwcp" podStartSLOduration=1.442192572 podStartE2EDuration="2.894775608s" totalImagesPullingTime="1.452583036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:32:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:10.89466852 +0000 UTC m=+92.041349276" watchObservedRunningTime="2026-07-15 14:32:10.894775608 +0000 UTC m=+92.041456364"
Jul 15 14:32:10.917721 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:10.917678    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tfzpm" podStartSLOduration=1.55408743 podStartE2EDuration="2.917657253s" totalImagesPullingTime="1.363569823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:32:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:10.917106586 +0000 UTC m=+92.063787352" watchObservedRunningTime="2026-07-15 14:32:10.917657253 +0000 UTC m=+92.064338010"
Jul 15 14:32:11.749787 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.748531    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:32:11.756018 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.755985    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-584f777759-g256v"]
Jul 15 14:32:11.759303 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.759282    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.762857 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.762767    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-c4bzm\""
Jul 15 14:32:11.763002 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.762789    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 15 14:32:11.763127 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.762797    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 15 14:32:11.763507 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.763489    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 15 14:32:11.763722 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.763501    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 15 14:32:11.763858 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.763840    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 15 14:32:11.764079 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.763517    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-19m6tfsk35vch\""
Jul 15 14:32:11.765719 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.765674    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-584f777759-g256v"]
Jul 15 14:32:11.862386 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.862351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5cm49" event={"ID":"40700db9-a43e-43ec-abcb-56ddc2b032ca","Type":"ContainerStarted","Data":"5704f0b5092286ac06c4d52d085c65f94f1be6e3b9ff5f36cd39ccfeb6935dd9"}
Jul 15 14:32:11.862826 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.862415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5cm49" event={"ID":"40700db9-a43e-43ec-abcb-56ddc2b032ca","Type":"ContainerStarted","Data":"5f9e9181544d2e44b29cfdf1457e08f98960bbd8797dab7981d2d7bf035650ea"}
Jul 15 14:32:11.873602 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.873571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.873750 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.873623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.873750 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.873722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.873901 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.873770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-grpc-tls\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.873901 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.873800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-metrics-client-ca\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.873901 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.873826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxfdq\" (UniqueName: \"kubernetes.io/projected/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-kube-api-access-rxfdq\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.874055 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.873940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-tls\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.874055 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.873981    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.887064 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.887014    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5cm49" podStartSLOduration=2.825073316 podStartE2EDuration="3.886971234s" totalImagesPullingTime="983.795414ms" totalInitContainerRuntime="78.102504ms" isStatefulPod=true podCreationTimestamp="2026-07-15 14:32:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:11.886024914 +0000 UTC m=+93.032705700" watchObservedRunningTime="2026-07-15 14:32:11.886971234 +0000 UTC m=+93.033651989"
Jul 15 14:32:11.974571 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.974539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.974698 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.974633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-grpc-tls\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.974698 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.974676    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-metrics-client-ca\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.974858 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.974707    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxfdq\" (UniqueName: \"kubernetes.io/projected/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-kube-api-access-rxfdq\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.974909 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.974860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-tls\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.974909 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.974887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.975305 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.975017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.975305 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.975060    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.975535 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.975511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-metrics-client-ca\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.977719 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.977697    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.977815 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.977760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.977877 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.977862    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.977924 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.977897    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-grpc-tls\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.978148 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.978125    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.978253 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.978234    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-secret-thanos-querier-tls\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:11.984453 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:11.984433    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxfdq\" (UniqueName: \"kubernetes.io/projected/ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8-kube-api-access-rxfdq\") pod \"thanos-querier-584f777759-g256v\" (UID: \"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8\") " pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:12.072391 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:12.072303    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:12.229295 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:12.229005    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-584f777759-g256v"]
Jul 15 14:32:12.231429 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:32:12.231405    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5cafe3_7eb9_4967_8ddf_1073f4ae51f8.slice/crio-902b4909866e19dd4941f76caeb4a05b1b7a39542f7998d475d743395d018af5 WatchSource:0}: Error finding container 902b4909866e19dd4941f76caeb4a05b1b7a39542f7998d475d743395d018af5: Status 404 returned error can't find the container with id 902b4909866e19dd4941f76caeb4a05b1b7a39542f7998d475d743395d018af5
Jul 15 14:32:12.869044 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:12.869001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584f777759-g256v" event={"ID":"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8","Type":"ContainerStarted","Data":"902b4909866e19dd4941f76caeb4a05b1b7a39542f7998d475d743395d018af5"}
Jul 15 14:32:13.382069 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:13.382035    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w"]
Jul 15 14:32:13.385778 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:13.385755    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w"
Jul 15 14:32:13.388689 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:13.388477    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-p66px\""
Jul 15 14:32:13.388689 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:13.388520    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 14:32:13.393157 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:13.393105    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w"]
Jul 15 14:32:13.487437 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:13.487398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thdjv\" (UniqueName: \"kubernetes.io/projected/1713875d-53b3-402d-ac1b-27b70031a603-kube-api-access-thdjv\") pod \"monitoring-plugin-5f68df7f58-v8f5w\" (UID: \"1713875d-53b3-402d-ac1b-27b70031a603\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w"
Jul 15 14:32:13.487607 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:13.487562    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1713875d-53b3-402d-ac1b-27b70031a603-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-v8f5w\" (UID: \"1713875d-53b3-402d-ac1b-27b70031a603\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w"
Jul 15 14:32:13.588892 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:13.588855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1713875d-53b3-402d-ac1b-27b70031a603-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-v8f5w\" (UID: \"1713875d-53b3-402d-ac1b-27b70031a603\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w"
Jul 15 14:32:13.589057 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:13.588926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thdjv\" (UniqueName: \"kubernetes.io/projected/1713875d-53b3-402d-ac1b-27b70031a603-kube-api-access-thdjv\") pod \"monitoring-plugin-5f68df7f58-v8f5w\" (UID: \"1713875d-53b3-402d-ac1b-27b70031a603\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w"
Jul 15 14:32:13.589057 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:32:13.589025    2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 15 14:32:13.589184 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:32:13.589112    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1713875d-53b3-402d-ac1b-27b70031a603-monitoring-plugin-cert podName:1713875d-53b3-402d-ac1b-27b70031a603 nodeName:}" failed. No retries permitted until 2026-07-15 14:32:14.089090276 +0000 UTC m=+95.235771020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1713875d-53b3-402d-ac1b-27b70031a603-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-v8f5w" (UID: "1713875d-53b3-402d-ac1b-27b70031a603") : secret "monitoring-plugin-cert" not found
Jul 15 14:32:13.601894 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:13.601861    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thdjv\" (UniqueName: \"kubernetes.io/projected/1713875d-53b3-402d-ac1b-27b70031a603-kube-api-access-thdjv\") pod \"monitoring-plugin-5f68df7f58-v8f5w\" (UID: \"1713875d-53b3-402d-ac1b-27b70031a603\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w"
Jul 15 14:32:14.094008 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:14.093960    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1713875d-53b3-402d-ac1b-27b70031a603-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-v8f5w\" (UID: \"1713875d-53b3-402d-ac1b-27b70031a603\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w"
Jul 15 14:32:14.096931 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:14.096897    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1713875d-53b3-402d-ac1b-27b70031a603-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-v8f5w\" (UID: \"1713875d-53b3-402d-ac1b-27b70031a603\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w"
Jul 15 14:32:14.299869 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:14.299836    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w"
Jul 15 14:32:14.461927 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:14.461331    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b8d49f79d-hmrhv"]
Jul 15 14:32:14.542824 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:14.542796    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w"]
Jul 15 14:32:14.547349 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:32:14.547322    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1713875d_53b3_402d_ac1b_27b70031a603.slice/crio-9bc596cb6f049389b623e9151e35e78c56df531806e6c168459818c4910ead54 WatchSource:0}: Error finding container 9bc596cb6f049389b623e9151e35e78c56df531806e6c168459818c4910ead54: Status 404 returned error can't find the container with id 9bc596cb6f049389b623e9151e35e78c56df531806e6c168459818c4910ead54
Jul 15 14:32:14.879249 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:14.879208    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8d49f79d-hmrhv" event={"ID":"02ea6f2a-14f3-4fee-8d85-98308514c501","Type":"ContainerStarted","Data":"0a3e4869294bbe72623652302ba76dc1b539592835db92f44c942374b27ca58f"}
Jul 15 14:32:14.880504 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:14.880477    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w" event={"ID":"1713875d-53b3-402d-ac1b-27b70031a603","Type":"ContainerStarted","Data":"9bc596cb6f049389b623e9151e35e78c56df531806e6c168459818c4910ead54"}
Jul 15 14:32:14.882710 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:14.882687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584f777759-g256v" event={"ID":"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8","Type":"ContainerStarted","Data":"18b9d806f2f1bbaadb3998f7bc3404cd82c88bc40044a647290b80e246ea44ec"}
Jul 15 14:32:14.882835 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:14.882763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584f777759-g256v" event={"ID":"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8","Type":"ContainerStarted","Data":"94e09640ea83bd66d7b5aa47f30da0f43c5d82034208f8e4cb3b814d3d66aa7c"}
Jul 15 14:32:14.882835 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:14.882791    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584f777759-g256v" event={"ID":"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8","Type":"ContainerStarted","Data":"ffd262c38ee1e068f3fa6c3bba2789bea5cd7b5b1b474091976c8971d181e77a"}
Jul 15 14:32:14.922854 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:14.922810    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b8d49f79d-hmrhv" podStartSLOduration=1.391737117 podStartE2EDuration="5.922796012s" totalImagesPullingTime="4.531058895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:14.921343604 +0000 UTC m=+96.068024388" watchObservedRunningTime="2026-07-15 14:32:14.922796012 +0000 UTC m=+96.069476778"
Jul 15 14:32:15.694682 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:15.694646    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f8nw2"
Jul 15 14:32:16.893597 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:16.893561    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w" event={"ID":"1713875d-53b3-402d-ac1b-27b70031a603","Type":"ContainerStarted","Data":"73f4cee6a19fd9d37db1ac01ee680310ef31e5e867d91ca55f75ec590e1e56c9"}
Jul 15 14:32:16.894045 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:16.893775    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w"
Jul 15 14:32:16.896827 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:16.896801    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584f777759-g256v" event={"ID":"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8","Type":"ContainerStarted","Data":"d176986fa30e150544188c2e2f7186a4317f54c3c754123bf4aa7cb2f1230370"}
Jul 15 14:32:16.896945 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:16.896854    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584f777759-g256v" event={"ID":"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8","Type":"ContainerStarted","Data":"a05a7c6ca3aef6ff354ca8503192fa125e19cb5251cf531930b302b98bb0f6ae"}
Jul 15 14:32:16.896945 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:16.896880    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584f777759-g256v" event={"ID":"ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8","Type":"ContainerStarted","Data":"4b42f5e92866cc48f64cc74b508ec1c38007f62440b2c9557c91315e919f1d91"}
Jul 15 14:32:16.897028 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:16.896953    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:16.898995 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:16.898976    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w"
Jul 15 14:32:16.913387 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:16.913353    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-v8f5w" podStartSLOduration=2.427947522 podStartE2EDuration="3.913342603s" totalImagesPullingTime="1.485395081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:32:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:16.911995467 +0000 UTC m=+98.058676223" watchObservedRunningTime="2026-07-15 14:32:16.913342603 +0000 UTC m=+98.060023358"
Jul 15 14:32:16.937564 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:16.937525    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-584f777759-g256v" podStartSLOduration=2.3241262369999998 podStartE2EDuration="5.93751255s" totalImagesPullingTime="3.613386313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:32:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:16.93583558 +0000 UTC m=+98.082516337" watchObservedRunningTime="2026-07-15 14:32:16.93751255 +0000 UTC m=+98.084193559"
Jul 15 14:32:18.237799 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:18.237664    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bbcd4f88f-lp87q"]
Jul 15 14:32:19.412703 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:19.412675    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:22.907053 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:22.907024    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-584f777759-g256v"
Jul 15 14:32:39.899573 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:39.899512    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b8d49f79d-hmrhv" podUID="02ea6f2a-14f3-4fee-8d85-98308514c501" containerName="console" containerID="cri-o://0a3e4869294bbe72623652302ba76dc1b539592835db92f44c942374b27ca58f" gracePeriod=15
Jul 15 14:32:40.145808 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.145784    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:40.195123 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.195097    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t4pc\" (UniqueName: \"kubernetes.io/projected/02ea6f2a-14f3-4fee-8d85-98308514c501-kube-api-access-7t4pc\") pod \"02ea6f2a-14f3-4fee-8d85-98308514c501\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") "
Jul 15 14:32:40.195254 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.195157    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-trusted-ca-bundle\") pod \"02ea6f2a-14f3-4fee-8d85-98308514c501\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") "
Jul 15 14:32:40.195254 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.195179    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-console-config\") pod \"02ea6f2a-14f3-4fee-8d85-98308514c501\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") "
Jul 15 14:32:40.195254 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.195213    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02ea6f2a-14f3-4fee-8d85-98308514c501-console-oauth-config\") pod \"02ea6f2a-14f3-4fee-8d85-98308514c501\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") "
Jul 15 14:32:40.195254 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.195236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02ea6f2a-14f3-4fee-8d85-98308514c501-console-serving-cert\") pod \"02ea6f2a-14f3-4fee-8d85-98308514c501\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") "
Jul 15 14:32:40.195254 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.195254    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-service-ca\") pod \"02ea6f2a-14f3-4fee-8d85-98308514c501\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") "
Jul 15 14:32:40.195504 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.195271    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-oauth-serving-cert\") pod \"02ea6f2a-14f3-4fee-8d85-98308514c501\" (UID: \"02ea6f2a-14f3-4fee-8d85-98308514c501\") "
Jul 15 14:32:40.195698 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.195675    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-console-config" (OuterVolumeSpecName: "console-config") pod "02ea6f2a-14f3-4fee-8d85-98308514c501" (UID: "02ea6f2a-14f3-4fee-8d85-98308514c501"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:32:40.195797 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.195777    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "02ea6f2a-14f3-4fee-8d85-98308514c501" (UID: "02ea6f2a-14f3-4fee-8d85-98308514c501"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:32:40.195867 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.195803    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-service-ca" (OuterVolumeSpecName: "service-ca") pod "02ea6f2a-14f3-4fee-8d85-98308514c501" (UID: "02ea6f2a-14f3-4fee-8d85-98308514c501"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:32:40.195867 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.195818    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "02ea6f2a-14f3-4fee-8d85-98308514c501" (UID: "02ea6f2a-14f3-4fee-8d85-98308514c501"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:32:40.197328 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.197286    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02ea6f2a-14f3-4fee-8d85-98308514c501-kube-api-access-7t4pc" (OuterVolumeSpecName: "kube-api-access-7t4pc") pod "02ea6f2a-14f3-4fee-8d85-98308514c501" (UID: "02ea6f2a-14f3-4fee-8d85-98308514c501"). InnerVolumeSpecName "kube-api-access-7t4pc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:32:40.197416 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.197332    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02ea6f2a-14f3-4fee-8d85-98308514c501-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "02ea6f2a-14f3-4fee-8d85-98308514c501" (UID: "02ea6f2a-14f3-4fee-8d85-98308514c501"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:32:40.197416 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.197363    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02ea6f2a-14f3-4fee-8d85-98308514c501-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "02ea6f2a-14f3-4fee-8d85-98308514c501" (UID: "02ea6f2a-14f3-4fee-8d85-98308514c501"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:32:40.296374 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.296348    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t4pc\" (UniqueName: \"kubernetes.io/projected/02ea6f2a-14f3-4fee-8d85-98308514c501-kube-api-access-7t4pc\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:40.296374 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.296372    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-trusted-ca-bundle\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:40.296506 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.296382    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-console-config\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:40.296506 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.296392    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02ea6f2a-14f3-4fee-8d85-98308514c501-console-oauth-config\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:40.296506 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.296400    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02ea6f2a-14f3-4fee-8d85-98308514c501-console-serving-cert\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:40.296506 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.296409    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:40.296506 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.296416    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02ea6f2a-14f3-4fee-8d85-98308514c501-oauth-serving-cert\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:40.993752 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.993703    2581 generic.go:356] "Generic (PLEG): container finished" podID="02ea6f2a-14f3-4fee-8d85-98308514c501" containerID="0a3e4869294bbe72623652302ba76dc1b539592835db92f44c942374b27ca58f" exitCode=0
Jul 15 14:32:40.994084 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.993770    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8d49f79d-hmrhv"
Jul 15 14:32:40.994084 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.993786    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8d49f79d-hmrhv" event={"ID":"02ea6f2a-14f3-4fee-8d85-98308514c501","Type":"ContainerDied","Data":"0a3e4869294bbe72623652302ba76dc1b539592835db92f44c942374b27ca58f"}
Jul 15 14:32:40.994084 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.993833    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8d49f79d-hmrhv" event={"ID":"02ea6f2a-14f3-4fee-8d85-98308514c501","Type":"ContainerDied","Data":"94438de16c8e50f9d672267159df7e6e32e06717f486e303e6fbff1c6a5e3def"}
Jul 15 14:32:40.994084 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.993857    2581 scope.go:117] "RemoveContainer" containerID="0a3e4869294bbe72623652302ba76dc1b539592835db92f44c942374b27ca58f"
Jul 15 14:32:40.995555 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.995533    2581 generic.go:356] "Generic (PLEG): container finished" podID="c804fc5f-df87-47b4-85a8-28d2c5823350" containerID="65bab1c2225ef9dcd28af4912be27712868513aca28436511ecbe840b5136a25" exitCode=0
Jul 15 14:32:40.995632 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.995597    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl" event={"ID":"c804fc5f-df87-47b4-85a8-28d2c5823350","Type":"ContainerDied","Data":"65bab1c2225ef9dcd28af4912be27712868513aca28436511ecbe840b5136a25"}
Jul 15 14:32:40.995921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:40.995907    2581 scope.go:117] "RemoveContainer" containerID="65bab1c2225ef9dcd28af4912be27712868513aca28436511ecbe840b5136a25"
Jul 15 14:32:41.004210 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:41.004195    2581 scope.go:117] "RemoveContainer" containerID="0a3e4869294bbe72623652302ba76dc1b539592835db92f44c942374b27ca58f"
Jul 15 14:32:41.004471 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:32:41.004452    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a3e4869294bbe72623652302ba76dc1b539592835db92f44c942374b27ca58f\": container with ID starting with 0a3e4869294bbe72623652302ba76dc1b539592835db92f44c942374b27ca58f not found: ID does not exist" containerID="0a3e4869294bbe72623652302ba76dc1b539592835db92f44c942374b27ca58f"
Jul 15 14:32:41.004531 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:41.004480    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a3e4869294bbe72623652302ba76dc1b539592835db92f44c942374b27ca58f"} err="failed to get container status \"0a3e4869294bbe72623652302ba76dc1b539592835db92f44c942374b27ca58f\": rpc error: code = NotFound desc = could not find container \"0a3e4869294bbe72623652302ba76dc1b539592835db92f44c942374b27ca58f\": container with ID starting with 0a3e4869294bbe72623652302ba76dc1b539592835db92f44c942374b27ca58f not found: ID does not exist"
Jul 15 14:32:41.036957 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:41.036932    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b8d49f79d-hmrhv"]
Jul 15 14:32:41.046700 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:41.046678    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b8d49f79d-hmrhv"]
Jul 15 14:32:41.379175 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:41.379072    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02ea6f2a-14f3-4fee-8d85-98308514c501" path="/var/lib/kubelet/pods/02ea6f2a-14f3-4fee-8d85-98308514c501/volumes"
Jul 15 14:32:42.002077 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:42.002046    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8pkvl" event={"ID":"c804fc5f-df87-47b4-85a8-28d2c5823350","Type":"ContainerStarted","Data":"132b21f05ddf32c2412f8db9f06da8deeb2a83487a754e63a4d467a8f11452ba"}
Jul 15 14:32:43.258004 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.257968    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q" podUID="8ce30930-ad00-4d77-9b05-307c3f8d44e0" containerName="registry" containerID="cri-o://92abf889d0e370277de1891bfeee45c33d5220d268cb13e1a320e3f235d4efe9" gracePeriod=30
Jul 15 14:32:43.497885 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.497863    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:32:43.523268 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.523126    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ce30930-ad00-4d77-9b05-307c3f8d44e0-trusted-ca\") pod \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") "
Jul 15 14:32:43.523268 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.523174    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ce30930-ad00-4d77-9b05-307c3f8d44e0-image-registry-private-configuration\") pod \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") "
Jul 15 14:32:43.523268 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.523209    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-bound-sa-token\") pod \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") "
Jul 15 14:32:43.524115 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.523505    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls\") pod \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") "
Jul 15 14:32:43.524115 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.523548    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ce30930-ad00-4d77-9b05-307c3f8d44e0-ca-trust-extracted\") pod \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") "
Jul 15 14:32:43.524115 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.523576    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ce30930-ad00-4d77-9b05-307c3f8d44e0-installation-pull-secrets\") pod \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") "
Jul 15 14:32:43.524115 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.523613    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdn9h\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-kube-api-access-jdn9h\") pod \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") "
Jul 15 14:32:43.524115 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.523645    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-certificates\") pod \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\" (UID: \"8ce30930-ad00-4d77-9b05-307c3f8d44e0\") "
Jul 15 14:32:43.524115 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.523690    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce30930-ad00-4d77-9b05-307c3f8d44e0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8ce30930-ad00-4d77-9b05-307c3f8d44e0" (UID: "8ce30930-ad00-4d77-9b05-307c3f8d44e0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:32:43.524115 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.523951    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8ce30930-ad00-4d77-9b05-307c3f8d44e0-trusted-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:43.524864 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.524821    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8ce30930-ad00-4d77-9b05-307c3f8d44e0" (UID: "8ce30930-ad00-4d77-9b05-307c3f8d44e0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:32:43.526815 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.526600    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce30930-ad00-4d77-9b05-307c3f8d44e0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8ce30930-ad00-4d77-9b05-307c3f8d44e0" (UID: "8ce30930-ad00-4d77-9b05-307c3f8d44e0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:32:43.527157 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.527016    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8ce30930-ad00-4d77-9b05-307c3f8d44e0" (UID: "8ce30930-ad00-4d77-9b05-307c3f8d44e0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:32:43.527157 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.527107    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce30930-ad00-4d77-9b05-307c3f8d44e0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8ce30930-ad00-4d77-9b05-307c3f8d44e0" (UID: "8ce30930-ad00-4d77-9b05-307c3f8d44e0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:32:43.527344 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.527222    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8ce30930-ad00-4d77-9b05-307c3f8d44e0" (UID: "8ce30930-ad00-4d77-9b05-307c3f8d44e0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:32:43.528316 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.528281    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-kube-api-access-jdn9h" (OuterVolumeSpecName: "kube-api-access-jdn9h") pod "8ce30930-ad00-4d77-9b05-307c3f8d44e0" (UID: "8ce30930-ad00-4d77-9b05-307c3f8d44e0"). InnerVolumeSpecName "kube-api-access-jdn9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:32:43.535461 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.535430    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce30930-ad00-4d77-9b05-307c3f8d44e0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8ce30930-ad00-4d77-9b05-307c3f8d44e0" (UID: "8ce30930-ad00-4d77-9b05-307c3f8d44e0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:32:43.625234 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.625210    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-tls\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:43.625234 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.625231    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8ce30930-ad00-4d77-9b05-307c3f8d44e0-ca-trust-extracted\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:43.625418 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.625241    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8ce30930-ad00-4d77-9b05-307c3f8d44e0-installation-pull-secrets\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:43.625418 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.625250    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdn9h\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-kube-api-access-jdn9h\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:43.625418 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.625258    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8ce30930-ad00-4d77-9b05-307c3f8d44e0-registry-certificates\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:43.625418 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.625276    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8ce30930-ad00-4d77-9b05-307c3f8d44e0-image-registry-private-configuration\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:43.625418 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:43.625286    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ce30930-ad00-4d77-9b05-307c3f8d44e0-bound-sa-token\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:32:44.010922 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:44.010886    2581 generic.go:356] "Generic (PLEG): container finished" podID="8ce30930-ad00-4d77-9b05-307c3f8d44e0" containerID="92abf889d0e370277de1891bfeee45c33d5220d268cb13e1a320e3f235d4efe9" exitCode=0
Jul 15 14:32:44.011080 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:44.010930    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q"
Jul 15 14:32:44.011080 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:44.010953    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q" event={"ID":"8ce30930-ad00-4d77-9b05-307c3f8d44e0","Type":"ContainerDied","Data":"92abf889d0e370277de1891bfeee45c33d5220d268cb13e1a320e3f235d4efe9"}
Jul 15 14:32:44.011080 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:44.011002    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bbcd4f88f-lp87q" event={"ID":"8ce30930-ad00-4d77-9b05-307c3f8d44e0","Type":"ContainerDied","Data":"7c75f9f983b646c58e3623340d2eb9955cb3f3cabfa24f5bfc3a6d35bdd3b608"}
Jul 15 14:32:44.011080 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:44.011028    2581 scope.go:117] "RemoveContainer" containerID="92abf889d0e370277de1891bfeee45c33d5220d268cb13e1a320e3f235d4efe9"
Jul 15 14:32:44.021844 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:44.021816    2581 scope.go:117] "RemoveContainer" containerID="92abf889d0e370277de1891bfeee45c33d5220d268cb13e1a320e3f235d4efe9"
Jul 15 14:32:44.022445 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:32:44.022423    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92abf889d0e370277de1891bfeee45c33d5220d268cb13e1a320e3f235d4efe9\": container with ID starting with 92abf889d0e370277de1891bfeee45c33d5220d268cb13e1a320e3f235d4efe9 not found: ID does not exist" containerID="92abf889d0e370277de1891bfeee45c33d5220d268cb13e1a320e3f235d4efe9"
Jul 15 14:32:44.022526 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:44.022454    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92abf889d0e370277de1891bfeee45c33d5220d268cb13e1a320e3f235d4efe9"} err="failed to get container status \"92abf889d0e370277de1891bfeee45c33d5220d268cb13e1a320e3f235d4efe9\": rpc error: code = NotFound desc = could not find container \"92abf889d0e370277de1891bfeee45c33d5220d268cb13e1a320e3f235d4efe9\": container with ID starting with 92abf889d0e370277de1891bfeee45c33d5220d268cb13e1a320e3f235d4efe9 not found: ID does not exist"
Jul 15 14:32:44.040659 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:44.040633    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bbcd4f88f-lp87q"]
Jul 15 14:32:44.044638 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:44.044618    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-bbcd4f88f-lp87q"]
Jul 15 14:32:45.379274 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:45.379244    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce30930-ad00-4d77-9b05-307c3f8d44e0" path="/var/lib/kubelet/pods/8ce30930-ad00-4d77-9b05-307c3f8d44e0/volumes"
Jul 15 14:32:47.024982 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:47.024949    2581 generic.go:356] "Generic (PLEG): container finished" podID="9e2b20d7-9a9b-43d7-81a6-d269bca2df7e" containerID="a3a93b73aac1bb6056b410aad28e9955e7475cfc5782a0252c8dfc62679f2b8d" exitCode=0
Jul 15 14:32:47.025375 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:47.025025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st" event={"ID":"9e2b20d7-9a9b-43d7-81a6-d269bca2df7e","Type":"ContainerDied","Data":"a3a93b73aac1bb6056b410aad28e9955e7475cfc5782a0252c8dfc62679f2b8d"}
Jul 15 14:32:47.025375 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:47.025334    2581 scope.go:117] "RemoveContainer" containerID="a3a93b73aac1bb6056b410aad28e9955e7475cfc5782a0252c8dfc62679f2b8d"
Jul 15 14:32:48.031302 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:48.031268    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fk2st" event={"ID":"9e2b20d7-9a9b-43d7-81a6-d269bca2df7e","Type":"ContainerStarted","Data":"3657a51f1817e64f7e11579c2e1b7c44b6bac5425c58b4dec2e9fb0a121cf31b"}
Jul 15 14:32:52.050388 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:52.050354    2581 generic.go:356] "Generic (PLEG): container finished" podID="f33ca220-779c-4d54-8c25-51ee1dacd4b8" containerID="00769954bc22ef64c90ecad3fc02633a8f7b1a981b8d1f8cd34f3079d89e1f34" exitCode=0
Jul 15 14:32:52.050817 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:52.050427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5" event={"ID":"f33ca220-779c-4d54-8c25-51ee1dacd4b8","Type":"ContainerDied","Data":"00769954bc22ef64c90ecad3fc02633a8f7b1a981b8d1f8cd34f3079d89e1f34"}
Jul 15 14:32:52.050817 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:52.050778    2581 scope.go:117] "RemoveContainer" containerID="00769954bc22ef64c90ecad3fc02633a8f7b1a981b8d1f8cd34f3079d89e1f34"
Jul 15 14:32:53.059068 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:32:53.059030    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dj7t5" event={"ID":"f33ca220-779c-4d54-8c25-51ee1dacd4b8","Type":"ContainerStarted","Data":"3b23bc1b03b65c73b152bf15f863cd0d0a7d15a24451e5b7d9afc8686604951e"}
Jul 15 14:33:37.437832 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.437751    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-749d96f8ff-wvlvj"]
Jul 15 14:33:37.438256 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.438066    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce30930-ad00-4d77-9b05-307c3f8d44e0" containerName="registry"
Jul 15 14:33:37.438256 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.438078    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce30930-ad00-4d77-9b05-307c3f8d44e0" containerName="registry"
Jul 15 14:33:37.438256 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.438094    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ea6f2a-14f3-4fee-8d85-98308514c501" containerName="console"
Jul 15 14:33:37.438256 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.438099    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ea6f2a-14f3-4fee-8d85-98308514c501" containerName="console"
Jul 15 14:33:37.438256 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.438172    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce30930-ad00-4d77-9b05-307c3f8d44e0" containerName="registry"
Jul 15 14:33:37.438256 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.438180    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="02ea6f2a-14f3-4fee-8d85-98308514c501" containerName="console"
Jul 15 14:33:37.440408 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.440385    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.444978 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.444960    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 14:33:37.445327 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.445302    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8czzb\""
Jul 15 14:33:37.446180 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.446159    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 14:33:37.446457 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.446435    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 14:33:37.446577 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.446371    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 14:33:37.447551 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.447530    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 14:33:37.447657 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.447622    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 14:33:37.448129 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.447999    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 14:33:37.456156 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.456137    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-749d96f8ff-wvlvj"]
Jul 15 14:33:37.458297 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.458276    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 14:33:37.638968 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.638937    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-oauth-config\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.639127 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.638970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-trusted-ca-bundle\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.639127 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.638996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-serving-cert\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.639205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.639117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-oauth-serving-cert\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.639205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.639169    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-config\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.639267 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.639239    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z425\" (UniqueName: \"kubernetes.io/projected/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-kube-api-access-6z425\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.639299 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.639289    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-service-ca\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.739842 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.739766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-serving-cert\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.739842 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.739812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-oauth-serving-cert\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.739842 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.739830    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-config\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.740075 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.739861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z425\" (UniqueName: \"kubernetes.io/projected/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-kube-api-access-6z425\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.740075 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.739907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-service-ca\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.740075 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.739949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-oauth-config\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.740075 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.739975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-trusted-ca-bundle\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.740584 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.740559    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-config\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.740683 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.740608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-oauth-serving-cert\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.740719 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.740688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-service-ca\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.740878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.740862    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-trusted-ca-bundle\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.742839 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.742817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-serving-cert\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.742949 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.742931    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-oauth-config\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.749574 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.749551    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z425\" (UniqueName: \"kubernetes.io/projected/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-kube-api-access-6z425\") pod \"console-749d96f8ff-wvlvj\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") " pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.750472 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.750456    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:37.885199 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:37.885141    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-749d96f8ff-wvlvj"]
Jul 15 14:33:37.887645 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:33:37.887617    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0dc09c9_7df2_4a69_bb51_9d6d5b161576.slice/crio-2ccd459ad0982be701fb08fe125a3ecb62bff69db8a33267aa6191c747ece149 WatchSource:0}: Error finding container 2ccd459ad0982be701fb08fe125a3ecb62bff69db8a33267aa6191c747ece149: Status 404 returned error can't find the container with id 2ccd459ad0982be701fb08fe125a3ecb62bff69db8a33267aa6191c747ece149
Jul 15 14:33:38.237059 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:38.237026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749d96f8ff-wvlvj" event={"ID":"d0dc09c9-7df2-4a69-bb51-9d6d5b161576","Type":"ContainerStarted","Data":"046c1755b2a7ae9fafc9015368e41c96b6d9fc90fa335feb487f10f480d2e724"}
Jul 15 14:33:38.237228 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:38.237074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749d96f8ff-wvlvj" event={"ID":"d0dc09c9-7df2-4a69-bb51-9d6d5b161576","Type":"ContainerStarted","Data":"2ccd459ad0982be701fb08fe125a3ecb62bff69db8a33267aa6191c747ece149"}
Jul 15 14:33:38.261716 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:38.261664    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-749d96f8ff-wvlvj" podStartSLOduration=1.261650878 podStartE2EDuration="1.261650878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:33:38.26038787 +0000 UTC m=+179.407068646" watchObservedRunningTime="2026-07-15 14:33:38.261650878 +0000 UTC m=+179.408331634"
Jul 15 14:33:47.751478 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:47.751439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:47.751892 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:47.751495    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:47.755865 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:47.755844    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:33:48.279394 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:33:48.279369    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:34:56.875322 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:34:56.875290    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-749d96f8ff-wvlvj"]
Jul 15 14:35:21.895700 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:21.895662    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-749d96f8ff-wvlvj" podUID="d0dc09c9-7df2-4a69-bb51-9d6d5b161576" containerName="console" containerID="cri-o://046c1755b2a7ae9fafc9015368e41c96b6d9fc90fa335feb487f10f480d2e724" gracePeriod=15
Jul 15 14:35:22.132358 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.132334    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:35:22.190925 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.190897    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-oauth-serving-cert\") pod \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") "
Jul 15 14:35:22.191054 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.190968    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-service-ca\") pod \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") "
Jul 15 14:35:22.191054 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.191010    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-serving-cert\") pod \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") "
Jul 15 14:35:22.191054 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.191035    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-trusted-ca-bundle\") pod \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") "
Jul 15 14:35:22.191205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.191062    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-oauth-config\") pod \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") "
Jul 15 14:35:22.191205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.191093    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-config\") pod \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") "
Jul 15 14:35:22.191205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.191121    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z425\" (UniqueName: \"kubernetes.io/projected/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-kube-api-access-6z425\") pod \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\" (UID: \"d0dc09c9-7df2-4a69-bb51-9d6d5b161576\") "
Jul 15 14:35:22.191408 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.191376    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-service-ca" (OuterVolumeSpecName: "service-ca") pod "d0dc09c9-7df2-4a69-bb51-9d6d5b161576" (UID: "d0dc09c9-7df2-4a69-bb51-9d6d5b161576"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:35:22.192060 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.191870    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d0dc09c9-7df2-4a69-bb51-9d6d5b161576" (UID: "d0dc09c9-7df2-4a69-bb51-9d6d5b161576"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:35:22.192060 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.191292    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d0dc09c9-7df2-4a69-bb51-9d6d5b161576" (UID: "d0dc09c9-7df2-4a69-bb51-9d6d5b161576"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:35:22.192060 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.191989    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-config" (OuterVolumeSpecName: "console-config") pod "d0dc09c9-7df2-4a69-bb51-9d6d5b161576" (UID: "d0dc09c9-7df2-4a69-bb51-9d6d5b161576"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:35:22.198344 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.198319    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d0dc09c9-7df2-4a69-bb51-9d6d5b161576" (UID: "d0dc09c9-7df2-4a69-bb51-9d6d5b161576"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:35:22.198798 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.198766    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-kube-api-access-6z425" (OuterVolumeSpecName: "kube-api-access-6z425") pod "d0dc09c9-7df2-4a69-bb51-9d6d5b161576" (UID: "d0dc09c9-7df2-4a69-bb51-9d6d5b161576"). InnerVolumeSpecName "kube-api-access-6z425". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:35:22.198889 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.198801    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d0dc09c9-7df2-4a69-bb51-9d6d5b161576" (UID: "d0dc09c9-7df2-4a69-bb51-9d6d5b161576"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:35:22.292469 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.292447    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-config\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:35:22.292469 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.292465    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z425\" (UniqueName: \"kubernetes.io/projected/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-kube-api-access-6z425\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:35:22.292583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.292474    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-oauth-serving-cert\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:35:22.292583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.292482    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:35:22.292583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.292490    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-serving-cert\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:35:22.292583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.292498    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-trusted-ca-bundle\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:35:22.292583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.292506    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0dc09c9-7df2-4a69-bb51-9d6d5b161576-console-oauth-config\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:35:22.633327 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.633222    2581 generic.go:356] "Generic (PLEG): container finished" podID="d0dc09c9-7df2-4a69-bb51-9d6d5b161576" containerID="046c1755b2a7ae9fafc9015368e41c96b6d9fc90fa335feb487f10f480d2e724" exitCode=0
Jul 15 14:35:22.633327 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.633302    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749d96f8ff-wvlvj"
Jul 15 14:35:22.633487 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.633321    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749d96f8ff-wvlvj" event={"ID":"d0dc09c9-7df2-4a69-bb51-9d6d5b161576","Type":"ContainerDied","Data":"046c1755b2a7ae9fafc9015368e41c96b6d9fc90fa335feb487f10f480d2e724"}
Jul 15 14:35:22.633487 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.633370    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749d96f8ff-wvlvj" event={"ID":"d0dc09c9-7df2-4a69-bb51-9d6d5b161576","Type":"ContainerDied","Data":"2ccd459ad0982be701fb08fe125a3ecb62bff69db8a33267aa6191c747ece149"}
Jul 15 14:35:22.633487 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.633390    2581 scope.go:117] "RemoveContainer" containerID="046c1755b2a7ae9fafc9015368e41c96b6d9fc90fa335feb487f10f480d2e724"
Jul 15 14:35:22.642076 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.642061    2581 scope.go:117] "RemoveContainer" containerID="046c1755b2a7ae9fafc9015368e41c96b6d9fc90fa335feb487f10f480d2e724"
Jul 15 14:35:22.642313 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:35:22.642295    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046c1755b2a7ae9fafc9015368e41c96b6d9fc90fa335feb487f10f480d2e724\": container with ID starting with 046c1755b2a7ae9fafc9015368e41c96b6d9fc90fa335feb487f10f480d2e724 not found: ID does not exist" containerID="046c1755b2a7ae9fafc9015368e41c96b6d9fc90fa335feb487f10f480d2e724"
Jul 15 14:35:22.642366 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.642321    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046c1755b2a7ae9fafc9015368e41c96b6d9fc90fa335feb487f10f480d2e724"} err="failed to get container status \"046c1755b2a7ae9fafc9015368e41c96b6d9fc90fa335feb487f10f480d2e724\": rpc error: code = NotFound desc = could not find container \"046c1755b2a7ae9fafc9015368e41c96b6d9fc90fa335feb487f10f480d2e724\": container with ID starting with 046c1755b2a7ae9fafc9015368e41c96b6d9fc90fa335feb487f10f480d2e724 not found: ID does not exist"
Jul 15 14:35:22.656998 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.656975    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-749d96f8ff-wvlvj"]
Jul 15 14:35:22.660559 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:22.660538    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-749d96f8ff-wvlvj"]
Jul 15 14:35:23.380321 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:23.380275    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0dc09c9-7df2-4a69-bb51-9d6d5b161576" path="/var/lib/kubelet/pods/d0dc09c9-7df2-4a69-bb51-9d6d5b161576/volumes"
Jul 15 14:35:39.221505 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:39.221478    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 14:35:39.222038 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:39.221531    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 14:35:39.226802 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:39.226781    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:35:39.226929 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:39.226918    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:35:39.232676 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:35:39.232650    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 14:37:27.071635 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.071585    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"]
Jul 15 14:37:27.072089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.071997    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0dc09c9-7df2-4a69-bb51-9d6d5b161576" containerName="console"
Jul 15 14:37:27.072089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.072012    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0dc09c9-7df2-4a69-bb51-9d6d5b161576" containerName="console"
Jul 15 14:37:27.072089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.072078    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0dc09c9-7df2-4a69-bb51-9d6d5b161576" containerName="console"
Jul 15 14:37:27.075059 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.075042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"
Jul 15 14:37:27.077975 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.077958    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v6p97\""
Jul 15 14:37:27.078057 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.078024    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 14:37:27.079211 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.079194    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 14:37:27.096368 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.096348    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"]
Jul 15 14:37:27.182663 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.182640    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d21c2ec-a341-423e-b64b-ec44e1e56132-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4\" (UID: \"8d21c2ec-a341-423e-b64b-ec44e1e56132\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"
Jul 15 14:37:27.182795 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.182686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d21c2ec-a341-423e-b64b-ec44e1e56132-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4\" (UID: \"8d21c2ec-a341-423e-b64b-ec44e1e56132\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"
Jul 15 14:37:27.182795 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.182747    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z62xk\" (UniqueName: \"kubernetes.io/projected/8d21c2ec-a341-423e-b64b-ec44e1e56132-kube-api-access-z62xk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4\" (UID: \"8d21c2ec-a341-423e-b64b-ec44e1e56132\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"
Jul 15 14:37:27.283569 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.283544    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z62xk\" (UniqueName: \"kubernetes.io/projected/8d21c2ec-a341-423e-b64b-ec44e1e56132-kube-api-access-z62xk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4\" (UID: \"8d21c2ec-a341-423e-b64b-ec44e1e56132\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"
Jul 15 14:37:27.283671 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.283589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d21c2ec-a341-423e-b64b-ec44e1e56132-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4\" (UID: \"8d21c2ec-a341-423e-b64b-ec44e1e56132\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"
Jul 15 14:37:27.283671 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.283636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d21c2ec-a341-423e-b64b-ec44e1e56132-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4\" (UID: \"8d21c2ec-a341-423e-b64b-ec44e1e56132\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"
Jul 15 14:37:27.284040 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.284020    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d21c2ec-a341-423e-b64b-ec44e1e56132-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4\" (UID: \"8d21c2ec-a341-423e-b64b-ec44e1e56132\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"
Jul 15 14:37:27.284083 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.284038    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d21c2ec-a341-423e-b64b-ec44e1e56132-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4\" (UID: \"8d21c2ec-a341-423e-b64b-ec44e1e56132\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"
Jul 15 14:37:27.292841 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.292815    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z62xk\" (UniqueName: \"kubernetes.io/projected/8d21c2ec-a341-423e-b64b-ec44e1e56132-kube-api-access-z62xk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4\" (UID: \"8d21c2ec-a341-423e-b64b-ec44e1e56132\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"
Jul 15 14:37:27.384779 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.384711    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"
Jul 15 14:37:27.512486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.512462    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"]
Jul 15 14:37:27.514388 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:37:27.514363    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d21c2ec_a341_423e_b64b_ec44e1e56132.slice/crio-deae9f16d507231d1506f066d21a2a496501d7c39b2145a2f6f16a0c26b23c7b WatchSource:0}: Error finding container deae9f16d507231d1506f066d21a2a496501d7c39b2145a2f6f16a0c26b23c7b: Status 404 returned error can't find the container with id deae9f16d507231d1506f066d21a2a496501d7c39b2145a2f6f16a0c26b23c7b
Jul 15 14:37:27.516319 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:27.516299    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 14:37:28.121431 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:28.121394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4" event={"ID":"8d21c2ec-a341-423e-b64b-ec44e1e56132","Type":"ContainerStarted","Data":"deae9f16d507231d1506f066d21a2a496501d7c39b2145a2f6f16a0c26b23c7b"}
Jul 15 14:37:35.156031 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:35.155945    2581 generic.go:356] "Generic (PLEG): container finished" podID="8d21c2ec-a341-423e-b64b-ec44e1e56132" containerID="1f27cca995f90578e4454b54b48b92d9a7f948b8f81f7f7faeb61377bb8969fa" exitCode=0
Jul 15 14:37:35.156417 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:35.156025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4" event={"ID":"8d21c2ec-a341-423e-b64b-ec44e1e56132","Type":"ContainerDied","Data":"1f27cca995f90578e4454b54b48b92d9a7f948b8f81f7f7faeb61377bb8969fa"}
Jul 15 14:37:38.170679 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:38.170643    2581 generic.go:356] "Generic (PLEG): container finished" podID="8d21c2ec-a341-423e-b64b-ec44e1e56132" containerID="790d5e8510e7de97cb570a82cc9130e8a1ce1cf7702c5a6eef3572aa276186de" exitCode=0
Jul 15 14:37:38.170679 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:38.170685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4" event={"ID":"8d21c2ec-a341-423e-b64b-ec44e1e56132","Type":"ContainerDied","Data":"790d5e8510e7de97cb570a82cc9130e8a1ce1cf7702c5a6eef3572aa276186de"}
Jul 15 14:37:47.210602 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:47.210568    2581 generic.go:356] "Generic (PLEG): container finished" podID="8d21c2ec-a341-423e-b64b-ec44e1e56132" containerID="41b5f304e344d7b805c10a2a3b05072065d59573b9ff2e5dc8a54143d4860d6e" exitCode=0
Jul 15 14:37:47.210972 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:47.210621    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4" event={"ID":"8d21c2ec-a341-423e-b64b-ec44e1e56132","Type":"ContainerDied","Data":"41b5f304e344d7b805c10a2a3b05072065d59573b9ff2e5dc8a54143d4860d6e"}
Jul 15 14:37:48.337504 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:48.337481    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"
Jul 15 14:37:48.463694 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:48.463667    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d21c2ec-a341-423e-b64b-ec44e1e56132-bundle\") pod \"8d21c2ec-a341-423e-b64b-ec44e1e56132\" (UID: \"8d21c2ec-a341-423e-b64b-ec44e1e56132\") "
Jul 15 14:37:48.463694 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:48.463700    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d21c2ec-a341-423e-b64b-ec44e1e56132-util\") pod \"8d21c2ec-a341-423e-b64b-ec44e1e56132\" (UID: \"8d21c2ec-a341-423e-b64b-ec44e1e56132\") "
Jul 15 14:37:48.463894 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:48.463757    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z62xk\" (UniqueName: \"kubernetes.io/projected/8d21c2ec-a341-423e-b64b-ec44e1e56132-kube-api-access-z62xk\") pod \"8d21c2ec-a341-423e-b64b-ec44e1e56132\" (UID: \"8d21c2ec-a341-423e-b64b-ec44e1e56132\") "
Jul 15 14:37:48.464389 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:48.464363    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d21c2ec-a341-423e-b64b-ec44e1e56132-bundle" (OuterVolumeSpecName: "bundle") pod "8d21c2ec-a341-423e-b64b-ec44e1e56132" (UID: "8d21c2ec-a341-423e-b64b-ec44e1e56132"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:37:48.466167 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:48.466101    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d21c2ec-a341-423e-b64b-ec44e1e56132-kube-api-access-z62xk" (OuterVolumeSpecName: "kube-api-access-z62xk") pod "8d21c2ec-a341-423e-b64b-ec44e1e56132" (UID: "8d21c2ec-a341-423e-b64b-ec44e1e56132"). InnerVolumeSpecName "kube-api-access-z62xk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:37:48.468444 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:48.468420    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d21c2ec-a341-423e-b64b-ec44e1e56132-util" (OuterVolumeSpecName: "util") pod "8d21c2ec-a341-423e-b64b-ec44e1e56132" (UID: "8d21c2ec-a341-423e-b64b-ec44e1e56132"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:37:48.564510 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:48.564483    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z62xk\" (UniqueName: \"kubernetes.io/projected/8d21c2ec-a341-423e-b64b-ec44e1e56132-kube-api-access-z62xk\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:37:48.564510 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:48.564506    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d21c2ec-a341-423e-b64b-ec44e1e56132-bundle\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:37:48.564510 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:48.564516    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d21c2ec-a341-423e-b64b-ec44e1e56132-util\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:37:49.220184 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:49.220155    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4" event={"ID":"8d21c2ec-a341-423e-b64b-ec44e1e56132","Type":"ContainerDied","Data":"deae9f16d507231d1506f066d21a2a496501d7c39b2145a2f6f16a0c26b23c7b"}
Jul 15 14:37:49.220184 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:49.220178    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l87w4"
Jul 15 14:37:49.220379 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:37:49.220199    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="deae9f16d507231d1506f066d21a2a496501d7c39b2145a2f6f16a0c26b23c7b"
Jul 15 14:38:00.051505 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.051463    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"]
Jul 15 14:38:00.052116 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.051931    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d21c2ec-a341-423e-b64b-ec44e1e56132" containerName="extract"
Jul 15 14:38:00.052116 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.051950    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d21c2ec-a341-423e-b64b-ec44e1e56132" containerName="extract"
Jul 15 14:38:00.052116 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.051985    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d21c2ec-a341-423e-b64b-ec44e1e56132" containerName="util"
Jul 15 14:38:00.052116 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.051994    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d21c2ec-a341-423e-b64b-ec44e1e56132" containerName="util"
Jul 15 14:38:00.052116 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.052007    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d21c2ec-a341-423e-b64b-ec44e1e56132" containerName="pull"
Jul 15 14:38:00.052116 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.052014    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d21c2ec-a341-423e-b64b-ec44e1e56132" containerName="pull"
Jul 15 14:38:00.052116 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.052101    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d21c2ec-a341-423e-b64b-ec44e1e56132" containerName="extract"
Jul 15 14:38:00.056973 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.056950    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"
Jul 15 14:38:00.062240 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.062220    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v6p97\""
Jul 15 14:38:00.063201 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.063154    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 14:38:00.063201 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.063167    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 14:38:00.099161 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.099136    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"]
Jul 15 14:38:00.148940 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.148916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d\" (UID: \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"
Jul 15 14:38:00.149048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.148945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r24n\" (UniqueName: \"kubernetes.io/projected/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-kube-api-access-4r24n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d\" (UID: \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"
Jul 15 14:38:00.149048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.149031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d\" (UID: \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"
Jul 15 14:38:00.249678 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.249645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d\" (UID: \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"
Jul 15 14:38:00.249817 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.249703    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d\" (UID: \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"
Jul 15 14:38:00.249817 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.249753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r24n\" (UniqueName: \"kubernetes.io/projected/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-kube-api-access-4r24n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d\" (UID: \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"
Jul 15 14:38:00.250128 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.250111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d\" (UID: \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"
Jul 15 14:38:00.250163 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.250120    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d\" (UID: \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"
Jul 15 14:38:00.277096 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.277067    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r24n\" (UniqueName: \"kubernetes.io/projected/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-kube-api-access-4r24n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d\" (UID: \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"
Jul 15 14:38:00.365920 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.365862    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"
Jul 15 14:38:00.539615 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:38:00.539587    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e2d6a0_f863_42ab_9ea1_3601b3722b27.slice/crio-625756ffef5d9b9284605465b55c18742b75c32a1ebf1801de1af935af98c7b1 WatchSource:0}: Error finding container 625756ffef5d9b9284605465b55c18742b75c32a1ebf1801de1af935af98c7b1: Status 404 returned error can't find the container with id 625756ffef5d9b9284605465b55c18742b75c32a1ebf1801de1af935af98c7b1
Jul 15 14:38:00.548970 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:00.548949    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"]
Jul 15 14:38:01.276028 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:01.275933    2581 generic.go:356] "Generic (PLEG): container finished" podID="c6e2d6a0-f863-42ab-9ea1-3601b3722b27" containerID="8b510324525441f9b0f70cf8c337c5bbc3c9ce0078b3b28a88b4ecdc253c2c22" exitCode=0
Jul 15 14:38:01.276028 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:01.276021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d" event={"ID":"c6e2d6a0-f863-42ab-9ea1-3601b3722b27","Type":"ContainerDied","Data":"8b510324525441f9b0f70cf8c337c5bbc3c9ce0078b3b28a88b4ecdc253c2c22"}
Jul 15 14:38:01.276420 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:01.276064    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d" event={"ID":"c6e2d6a0-f863-42ab-9ea1-3601b3722b27","Type":"ContainerStarted","Data":"625756ffef5d9b9284605465b55c18742b75c32a1ebf1801de1af935af98c7b1"}
Jul 15 14:38:02.942374 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:02.942336    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sbcwj"]
Jul 15 14:38:02.948829 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:02.948806    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sbcwj"
Jul 15 14:38:02.952286 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:02.952259    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 14:38:02.952286 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:02.952277    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 14:38:02.953558 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:02.953538    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mhg2z\""
Jul 15 14:38:02.960433 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:02.960410    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sbcwj"]
Jul 15 14:38:03.074028 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:03.073996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kgn9\" (UniqueName: \"kubernetes.io/projected/55b3b0a0-763a-4293-834a-8c4721dfc4b9-kube-api-access-4kgn9\") pod \"cert-manager-cainjector-559cdd8c87-sbcwj\" (UID: \"55b3b0a0-763a-4293-834a-8c4721dfc4b9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sbcwj"
Jul 15 14:38:03.074202 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:03.074101    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55b3b0a0-763a-4293-834a-8c4721dfc4b9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sbcwj\" (UID: \"55b3b0a0-763a-4293-834a-8c4721dfc4b9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sbcwj"
Jul 15 14:38:03.175063 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:03.175027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55b3b0a0-763a-4293-834a-8c4721dfc4b9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sbcwj\" (UID: \"55b3b0a0-763a-4293-834a-8c4721dfc4b9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sbcwj"
Jul 15 14:38:03.175299 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:03.175105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kgn9\" (UniqueName: \"kubernetes.io/projected/55b3b0a0-763a-4293-834a-8c4721dfc4b9-kube-api-access-4kgn9\") pod \"cert-manager-cainjector-559cdd8c87-sbcwj\" (UID: \"55b3b0a0-763a-4293-834a-8c4721dfc4b9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sbcwj"
Jul 15 14:38:03.187660 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:03.187630    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55b3b0a0-763a-4293-834a-8c4721dfc4b9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sbcwj\" (UID: \"55b3b0a0-763a-4293-834a-8c4721dfc4b9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sbcwj"
Jul 15 14:38:03.187830 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:03.187775    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kgn9\" (UniqueName: \"kubernetes.io/projected/55b3b0a0-763a-4293-834a-8c4721dfc4b9-kube-api-access-4kgn9\") pod \"cert-manager-cainjector-559cdd8c87-sbcwj\" (UID: \"55b3b0a0-763a-4293-834a-8c4721dfc4b9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sbcwj"
Jul 15 14:38:03.269566 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:03.269501    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sbcwj"
Jul 15 14:38:03.444516 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:03.444489    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sbcwj"]
Jul 15 14:38:03.446397 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:38:03.446367    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55b3b0a0_763a_4293_834a_8c4721dfc4b9.slice/crio-13632427bacfe900a38c4d3663fa69a51bfb7edee6ac7b5fb5c66c9c88de0a64 WatchSource:0}: Error finding container 13632427bacfe900a38c4d3663fa69a51bfb7edee6ac7b5fb5c66c9c88de0a64: Status 404 returned error can't find the container with id 13632427bacfe900a38c4d3663fa69a51bfb7edee6ac7b5fb5c66c9c88de0a64
Jul 15 14:38:04.297167 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:04.297128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sbcwj" event={"ID":"55b3b0a0-763a-4293-834a-8c4721dfc4b9","Type":"ContainerStarted","Data":"13632427bacfe900a38c4d3663fa69a51bfb7edee6ac7b5fb5c66c9c88de0a64"}
Jul 15 14:38:04.299394 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:04.299361    2581 generic.go:356] "Generic (PLEG): container finished" podID="c6e2d6a0-f863-42ab-9ea1-3601b3722b27" containerID="bfb86ab3f185867f28ac087b2e0408549f436442c94efbc288ff5000a2e7ca91" exitCode=0
Jul 15 14:38:04.299521 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:04.299418    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d" event={"ID":"c6e2d6a0-f863-42ab-9ea1-3601b3722b27","Type":"ContainerDied","Data":"bfb86ab3f185867f28ac087b2e0408549f436442c94efbc288ff5000a2e7ca91"}
Jul 15 14:38:05.306625 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:05.306595    2581 generic.go:356] "Generic (PLEG): container finished" podID="c6e2d6a0-f863-42ab-9ea1-3601b3722b27" containerID="ec2aa9496ed50550db95d3f4db3cdd35bf10b0a8d731d14a05824191c34baae0" exitCode=0
Jul 15 14:38:05.307074 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:05.306684    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d" event={"ID":"c6e2d6a0-f863-42ab-9ea1-3601b3722b27","Type":"ContainerDied","Data":"ec2aa9496ed50550db95d3f4db3cdd35bf10b0a8d731d14a05824191c34baae0"}
Jul 15 14:38:06.312882 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:06.312839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sbcwj" event={"ID":"55b3b0a0-763a-4293-834a-8c4721dfc4b9","Type":"ContainerStarted","Data":"a75eee285cd8a6fb2f97c9eee5fd7d4941cc90996ac03d4979c3fa9c96788517"}
Jul 15 14:38:06.336688 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:06.335472    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sbcwj" podStartSLOduration=1.899392866 podStartE2EDuration="4.335450263s" totalImagesPullingTime="2.436057397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:38:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:38:06.33419622 +0000 UTC m=+447.480876986" watchObservedRunningTime="2026-07-15 14:38:06.335450263 +0000 UTC m=+447.482131022"
Jul 15 14:38:06.445366 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:06.445341    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"
Jul 15 14:38:06.602476 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:06.602399    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-bundle\") pod \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\" (UID: \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\") "
Jul 15 14:38:06.602476 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:06.602438    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4r24n\" (UniqueName: \"kubernetes.io/projected/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-kube-api-access-4r24n\") pod \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\" (UID: \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\") "
Jul 15 14:38:06.602476 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:06.602466    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-util\") pod \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\" (UID: \"c6e2d6a0-f863-42ab-9ea1-3601b3722b27\") "
Jul 15 14:38:06.602891 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:06.602860    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-bundle" (OuterVolumeSpecName: "bundle") pod "c6e2d6a0-f863-42ab-9ea1-3601b3722b27" (UID: "c6e2d6a0-f863-42ab-9ea1-3601b3722b27"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:38:06.604510 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:06.604483    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-kube-api-access-4r24n" (OuterVolumeSpecName: "kube-api-access-4r24n") pod "c6e2d6a0-f863-42ab-9ea1-3601b3722b27" (UID: "c6e2d6a0-f863-42ab-9ea1-3601b3722b27"). InnerVolumeSpecName "kube-api-access-4r24n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:38:06.606848 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:06.606821    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-util" (OuterVolumeSpecName: "util") pod "c6e2d6a0-f863-42ab-9ea1-3601b3722b27" (UID: "c6e2d6a0-f863-42ab-9ea1-3601b3722b27"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:38:06.703154 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:06.703122    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-bundle\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:38:06.703154 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:06.703150    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r24n\" (UniqueName: \"kubernetes.io/projected/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-kube-api-access-4r24n\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:38:06.703154 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:06.703162    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6e2d6a0-f863-42ab-9ea1-3601b3722b27-util\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:38:07.318704 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:07.318666    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d" event={"ID":"c6e2d6a0-f863-42ab-9ea1-3601b3722b27","Type":"ContainerDied","Data":"625756ffef5d9b9284605465b55c18742b75c32a1ebf1801de1af935af98c7b1"}
Jul 15 14:38:07.318704 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:07.318695    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmbx5d"
Jul 15 14:38:07.319151 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:07.318716    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="625756ffef5d9b9284605465b55c18742b75c32a1ebf1801de1af935af98c7b1"
Jul 15 14:38:11.106222 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.106188    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b4c6p"]
Jul 15 14:38:11.106635 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.106505    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e2d6a0-f863-42ab-9ea1-3601b3722b27" containerName="util"
Jul 15 14:38:11.106635 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.106516    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e2d6a0-f863-42ab-9ea1-3601b3722b27" containerName="util"
Jul 15 14:38:11.106635 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.106532    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e2d6a0-f863-42ab-9ea1-3601b3722b27" containerName="pull"
Jul 15 14:38:11.106635 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.106537    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e2d6a0-f863-42ab-9ea1-3601b3722b27" containerName="pull"
Jul 15 14:38:11.106635 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.106549    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e2d6a0-f863-42ab-9ea1-3601b3722b27" containerName="extract"
Jul 15 14:38:11.106635 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.106554    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e2d6a0-f863-42ab-9ea1-3601b3722b27" containerName="extract"
Jul 15 14:38:11.106635 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.106607    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6e2d6a0-f863-42ab-9ea1-3601b3722b27" containerName="extract"
Jul 15 14:38:11.110565 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.110549    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-b4c6p"
Jul 15 14:38:11.113646 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.113627    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jrvqh\""
Jul 15 14:38:11.123409 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.123388    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b4c6p"]
Jul 15 14:38:11.131609 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.131589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xqkz\" (UniqueName: \"kubernetes.io/projected/da1d86c3-08a1-4afe-91da-88b227e88d76-kube-api-access-6xqkz\") pod \"cert-manager-55b4d954d5-b4c6p\" (UID: \"da1d86c3-08a1-4afe-91da-88b227e88d76\") " pod="cert-manager/cert-manager-55b4d954d5-b4c6p"
Jul 15 14:38:11.131702 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.131625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da1d86c3-08a1-4afe-91da-88b227e88d76-bound-sa-token\") pod \"cert-manager-55b4d954d5-b4c6p\" (UID: \"da1d86c3-08a1-4afe-91da-88b227e88d76\") " pod="cert-manager/cert-manager-55b4d954d5-b4c6p"
Jul 15 14:38:11.232407 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.232382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xqkz\" (UniqueName: \"kubernetes.io/projected/da1d86c3-08a1-4afe-91da-88b227e88d76-kube-api-access-6xqkz\") pod \"cert-manager-55b4d954d5-b4c6p\" (UID: \"da1d86c3-08a1-4afe-91da-88b227e88d76\") " pod="cert-manager/cert-manager-55b4d954d5-b4c6p"
Jul 15 14:38:11.232528 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.232435    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da1d86c3-08a1-4afe-91da-88b227e88d76-bound-sa-token\") pod \"cert-manager-55b4d954d5-b4c6p\" (UID: \"da1d86c3-08a1-4afe-91da-88b227e88d76\") " pod="cert-manager/cert-manager-55b4d954d5-b4c6p"
Jul 15 14:38:11.242349 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.242327    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da1d86c3-08a1-4afe-91da-88b227e88d76-bound-sa-token\") pod \"cert-manager-55b4d954d5-b4c6p\" (UID: \"da1d86c3-08a1-4afe-91da-88b227e88d76\") " pod="cert-manager/cert-manager-55b4d954d5-b4c6p"
Jul 15 14:38:11.243669 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.243652    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xqkz\" (UniqueName: \"kubernetes.io/projected/da1d86c3-08a1-4afe-91da-88b227e88d76-kube-api-access-6xqkz\") pod \"cert-manager-55b4d954d5-b4c6p\" (UID: \"da1d86c3-08a1-4afe-91da-88b227e88d76\") " pod="cert-manager/cert-manager-55b4d954d5-b4c6p"
Jul 15 14:38:11.419217 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.419195    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-b4c6p"
Jul 15 14:38:11.572819 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:11.572794    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b4c6p"]
Jul 15 14:38:11.574914 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:38:11.574889    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda1d86c3_08a1_4afe_91da_88b227e88d76.slice/crio-880327ab50c7767213d7443d737c34339fa790d60dfd44ff0385749c3c27ab0c WatchSource:0}: Error finding container 880327ab50c7767213d7443d737c34339fa790d60dfd44ff0385749c3c27ab0c: Status 404 returned error can't find the container with id 880327ab50c7767213d7443d737c34339fa790d60dfd44ff0385749c3c27ab0c
Jul 15 14:38:12.339584 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:12.339550    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-b4c6p" event={"ID":"da1d86c3-08a1-4afe-91da-88b227e88d76","Type":"ContainerStarted","Data":"3d0680a392e958757265800c3f674720c93535c47ebeed13707498baa0528c7c"}
Jul 15 14:38:12.339584 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:12.339586    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-b4c6p" event={"ID":"da1d86c3-08a1-4afe-91da-88b227e88d76","Type":"ContainerStarted","Data":"880327ab50c7767213d7443d737c34339fa790d60dfd44ff0385749c3c27ab0c"}
Jul 15 14:38:12.363251 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:12.363209    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-b4c6p" podStartSLOduration=1.363193802 podStartE2EDuration="1.363193802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:38:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:38:12.363120005 +0000 UTC m=+453.509800780" watchObservedRunningTime="2026-07-15 14:38:12.363193802 +0000 UTC m=+453.509874558"
Jul 15 14:38:18.824403 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.824373    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"]
Jul 15 14:38:18.829209 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.829190    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"
Jul 15 14:38:18.832042 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.832024    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 14:38:18.833278 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.833253    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v6p97\""
Jul 15 14:38:18.833278 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.833262    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 14:38:18.835246 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.835223    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"]
Jul 15 14:38:18.888052 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.888022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv89p\" (UniqueName: \"kubernetes.io/projected/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-kube-api-access-hv89p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt\" (UID: \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"
Jul 15 14:38:18.888154 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.888058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt\" (UID: \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"
Jul 15 14:38:18.888154 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.888118    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt\" (UID: \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"
Jul 15 14:38:18.988565 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.988540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt\" (UID: \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"
Jul 15 14:38:18.988658 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.988577    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt\" (UID: \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"
Jul 15 14:38:18.988658 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.988623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv89p\" (UniqueName: \"kubernetes.io/projected/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-kube-api-access-hv89p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt\" (UID: \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"
Jul 15 14:38:18.988900 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.988882    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt\" (UID: \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"
Jul 15 14:38:18.988968 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.988934    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt\" (UID: \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"
Jul 15 14:38:18.997528 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:18.997509    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv89p\" (UniqueName: \"kubernetes.io/projected/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-kube-api-access-hv89p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt\" (UID: \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"
Jul 15 14:38:19.139946 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:19.139878    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"
Jul 15 14:38:19.270331 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:19.270306    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"]
Jul 15 14:38:19.272879 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:38:19.272845    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda012f14f_eff6_48b3_b8a8_0e9cc5ee6c4d.slice/crio-ae31cb4472fb757fcfb04b60ffd1da43499630684094149407ebb6c66fbba626 WatchSource:0}: Error finding container ae31cb4472fb757fcfb04b60ffd1da43499630684094149407ebb6c66fbba626: Status 404 returned error can't find the container with id ae31cb4472fb757fcfb04b60ffd1da43499630684094149407ebb6c66fbba626
Jul 15 14:38:19.373961 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:19.373920    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt" event={"ID":"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d","Type":"ContainerStarted","Data":"71e004e4e385ee13390140f7440ca45328862608879b529404830c4667e0e4ad"}
Jul 15 14:38:19.374198 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:19.374019    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt" event={"ID":"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d","Type":"ContainerStarted","Data":"ae31cb4472fb757fcfb04b60ffd1da43499630684094149407ebb6c66fbba626"}
Jul 15 14:38:20.380034 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:20.379950    2581 generic.go:356] "Generic (PLEG): container finished" podID="a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d" containerID="71e004e4e385ee13390140f7440ca45328862608879b529404830c4667e0e4ad" exitCode=0
Jul 15 14:38:20.380034 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:20.380021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt" event={"ID":"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d","Type":"ContainerDied","Data":"71e004e4e385ee13390140f7440ca45328862608879b529404830c4667e0e4ad"}
Jul 15 14:38:21.385359 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:21.385288    2581 generic.go:356] "Generic (PLEG): container finished" podID="a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d" containerID="55de00ab8f26dfbf2bf25a1bb5a93d29721517b3b64dbcff1d6b706929d55ff1" exitCode=0
Jul 15 14:38:21.385359 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:21.385327    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt" event={"ID":"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d","Type":"ContainerDied","Data":"55de00ab8f26dfbf2bf25a1bb5a93d29721517b3b64dbcff1d6b706929d55ff1"}
Jul 15 14:38:22.391685 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:22.391649    2581 generic.go:356] "Generic (PLEG): container finished" podID="a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d" containerID="fdaf853ec40654401e7dc5164ca42732b6d628ebfc6ee1b5bfdd038dde45a51e" exitCode=0
Jul 15 14:38:22.392113 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:22.391722    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt" event={"ID":"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d","Type":"ContainerDied","Data":"fdaf853ec40654401e7dc5164ca42732b6d628ebfc6ee1b5bfdd038dde45a51e"}
Jul 15 14:38:23.516709 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:23.516687    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"
Jul 15 14:38:23.627331 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:23.627304    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-bundle\") pod \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\" (UID: \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\") "
Jul 15 14:38:23.627486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:23.627358    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv89p\" (UniqueName: \"kubernetes.io/projected/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-kube-api-access-hv89p\") pod \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\" (UID: \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\") "
Jul 15 14:38:23.627486 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:23.627385    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-util\") pod \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\" (UID: \"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d\") "
Jul 15 14:38:23.628095 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:23.628070    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-bundle" (OuterVolumeSpecName: "bundle") pod "a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d" (UID: "a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:38:23.629499 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:23.629471    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-kube-api-access-hv89p" (OuterVolumeSpecName: "kube-api-access-hv89p") pod "a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d" (UID: "a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d"). InnerVolumeSpecName "kube-api-access-hv89p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:38:23.632911 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:23.632879    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-util" (OuterVolumeSpecName: "util") pod "a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d" (UID: "a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:38:23.728145 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:23.728114    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-util\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:38:23.728145 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:23.728144    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-bundle\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:38:23.728145 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:23.728153    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv89p\" (UniqueName: \"kubernetes.io/projected/a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d-kube-api-access-hv89p\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:38:24.400918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:24.400887    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt"
Jul 15 14:38:24.401081 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:24.400916    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpj6bt" event={"ID":"a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d","Type":"ContainerDied","Data":"ae31cb4472fb757fcfb04b60ffd1da43499630684094149407ebb6c66fbba626"}
Jul 15 14:38:24.401081 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:24.400961    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae31cb4472fb757fcfb04b60ffd1da43499630684094149407ebb6c66fbba626"
Jul 15 14:38:35.021039 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.021005    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"]
Jul 15 14:38:35.021441 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.021326    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d" containerName="extract"
Jul 15 14:38:35.021441 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.021337    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d" containerName="extract"
Jul 15 14:38:35.021441 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.021347    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d" containerName="pull"
Jul 15 14:38:35.021441 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.021352    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d" containerName="pull"
Jul 15 14:38:35.021441 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.021363    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d" containerName="util"
Jul 15 14:38:35.021441 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.021368    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d" containerName="util"
Jul 15 14:38:35.021441 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.021421    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a012f14f-eff6-48b3-b8a8-0e9cc5ee6c4d" containerName="extract"
Jul 15 14:38:35.023504 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.023487    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.027365 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.027347    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 14:38:35.027895 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.027879    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 14:38:35.028983 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.028968    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 14:38:35.032324 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.032311    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 14:38:35.033241 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.033209    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kcdzw\""
Jul 15 14:38:35.047436 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.047415    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"]
Jul 15 14:38:35.112116 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.112088    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3170f621-2ad1-4305-b81b-43ac94c9d18d-tmp\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.112211 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.112126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3170f621-2ad1-4305-b81b-43ac94c9d18d-manifests\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.112211 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.112166    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftdzg\" (UniqueName: \"kubernetes.io/projected/3170f621-2ad1-4305-b81b-43ac94c9d18d-kube-api-access-ftdzg\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.112211 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.112205    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3170f621-2ad1-4305-b81b-43ac94c9d18d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.112324 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.112234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3170f621-2ad1-4305-b81b-43ac94c9d18d-webhook-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.213559 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.213525    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftdzg\" (UniqueName: \"kubernetes.io/projected/3170f621-2ad1-4305-b81b-43ac94c9d18d-kube-api-access-ftdzg\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.213721 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.213584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3170f621-2ad1-4305-b81b-43ac94c9d18d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.213721 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.213623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3170f621-2ad1-4305-b81b-43ac94c9d18d-webhook-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.213721 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.213652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3170f621-2ad1-4305-b81b-43ac94c9d18d-tmp\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.213930 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.213810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3170f621-2ad1-4305-b81b-43ac94c9d18d-manifests\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.214258 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.214232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3170f621-2ad1-4305-b81b-43ac94c9d18d-manifests\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.216636 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.216603    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3170f621-2ad1-4305-b81b-43ac94c9d18d-tmp\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.216749 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.216660    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3170f621-2ad1-4305-b81b-43ac94c9d18d-webhook-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.216792 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.216760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3170f621-2ad1-4305-b81b-43ac94c9d18d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.226767 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.226707    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftdzg\" (UniqueName: \"kubernetes.io/projected/3170f621-2ad1-4305-b81b-43ac94c9d18d-kube-api-access-ftdzg\") pod \"opendatahub-operator-controller-manager-846b6d9d56-dbq5c\" (UID: \"3170f621-2ad1-4305-b81b-43ac94c9d18d\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.333647 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.333585    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:35.481546 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:35.481249    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"]
Jul 15 14:38:35.486016 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:38:35.485990    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3170f621_2ad1_4305_b81b_43ac94c9d18d.slice/crio-f917fb8db5e5b662d23e97d0f47b1dbc157261dd63ba8717e0ea9ee06056fc36 WatchSource:0}: Error finding container f917fb8db5e5b662d23e97d0f47b1dbc157261dd63ba8717e0ea9ee06056fc36: Status 404 returned error can't find the container with id f917fb8db5e5b662d23e97d0f47b1dbc157261dd63ba8717e0ea9ee06056fc36
Jul 15 14:38:36.456417 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:36.456374    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c" event={"ID":"3170f621-2ad1-4305-b81b-43ac94c9d18d","Type":"ContainerStarted","Data":"f917fb8db5e5b662d23e97d0f47b1dbc157261dd63ba8717e0ea9ee06056fc36"}
Jul 15 14:38:39.473246 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:39.473149    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c" event={"ID":"3170f621-2ad1-4305-b81b-43ac94c9d18d","Type":"ContainerStarted","Data":"2c7587677a0a7a869c716a5fb9d9b056658745af0f83d639a7c08e34c524d4f5"}
Jul 15 14:38:40.249967 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.249931    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6df44595c9-glhl7"]
Jul 15 14:38:40.257544 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.257517    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.262605 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.262583    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 14:38:40.263881 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.263847    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 14:38:40.264502 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.264239    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 14:38:40.264502 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.264285    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 14:38:40.264502 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.264313    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 14:38:40.264502 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.264237    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 14:38:40.265056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.265041    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8czzb\""
Jul 15 14:38:40.265204 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.265111    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 14:38:40.268430 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.268260    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 14:38:40.272778 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.272758    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df44595c9-glhl7"]
Jul 15 14:38:40.358255 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.358225    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d8d1cd5-87f6-4544-ab7c-0628adce8137-console-serving-cert\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.358379 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.358264    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzzjw\" (UniqueName: \"kubernetes.io/projected/4d8d1cd5-87f6-4544-ab7c-0628adce8137-kube-api-access-rzzjw\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.358379 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.358329    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d8d1cd5-87f6-4544-ab7c-0628adce8137-console-config\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.358379 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.358349    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d8d1cd5-87f6-4544-ab7c-0628adce8137-trusted-ca-bundle\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.358379 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.358365    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d8d1cd5-87f6-4544-ab7c-0628adce8137-oauth-serving-cert\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.358521 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.358452    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8d1cd5-87f6-4544-ab7c-0628adce8137-service-ca\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.358521 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.358510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d8d1cd5-87f6-4544-ab7c-0628adce8137-console-oauth-config\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.459227 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.459198    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d8d1cd5-87f6-4544-ab7c-0628adce8137-console-oauth-config\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.459382 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.459238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d8d1cd5-87f6-4544-ab7c-0628adce8137-console-serving-cert\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.459382 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.459260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzzjw\" (UniqueName: \"kubernetes.io/projected/4d8d1cd5-87f6-4544-ab7c-0628adce8137-kube-api-access-rzzjw\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.459382 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.459317    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d8d1cd5-87f6-4544-ab7c-0628adce8137-console-config\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.459382 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.459350    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d8d1cd5-87f6-4544-ab7c-0628adce8137-trusted-ca-bundle\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.459382 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.459366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d8d1cd5-87f6-4544-ab7c-0628adce8137-oauth-serving-cert\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.459632 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.459410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8d1cd5-87f6-4544-ab7c-0628adce8137-service-ca\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.460090 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.460067    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d8d1cd5-87f6-4544-ab7c-0628adce8137-console-config\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.460222 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.460202    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8d1cd5-87f6-4544-ab7c-0628adce8137-service-ca\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.460263 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.460251    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d8d1cd5-87f6-4544-ab7c-0628adce8137-oauth-serving-cert\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.460302 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.460271    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d8d1cd5-87f6-4544-ab7c-0628adce8137-trusted-ca-bundle\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.461844 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.461815    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d8d1cd5-87f6-4544-ab7c-0628adce8137-console-oauth-config\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.461924 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.461906    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d8d1cd5-87f6-4544-ab7c-0628adce8137-console-serving-cert\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.468650 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.468629    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzzjw\" (UniqueName: \"kubernetes.io/projected/4d8d1cd5-87f6-4544-ab7c-0628adce8137-kube-api-access-rzzjw\") pod \"console-6df44595c9-glhl7\" (UID: \"4d8d1cd5-87f6-4544-ab7c-0628adce8137\") " pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.482746 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.482697    2581 generic.go:356] "Generic (PLEG): container finished" podID="3170f621-2ad1-4305-b81b-43ac94c9d18d" containerID="2c7587677a0a7a869c716a5fb9d9b056658745af0f83d639a7c08e34c524d4f5" exitCode=0
Jul 15 14:38:40.483070 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.482757    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c" event={"ID":"3170f621-2ad1-4305-b81b-43ac94c9d18d","Type":"ContainerDied","Data":"2c7587677a0a7a869c716a5fb9d9b056658745af0f83d639a7c08e34c524d4f5"}
Jul 15 14:38:40.614396 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.614323    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:40.762538 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:40.762513    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df44595c9-glhl7"]
Jul 15 14:38:40.764944 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:38:40.764918    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8d1cd5_87f6_4544_ab7c_0628adce8137.slice/crio-339bcb104031f20bef92ef9f9fe540ffa87b700c8d61922082c3a224f4523655 WatchSource:0}: Error finding container 339bcb104031f20bef92ef9f9fe540ffa87b700c8d61922082c3a224f4523655: Status 404 returned error can't find the container with id 339bcb104031f20bef92ef9f9fe540ffa87b700c8d61922082c3a224f4523655
Jul 15 14:38:41.488595 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:41.488565    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df44595c9-glhl7" event={"ID":"4d8d1cd5-87f6-4544-ab7c-0628adce8137","Type":"ContainerStarted","Data":"1d81cf050ccc8e63cad1944329de118e3f2b9a77fe7f32e0fbdc4d51c4af576d"}
Jul 15 14:38:41.489050 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:41.488608    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df44595c9-glhl7" event={"ID":"4d8d1cd5-87f6-4544-ab7c-0628adce8137","Type":"ContainerStarted","Data":"339bcb104031f20bef92ef9f9fe540ffa87b700c8d61922082c3a224f4523655"}
Jul 15 14:38:41.527856 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:41.523816    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6df44595c9-glhl7" podStartSLOduration=1.523796587 podStartE2EDuration="1.523796587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:38:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:38:41.521948389 +0000 UTC m=+482.668629144" watchObservedRunningTime="2026-07-15 14:38:41.523796587 +0000 UTC m=+482.670477343"
Jul 15 14:38:42.495121 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:42.495086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c" event={"ID":"3170f621-2ad1-4305-b81b-43ac94c9d18d","Type":"ContainerStarted","Data":"b7054c6114f252d332957b90e619a694f815aa2632de662f1631d3352916f6f0"}
Jul 15 14:38:42.523091 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:42.523049    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c" podStartSLOduration=2.759529509 podStartE2EDuration="8.523033697s" totalImagesPullingTime="4.738155172s" totalInitContainerRuntime="1.025349016s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:38:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:38:42.521515269 +0000 UTC m=+483.668196050" watchObservedRunningTime="2026-07-15 14:38:42.523033697 +0000 UTC m=+483.669714453"
Jul 15 14:38:43.500622 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:43.500589    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:50.614485 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:50.614456    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:50.614955 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:50.614505    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:50.619278 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:50.619249    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:51.541469 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:51.541438    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6df44595c9-glhl7"
Jul 15 14:38:54.507147 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:54.507120    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-dbq5c"
Jul 15 14:38:57.546310 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.546267    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d"]
Jul 15 14:38:57.556857 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.556834    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d"
Jul 15 14:38:57.568510 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.568491    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8g5x7\""
Jul 15 14:38:57.569419 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.569401    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 14:38:57.578004 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.577986    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 14:38:57.610869 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.610845    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d"]
Jul 15 14:38:57.693939 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.693907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f448e44-83bf-4c66-9825-7087afcc7565-tmp\") pod \"kube-auth-proxy-86c7c45d84-kvn8d\" (UID: \"0f448e44-83bf-4c66-9825-7087afcc7565\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d"
Jul 15 14:38:57.694082 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.693941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k478c\" (UniqueName: \"kubernetes.io/projected/0f448e44-83bf-4c66-9825-7087afcc7565-kube-api-access-k478c\") pod \"kube-auth-proxy-86c7c45d84-kvn8d\" (UID: \"0f448e44-83bf-4c66-9825-7087afcc7565\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d"
Jul 15 14:38:57.694082 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.694025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f448e44-83bf-4c66-9825-7087afcc7565-tls-certs\") pod \"kube-auth-proxy-86c7c45d84-kvn8d\" (UID: \"0f448e44-83bf-4c66-9825-7087afcc7565\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d"
Jul 15 14:38:57.794847 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.794813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f448e44-83bf-4c66-9825-7087afcc7565-tls-certs\") pod \"kube-auth-proxy-86c7c45d84-kvn8d\" (UID: \"0f448e44-83bf-4c66-9825-7087afcc7565\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d"
Jul 15 14:38:57.794999 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.794865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f448e44-83bf-4c66-9825-7087afcc7565-tmp\") pod \"kube-auth-proxy-86c7c45d84-kvn8d\" (UID: \"0f448e44-83bf-4c66-9825-7087afcc7565\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d"
Jul 15 14:38:57.794999 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.794885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k478c\" (UniqueName: \"kubernetes.io/projected/0f448e44-83bf-4c66-9825-7087afcc7565-kube-api-access-k478c\") pod \"kube-auth-proxy-86c7c45d84-kvn8d\" (UID: \"0f448e44-83bf-4c66-9825-7087afcc7565\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d"
Jul 15 14:38:57.796979 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.796925    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f448e44-83bf-4c66-9825-7087afcc7565-tmp\") pod \"kube-auth-proxy-86c7c45d84-kvn8d\" (UID: \"0f448e44-83bf-4c66-9825-7087afcc7565\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d"
Jul 15 14:38:57.797256 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.797237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f448e44-83bf-4c66-9825-7087afcc7565-tls-certs\") pod \"kube-auth-proxy-86c7c45d84-kvn8d\" (UID: \"0f448e44-83bf-4c66-9825-7087afcc7565\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d"
Jul 15 14:38:57.820937 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.820914    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k478c\" (UniqueName: \"kubernetes.io/projected/0f448e44-83bf-4c66-9825-7087afcc7565-kube-api-access-k478c\") pod \"kube-auth-proxy-86c7c45d84-kvn8d\" (UID: \"0f448e44-83bf-4c66-9825-7087afcc7565\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d"
Jul 15 14:38:57.866162 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:57.866140    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d"
Jul 15 14:38:58.026071 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:58.026035    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d"]
Jul 15 14:38:58.028355 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:38:58.028330    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f448e44_83bf_4c66_9825_7087afcc7565.slice/crio-cb3d1031d585552b6b684b1956ec2ac316ab88896ec070afa0fad5fe6a66c32c WatchSource:0}: Error finding container cb3d1031d585552b6b684b1956ec2ac316ab88896ec070afa0fad5fe6a66c32c: Status 404 returned error can't find the container with id cb3d1031d585552b6b684b1956ec2ac316ab88896ec070afa0fad5fe6a66c32c
Jul 15 14:38:58.570091 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:38:58.570051    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d" event={"ID":"0f448e44-83bf-4c66-9825-7087afcc7565","Type":"ContainerStarted","Data":"cb3d1031d585552b6b684b1956ec2ac316ab88896ec070afa0fad5fe6a66c32c"}
Jul 15 14:39:02.589878 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:02.589797    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d" event={"ID":"0f448e44-83bf-4c66-9825-7087afcc7565","Type":"ContainerStarted","Data":"d82f658ec3e926f56ad1fd832f8fe6a7ba15678fe47f9531f498d0a64f6420d6"}
Jul 15 14:39:02.630384 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:02.630336    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86c7c45d84-kvn8d" podStartSLOduration=1.469737999 podStartE2EDuration="5.630321276s" totalImagesPullingTime="4.160583277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:39:02.62808662 +0000 UTC m=+503.774767409" watchObservedRunningTime="2026-07-15 14:39:02.630321276 +0000 UTC m=+503.777002031"
Jul 15 14:39:04.367673 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.367635    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"]
Jul 15 14:39:04.370986 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.370922    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:04.378395 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.378374    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n5c6n\""
Jul 15 14:39:04.378511 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.378413    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 14:39:04.378628 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.378611    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 14:39:04.378701 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.378668    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 14:39:04.378768 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.378698    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:39:04.378827 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.378789    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 14:39:04.406158 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.406130    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"]
Jul 15 14:39:04.452184 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.452154    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjgp5\" (UniqueName: \"kubernetes.io/projected/cde232c2-3a55-4db8-ae84-0a0454d48f8f-kube-api-access-qjgp5\") pod \"lws-controller-manager-7bbc4984f8-t9jxz\" (UID: \"cde232c2-3a55-4db8-ae84-0a0454d48f8f\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:04.452288 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.452187    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cde232c2-3a55-4db8-ae84-0a0454d48f8f-cert\") pod \"lws-controller-manager-7bbc4984f8-t9jxz\" (UID: \"cde232c2-3a55-4db8-ae84-0a0454d48f8f\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:04.452288 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.452209    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cde232c2-3a55-4db8-ae84-0a0454d48f8f-metrics-cert\") pod \"lws-controller-manager-7bbc4984f8-t9jxz\" (UID: \"cde232c2-3a55-4db8-ae84-0a0454d48f8f\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:04.452369 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.452309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cde232c2-3a55-4db8-ae84-0a0454d48f8f-manager-config\") pod \"lws-controller-manager-7bbc4984f8-t9jxz\" (UID: \"cde232c2-3a55-4db8-ae84-0a0454d48f8f\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:04.553583 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.553558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjgp5\" (UniqueName: \"kubernetes.io/projected/cde232c2-3a55-4db8-ae84-0a0454d48f8f-kube-api-access-qjgp5\") pod \"lws-controller-manager-7bbc4984f8-t9jxz\" (UID: \"cde232c2-3a55-4db8-ae84-0a0454d48f8f\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:04.553688 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.553587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cde232c2-3a55-4db8-ae84-0a0454d48f8f-cert\") pod \"lws-controller-manager-7bbc4984f8-t9jxz\" (UID: \"cde232c2-3a55-4db8-ae84-0a0454d48f8f\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:04.553688 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.553605    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cde232c2-3a55-4db8-ae84-0a0454d48f8f-metrics-cert\") pod \"lws-controller-manager-7bbc4984f8-t9jxz\" (UID: \"cde232c2-3a55-4db8-ae84-0a0454d48f8f\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:04.553688 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.553654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cde232c2-3a55-4db8-ae84-0a0454d48f8f-manager-config\") pod \"lws-controller-manager-7bbc4984f8-t9jxz\" (UID: \"cde232c2-3a55-4db8-ae84-0a0454d48f8f\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:04.554840 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.554817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cde232c2-3a55-4db8-ae84-0a0454d48f8f-manager-config\") pod \"lws-controller-manager-7bbc4984f8-t9jxz\" (UID: \"cde232c2-3a55-4db8-ae84-0a0454d48f8f\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:04.561241 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.561218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cde232c2-3a55-4db8-ae84-0a0454d48f8f-metrics-cert\") pod \"lws-controller-manager-7bbc4984f8-t9jxz\" (UID: \"cde232c2-3a55-4db8-ae84-0a0454d48f8f\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:04.561364 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.561336    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cde232c2-3a55-4db8-ae84-0a0454d48f8f-cert\") pod \"lws-controller-manager-7bbc4984f8-t9jxz\" (UID: \"cde232c2-3a55-4db8-ae84-0a0454d48f8f\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:04.565702 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.565682    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjgp5\" (UniqueName: \"kubernetes.io/projected/cde232c2-3a55-4db8-ae84-0a0454d48f8f-kube-api-access-qjgp5\") pod \"lws-controller-manager-7bbc4984f8-t9jxz\" (UID: \"cde232c2-3a55-4db8-ae84-0a0454d48f8f\") " pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:04.680003 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.679977    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:04.835941 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:04.835917    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"]
Jul 15 14:39:04.838683 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:39:04.838656    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde232c2_3a55_4db8_ae84_0a0454d48f8f.slice/crio-2671afbfa6ec81f74f91c728f7b5420b547ced413176079763808ff0a9d4d6c0 WatchSource:0}: Error finding container 2671afbfa6ec81f74f91c728f7b5420b547ced413176079763808ff0a9d4d6c0: Status 404 returned error can't find the container with id 2671afbfa6ec81f74f91c728f7b5420b547ced413176079763808ff0a9d4d6c0
Jul 15 14:39:05.604547 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:05.604511    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz" event={"ID":"cde232c2-3a55-4db8-ae84-0a0454d48f8f","Type":"ContainerStarted","Data":"2671afbfa6ec81f74f91c728f7b5420b547ced413176079763808ff0a9d4d6c0"}
Jul 15 14:39:07.616106 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:07.616070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz" event={"ID":"cde232c2-3a55-4db8-ae84-0a0454d48f8f","Type":"ContainerStarted","Data":"7291aa464086c406a4981620884bd6450f1b2a17a95010d8ee5a54d8ac7d4c72"}
Jul 15 14:39:07.616485 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:07.616188    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:39:07.654591 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:07.654548    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz" podStartSLOduration=1.57181708 podStartE2EDuration="3.654532198s" totalImagesPullingTime="2.082715118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:39:07.654253009 +0000 UTC m=+508.800933784" watchObservedRunningTime="2026-07-15 14:39:07.654532198 +0000 UTC m=+508.801212989"
Jul 15 14:39:18.623776 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:39:18.623723    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bbc4984f8-t9jxz"
Jul 15 14:40:14.794454 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:14.791173    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"]
Jul 15 14:40:14.796363 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:14.796343    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"
Jul 15 14:40:14.805885 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:14.805866    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 14:40:14.806528 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:14.806513    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 14:40:14.807127 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:14.807114    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rpvvg\""
Jul 15 14:40:14.822593 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:14.822568    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"]
Jul 15 14:40:14.895660 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:14.895633    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24e5449f-588b-48be-8e1d-c46a444d4a0b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj\" (UID: \"24e5449f-588b-48be-8e1d-c46a444d4a0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"
Jul 15 14:40:14.895823 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:14.895674    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h98vc\" (UniqueName: \"kubernetes.io/projected/24e5449f-588b-48be-8e1d-c46a444d4a0b-kube-api-access-h98vc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj\" (UID: \"24e5449f-588b-48be-8e1d-c46a444d4a0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"
Jul 15 14:40:14.895823 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:14.895790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24e5449f-588b-48be-8e1d-c46a444d4a0b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj\" (UID: \"24e5449f-588b-48be-8e1d-c46a444d4a0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"
Jul 15 14:40:14.996373 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:14.996351    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24e5449f-588b-48be-8e1d-c46a444d4a0b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj\" (UID: \"24e5449f-588b-48be-8e1d-c46a444d4a0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"
Jul 15 14:40:14.996525 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:14.996399    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24e5449f-588b-48be-8e1d-c46a444d4a0b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj\" (UID: \"24e5449f-588b-48be-8e1d-c46a444d4a0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"
Jul 15 14:40:14.996525 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:14.996429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h98vc\" (UniqueName: \"kubernetes.io/projected/24e5449f-588b-48be-8e1d-c46a444d4a0b-kube-api-access-h98vc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj\" (UID: \"24e5449f-588b-48be-8e1d-c46a444d4a0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"
Jul 15 14:40:14.996767 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:14.996748    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24e5449f-588b-48be-8e1d-c46a444d4a0b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj\" (UID: \"24e5449f-588b-48be-8e1d-c46a444d4a0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"
Jul 15 14:40:14.996846 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:14.996786    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24e5449f-588b-48be-8e1d-c46a444d4a0b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj\" (UID: \"24e5449f-588b-48be-8e1d-c46a444d4a0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"
Jul 15 14:40:15.006968 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.006948    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h98vc\" (UniqueName: \"kubernetes.io/projected/24e5449f-588b-48be-8e1d-c46a444d4a0b-kube-api-access-h98vc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj\" (UID: \"24e5449f-588b-48be-8e1d-c46a444d4a0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"
Jul 15 14:40:15.105316 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.105261    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"
Jul 15 14:40:15.238285 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.238261    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"]
Jul 15 14:40:15.240790 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:40:15.240762    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e5449f_588b_48be_8e1d_c46a444d4a0b.slice/crio-d8c6393d320bda8fda36487d1b17b8ef2f04d505f8e604e60f28a185997fcef0 WatchSource:0}: Error finding container d8c6393d320bda8fda36487d1b17b8ef2f04d505f8e604e60f28a185997fcef0: Status 404 returned error can't find the container with id d8c6393d320bda8fda36487d1b17b8ef2f04d505f8e604e60f28a185997fcef0
Jul 15 14:40:15.539378 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.539351    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"]
Jul 15 14:40:15.542926 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.542910    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"
Jul 15 14:40:15.558847 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.558826    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"]
Jul 15 14:40:15.702595 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.702566    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0340751b-d8bb-42a8-8f18-3933dfad9975-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5\" (UID: \"0340751b-d8bb-42a8-8f18-3933dfad9975\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"
Jul 15 14:40:15.702754 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.702618    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0340751b-d8bb-42a8-8f18-3933dfad9975-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5\" (UID: \"0340751b-d8bb-42a8-8f18-3933dfad9975\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"
Jul 15 14:40:15.702754 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.702692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz9rj\" (UniqueName: \"kubernetes.io/projected/0340751b-d8bb-42a8-8f18-3933dfad9975-kube-api-access-nz9rj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5\" (UID: \"0340751b-d8bb-42a8-8f18-3933dfad9975\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"
Jul 15 14:40:15.803610 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.803546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz9rj\" (UniqueName: \"kubernetes.io/projected/0340751b-d8bb-42a8-8f18-3933dfad9975-kube-api-access-nz9rj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5\" (UID: \"0340751b-d8bb-42a8-8f18-3933dfad9975\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"
Jul 15 14:40:15.803610 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.803594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0340751b-d8bb-42a8-8f18-3933dfad9975-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5\" (UID: \"0340751b-d8bb-42a8-8f18-3933dfad9975\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"
Jul 15 14:40:15.803988 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.803635    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0340751b-d8bb-42a8-8f18-3933dfad9975-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5\" (UID: \"0340751b-d8bb-42a8-8f18-3933dfad9975\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"
Jul 15 14:40:15.803988 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.803928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0340751b-d8bb-42a8-8f18-3933dfad9975-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5\" (UID: \"0340751b-d8bb-42a8-8f18-3933dfad9975\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"
Jul 15 14:40:15.803988 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.803982    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0340751b-d8bb-42a8-8f18-3933dfad9975-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5\" (UID: \"0340751b-d8bb-42a8-8f18-3933dfad9975\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"
Jul 15 14:40:15.819958 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.819938    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz9rj\" (UniqueName: \"kubernetes.io/projected/0340751b-d8bb-42a8-8f18-3933dfad9975-kube-api-access-nz9rj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5\" (UID: \"0340751b-d8bb-42a8-8f18-3933dfad9975\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"
Jul 15 14:40:15.851449 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.851427    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"
Jul 15 14:40:15.909790 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.909763    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"]
Jul 15 14:40:15.913436 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.913417    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"
Jul 15 14:40:15.930697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.930675    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"]
Jul 15 14:40:15.933833 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.933771    2581 generic.go:356] "Generic (PLEG): container finished" podID="24e5449f-588b-48be-8e1d-c46a444d4a0b" containerID="85e359bd49c962b08035fb199b63a557fca515d49bbab6fa465ad2dce97773d1" exitCode=0
Jul 15 14:40:15.933833 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.933809    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj" event={"ID":"24e5449f-588b-48be-8e1d-c46a444d4a0b","Type":"ContainerDied","Data":"85e359bd49c962b08035fb199b63a557fca515d49bbab6fa465ad2dce97773d1"}
Jul 15 14:40:15.933957 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.933846    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj" event={"ID":"24e5449f-588b-48be-8e1d-c46a444d4a0b","Type":"ContainerStarted","Data":"d8c6393d320bda8fda36487d1b17b8ef2f04d505f8e604e60f28a185997fcef0"}
Jul 15 14:40:15.994155 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:15.994134    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"]
Jul 15 14:40:15.995963 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:40:15.995935    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0340751b_d8bb_42a8_8f18_3933dfad9975.slice/crio-a302b8f96a79e9984bf578e55cba7c894e65f351ff1789fad3a4dd534f6269a0 WatchSource:0}: Error finding container a302b8f96a79e9984bf578e55cba7c894e65f351ff1789fad3a4dd534f6269a0: Status 404 returned error can't find the container with id a302b8f96a79e9984bf578e55cba7c894e65f351ff1789fad3a4dd534f6269a0
Jul 15 14:40:16.007079 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.006795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/964e3a22-70c5-4086-93dd-437a069cdf2d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr\" (UID: \"964e3a22-70c5-4086-93dd-437a069cdf2d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"
Jul 15 14:40:16.007079 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.006854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/964e3a22-70c5-4086-93dd-437a069cdf2d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr\" (UID: \"964e3a22-70c5-4086-93dd-437a069cdf2d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"
Jul 15 14:40:16.007079 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.006916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj7qh\" (UniqueName: \"kubernetes.io/projected/964e3a22-70c5-4086-93dd-437a069cdf2d-kube-api-access-hj7qh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr\" (UID: \"964e3a22-70c5-4086-93dd-437a069cdf2d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"
Jul 15 14:40:16.107650 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.107619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/964e3a22-70c5-4086-93dd-437a069cdf2d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr\" (UID: \"964e3a22-70c5-4086-93dd-437a069cdf2d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"
Jul 15 14:40:16.107793 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.107682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj7qh\" (UniqueName: \"kubernetes.io/projected/964e3a22-70c5-4086-93dd-437a069cdf2d-kube-api-access-hj7qh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr\" (UID: \"964e3a22-70c5-4086-93dd-437a069cdf2d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"
Jul 15 14:40:16.107793 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.107774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/964e3a22-70c5-4086-93dd-437a069cdf2d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr\" (UID: \"964e3a22-70c5-4086-93dd-437a069cdf2d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"
Jul 15 14:40:16.108075 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.108051    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/964e3a22-70c5-4086-93dd-437a069cdf2d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr\" (UID: \"964e3a22-70c5-4086-93dd-437a069cdf2d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"
Jul 15 14:40:16.108113 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.108088    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/964e3a22-70c5-4086-93dd-437a069cdf2d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr\" (UID: \"964e3a22-70c5-4086-93dd-437a069cdf2d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"
Jul 15 14:40:16.117909 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.117888    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj7qh\" (UniqueName: \"kubernetes.io/projected/964e3a22-70c5-4086-93dd-437a069cdf2d-kube-api-access-hj7qh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr\" (UID: \"964e3a22-70c5-4086-93dd-437a069cdf2d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"
Jul 15 14:40:16.222903 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.222878    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"
Jul 15 14:40:16.282061 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.282030    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"]
Jul 15 14:40:16.286175 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.286145    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"
Jul 15 14:40:16.300637 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.300614    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"]
Jul 15 14:40:16.361477 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.361450    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"]
Jul 15 14:40:16.363332 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:40:16.363304    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964e3a22_70c5_4086_93dd_437a069cdf2d.slice/crio-533e18cbb145df1c7f920fd2a67033cb60ace6c882047ae383b0ed55ff8268ad WatchSource:0}: Error finding container 533e18cbb145df1c7f920fd2a67033cb60ace6c882047ae383b0ed55ff8268ad: Status 404 returned error can't find the container with id 533e18cbb145df1c7f920fd2a67033cb60ace6c882047ae383b0ed55ff8268ad
Jul 15 14:40:16.411346 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.411327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf9fd8d3-0197-47e6-8769-6e8d524e48be-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w\" (UID: \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"
Jul 15 14:40:16.411451 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.411386    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf589\" (UniqueName: \"kubernetes.io/projected/cf9fd8d3-0197-47e6-8769-6e8d524e48be-kube-api-access-mf589\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w\" (UID: \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"
Jul 15 14:40:16.411511 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.411463    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf9fd8d3-0197-47e6-8769-6e8d524e48be-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w\" (UID: \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"
Jul 15 14:40:16.512331 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.512305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf589\" (UniqueName: \"kubernetes.io/projected/cf9fd8d3-0197-47e6-8769-6e8d524e48be-kube-api-access-mf589\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w\" (UID: \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"
Jul 15 14:40:16.512460 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.512347    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf9fd8d3-0197-47e6-8769-6e8d524e48be-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w\" (UID: \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"
Jul 15 14:40:16.512460 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.512391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf9fd8d3-0197-47e6-8769-6e8d524e48be-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w\" (UID: \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"
Jul 15 14:40:16.512787 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.512765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf9fd8d3-0197-47e6-8769-6e8d524e48be-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w\" (UID: \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"
Jul 15 14:40:16.512848 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.512803    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf9fd8d3-0197-47e6-8769-6e8d524e48be-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w\" (UID: \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"
Jul 15 14:40:16.525245 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.525198    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf589\" (UniqueName: \"kubernetes.io/projected/cf9fd8d3-0197-47e6-8769-6e8d524e48be-kube-api-access-mf589\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w\" (UID: \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"
Jul 15 14:40:16.596451 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.596420    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"
Jul 15 14:40:16.735963 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.735939    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"]
Jul 15 14:40:16.738093 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:40:16.738064    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9fd8d3_0197_47e6_8769_6e8d524e48be.slice/crio-127c0a1945ff7e057949852561b7f2b15ce3230dbf26b5f189e063a969d1d25c WatchSource:0}: Error finding container 127c0a1945ff7e057949852561b7f2b15ce3230dbf26b5f189e063a969d1d25c: Status 404 returned error can't find the container with id 127c0a1945ff7e057949852561b7f2b15ce3230dbf26b5f189e063a969d1d25c
Jul 15 14:40:16.940968 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.940940    2581 generic.go:356] "Generic (PLEG): container finished" podID="964e3a22-70c5-4086-93dd-437a069cdf2d" containerID="3d1b63d10596c23230d712a87337842a61d04c5bb0f6344373c46a40dc3d9258" exitCode=0
Jul 15 14:40:16.941328 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.941021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr" event={"ID":"964e3a22-70c5-4086-93dd-437a069cdf2d","Type":"ContainerDied","Data":"3d1b63d10596c23230d712a87337842a61d04c5bb0f6344373c46a40dc3d9258"}
Jul 15 14:40:16.941328 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.941076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr" event={"ID":"964e3a22-70c5-4086-93dd-437a069cdf2d","Type":"ContainerStarted","Data":"533e18cbb145df1c7f920fd2a67033cb60ace6c882047ae383b0ed55ff8268ad"}
Jul 15 14:40:16.942599 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.942577    2581 generic.go:356] "Generic (PLEG): container finished" podID="cf9fd8d3-0197-47e6-8769-6e8d524e48be" containerID="fc243836a0a3c739ba52a5c6c02f459f40ad1c500f46cc4027d69bc9cff674a0" exitCode=0
Jul 15 14:40:16.942709 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.942676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w" event={"ID":"cf9fd8d3-0197-47e6-8769-6e8d524e48be","Type":"ContainerDied","Data":"fc243836a0a3c739ba52a5c6c02f459f40ad1c500f46cc4027d69bc9cff674a0"}
Jul 15 14:40:16.942791 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.942722    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w" event={"ID":"cf9fd8d3-0197-47e6-8769-6e8d524e48be","Type":"ContainerStarted","Data":"127c0a1945ff7e057949852561b7f2b15ce3230dbf26b5f189e063a969d1d25c"}
Jul 15 14:40:16.944192 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.944173    2581 generic.go:356] "Generic (PLEG): container finished" podID="0340751b-d8bb-42a8-8f18-3933dfad9975" containerID="b4b59eb0b9cdf092f7d891a9f3bde1b5937c80b72696cdbfcb985fb4dfc50a09" exitCode=0
Jul 15 14:40:16.944284 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.944199    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5" event={"ID":"0340751b-d8bb-42a8-8f18-3933dfad9975","Type":"ContainerDied","Data":"b4b59eb0b9cdf092f7d891a9f3bde1b5937c80b72696cdbfcb985fb4dfc50a09"}
Jul 15 14:40:16.944284 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:16.944238    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5" event={"ID":"0340751b-d8bb-42a8-8f18-3933dfad9975","Type":"ContainerStarted","Data":"a302b8f96a79e9984bf578e55cba7c894e65f351ff1789fad3a4dd534f6269a0"}
Jul 15 14:40:17.952672 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:17.952646    2581 generic.go:356] "Generic (PLEG): container finished" podID="24e5449f-588b-48be-8e1d-c46a444d4a0b" containerID="ea470d814afea4972135993a44f6435ed8371c9f1cefee63d07384ef2ce37aa2" exitCode=0
Jul 15 14:40:17.952988 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:17.952709    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj" event={"ID":"24e5449f-588b-48be-8e1d-c46a444d4a0b","Type":"ContainerDied","Data":"ea470d814afea4972135993a44f6435ed8371c9f1cefee63d07384ef2ce37aa2"}
Jul 15 14:40:18.959479 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:18.959448    2581 generic.go:356] "Generic (PLEG): container finished" podID="cf9fd8d3-0197-47e6-8769-6e8d524e48be" containerID="6d1cb18c3975a0cd218a6080e3842b5c54e684ec3aaed3ebe4981c51253c952c" exitCode=0
Jul 15 14:40:18.959915 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:18.959538    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w" event={"ID":"cf9fd8d3-0197-47e6-8769-6e8d524e48be","Type":"ContainerDied","Data":"6d1cb18c3975a0cd218a6080e3842b5c54e684ec3aaed3ebe4981c51253c952c"}
Jul 15 14:40:18.961874 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:18.961852    2581 generic.go:356] "Generic (PLEG): container finished" podID="24e5449f-588b-48be-8e1d-c46a444d4a0b" containerID="6c34973512011a41ef9b0dc49d38f8e00547133a0956f7a9f96dd4008d85f44e" exitCode=0
Jul 15 14:40:18.961974 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:18.961881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj" event={"ID":"24e5449f-588b-48be-8e1d-c46a444d4a0b","Type":"ContainerDied","Data":"6c34973512011a41ef9b0dc49d38f8e00547133a0956f7a9f96dd4008d85f44e"}
Jul 15 14:40:18.963712 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:18.963688    2581 generic.go:356] "Generic (PLEG): container finished" podID="0340751b-d8bb-42a8-8f18-3933dfad9975" containerID="c4d457772bfa1654910f0d57247d7c06b8c8de6c643944fbed87f93dd8f01555" exitCode=0
Jul 15 14:40:18.963810 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:18.963771    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5" event={"ID":"0340751b-d8bb-42a8-8f18-3933dfad9975","Type":"ContainerDied","Data":"c4d457772bfa1654910f0d57247d7c06b8c8de6c643944fbed87f93dd8f01555"}
Jul 15 14:40:18.965760 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:18.965720    2581 generic.go:356] "Generic (PLEG): container finished" podID="964e3a22-70c5-4086-93dd-437a069cdf2d" containerID="cbb90332e46e7d1c64e052df823c5f56f864356bcf87164f996c77719cbad579" exitCode=0
Jul 15 14:40:18.965848 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:18.965803    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr" event={"ID":"964e3a22-70c5-4086-93dd-437a069cdf2d","Type":"ContainerDied","Data":"cbb90332e46e7d1c64e052df823c5f56f864356bcf87164f996c77719cbad579"}
Jul 15 14:40:19.975217 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:19.975190    2581 generic.go:356] "Generic (PLEG): container finished" podID="cf9fd8d3-0197-47e6-8769-6e8d524e48be" containerID="048181b3746587d276b2ad993548716a50e7af3b12188a03d10d31c0bb96fe81" exitCode=0
Jul 15 14:40:19.975657 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:19.975282    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w" event={"ID":"cf9fd8d3-0197-47e6-8769-6e8d524e48be","Type":"ContainerDied","Data":"048181b3746587d276b2ad993548716a50e7af3b12188a03d10d31c0bb96fe81"}
Jul 15 14:40:19.977312 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:19.977291    2581 generic.go:356] "Generic (PLEG): container finished" podID="0340751b-d8bb-42a8-8f18-3933dfad9975" containerID="f821fd9cf9e4c037d7ae39fa13091d600f87a070b7280262a54441d3dd7830e2" exitCode=0
Jul 15 14:40:19.977435 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:19.977373    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5" event={"ID":"0340751b-d8bb-42a8-8f18-3933dfad9975","Type":"ContainerDied","Data":"f821fd9cf9e4c037d7ae39fa13091d600f87a070b7280262a54441d3dd7830e2"}
Jul 15 14:40:19.979245 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:19.979225    2581 generic.go:356] "Generic (PLEG): container finished" podID="964e3a22-70c5-4086-93dd-437a069cdf2d" containerID="b76bdeaac7dea54f4aab8421f849b36beccbfaa8713863e252c4999952dd83fd" exitCode=0
Jul 15 14:40:19.979359 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:19.979254    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr" event={"ID":"964e3a22-70c5-4086-93dd-437a069cdf2d","Type":"ContainerDied","Data":"b76bdeaac7dea54f4aab8421f849b36beccbfaa8713863e252c4999952dd83fd"}
Jul 15 14:40:20.111186 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:20.111165    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"
Jul 15 14:40:20.244428 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:20.244357    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24e5449f-588b-48be-8e1d-c46a444d4a0b-util\") pod \"24e5449f-588b-48be-8e1d-c46a444d4a0b\" (UID: \"24e5449f-588b-48be-8e1d-c46a444d4a0b\") "
Jul 15 14:40:20.244428 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:20.244403    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24e5449f-588b-48be-8e1d-c46a444d4a0b-bundle\") pod \"24e5449f-588b-48be-8e1d-c46a444d4a0b\" (UID: \"24e5449f-588b-48be-8e1d-c46a444d4a0b\") "
Jul 15 14:40:20.244718 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:20.244484    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h98vc\" (UniqueName: \"kubernetes.io/projected/24e5449f-588b-48be-8e1d-c46a444d4a0b-kube-api-access-h98vc\") pod \"24e5449f-588b-48be-8e1d-c46a444d4a0b\" (UID: \"24e5449f-588b-48be-8e1d-c46a444d4a0b\") "
Jul 15 14:40:20.244919 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:20.244892    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24e5449f-588b-48be-8e1d-c46a444d4a0b-bundle" (OuterVolumeSpecName: "bundle") pod "24e5449f-588b-48be-8e1d-c46a444d4a0b" (UID: "24e5449f-588b-48be-8e1d-c46a444d4a0b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:40:20.246588 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:20.246561    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24e5449f-588b-48be-8e1d-c46a444d4a0b-kube-api-access-h98vc" (OuterVolumeSpecName: "kube-api-access-h98vc") pod "24e5449f-588b-48be-8e1d-c46a444d4a0b" (UID: "24e5449f-588b-48be-8e1d-c46a444d4a0b"). InnerVolumeSpecName "kube-api-access-h98vc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:40:20.252299 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:20.252275    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24e5449f-588b-48be-8e1d-c46a444d4a0b-util" (OuterVolumeSpecName: "util") pod "24e5449f-588b-48be-8e1d-c46a444d4a0b" (UID: "24e5449f-588b-48be-8e1d-c46a444d4a0b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:40:20.345570 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:20.345545    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h98vc\" (UniqueName: \"kubernetes.io/projected/24e5449f-588b-48be-8e1d-c46a444d4a0b-kube-api-access-h98vc\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:40:20.345570 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:20.345568    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24e5449f-588b-48be-8e1d-c46a444d4a0b-util\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:40:20.345692 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:20.345579    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24e5449f-588b-48be-8e1d-c46a444d4a0b-bundle\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:40:20.985404 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:20.985377    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj"
Jul 15 14:40:20.985838 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:20.985415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj" event={"ID":"24e5449f-588b-48be-8e1d-c46a444d4a0b","Type":"ContainerDied","Data":"d8c6393d320bda8fda36487d1b17b8ef2f04d505f8e604e60f28a185997fcef0"}
Jul 15 14:40:20.985838 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:20.985454    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8c6393d320bda8fda36487d1b17b8ef2f04d505f8e604e60f28a185997fcef0"
Jul 15 14:40:21.139222 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.139194    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"
Jul 15 14:40:21.173678 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.173653    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"
Jul 15 14:40:21.178099 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.178078    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"
Jul 15 14:40:21.253276 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.253179    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf589\" (UniqueName: \"kubernetes.io/projected/cf9fd8d3-0197-47e6-8769-6e8d524e48be-kube-api-access-mf589\") pod \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\" (UID: \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\") "
Jul 15 14:40:21.253276 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.253251    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf9fd8d3-0197-47e6-8769-6e8d524e48be-util\") pod \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\" (UID: \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\") "
Jul 15 14:40:21.253276 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.253272    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf9fd8d3-0197-47e6-8769-6e8d524e48be-bundle\") pod \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\" (UID: \"cf9fd8d3-0197-47e6-8769-6e8d524e48be\") "
Jul 15 14:40:21.253748 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.253713    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9fd8d3-0197-47e6-8769-6e8d524e48be-bundle" (OuterVolumeSpecName: "bundle") pod "cf9fd8d3-0197-47e6-8769-6e8d524e48be" (UID: "cf9fd8d3-0197-47e6-8769-6e8d524e48be"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:40:21.255323 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.255298    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf9fd8d3-0197-47e6-8769-6e8d524e48be-kube-api-access-mf589" (OuterVolumeSpecName: "kube-api-access-mf589") pod "cf9fd8d3-0197-47e6-8769-6e8d524e48be" (UID: "cf9fd8d3-0197-47e6-8769-6e8d524e48be"). InnerVolumeSpecName "kube-api-access-mf589". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:40:21.258877 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.258857    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9fd8d3-0197-47e6-8769-6e8d524e48be-util" (OuterVolumeSpecName: "util") pod "cf9fd8d3-0197-47e6-8769-6e8d524e48be" (UID: "cf9fd8d3-0197-47e6-8769-6e8d524e48be"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:40:21.354533 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.354494    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz9rj\" (UniqueName: \"kubernetes.io/projected/0340751b-d8bb-42a8-8f18-3933dfad9975-kube-api-access-nz9rj\") pod \"0340751b-d8bb-42a8-8f18-3933dfad9975\" (UID: \"0340751b-d8bb-42a8-8f18-3933dfad9975\") "
Jul 15 14:40:21.354626 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.354552    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0340751b-d8bb-42a8-8f18-3933dfad9975-util\") pod \"0340751b-d8bb-42a8-8f18-3933dfad9975\" (UID: \"0340751b-d8bb-42a8-8f18-3933dfad9975\") "
Jul 15 14:40:21.354626 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.354569    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj7qh\" (UniqueName: \"kubernetes.io/projected/964e3a22-70c5-4086-93dd-437a069cdf2d-kube-api-access-hj7qh\") pod \"964e3a22-70c5-4086-93dd-437a069cdf2d\" (UID: \"964e3a22-70c5-4086-93dd-437a069cdf2d\") "
Jul 15 14:40:21.354626 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.354593    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/964e3a22-70c5-4086-93dd-437a069cdf2d-bundle\") pod \"964e3a22-70c5-4086-93dd-437a069cdf2d\" (UID: \"964e3a22-70c5-4086-93dd-437a069cdf2d\") "
Jul 15 14:40:21.354796 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.354644    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0340751b-d8bb-42a8-8f18-3933dfad9975-bundle\") pod \"0340751b-d8bb-42a8-8f18-3933dfad9975\" (UID: \"0340751b-d8bb-42a8-8f18-3933dfad9975\") "
Jul 15 14:40:21.354796 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.354668    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/964e3a22-70c5-4086-93dd-437a069cdf2d-util\") pod \"964e3a22-70c5-4086-93dd-437a069cdf2d\" (UID: \"964e3a22-70c5-4086-93dd-437a069cdf2d\") "
Jul 15 14:40:21.354926 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.354906    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf589\" (UniqueName: \"kubernetes.io/projected/cf9fd8d3-0197-47e6-8769-6e8d524e48be-kube-api-access-mf589\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:40:21.355011 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.354932    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf9fd8d3-0197-47e6-8769-6e8d524e48be-util\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:40:21.355011 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.354947    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf9fd8d3-0197-47e6-8769-6e8d524e48be-bundle\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:40:21.355221 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.355180    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0340751b-d8bb-42a8-8f18-3933dfad9975-bundle" (OuterVolumeSpecName: "bundle") pod "0340751b-d8bb-42a8-8f18-3933dfad9975" (UID: "0340751b-d8bb-42a8-8f18-3933dfad9975"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:40:21.355354 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.355334    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964e3a22-70c5-4086-93dd-437a069cdf2d-bundle" (OuterVolumeSpecName: "bundle") pod "964e3a22-70c5-4086-93dd-437a069cdf2d" (UID: "964e3a22-70c5-4086-93dd-437a069cdf2d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:40:21.356906 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.356883    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0340751b-d8bb-42a8-8f18-3933dfad9975-kube-api-access-nz9rj" (OuterVolumeSpecName: "kube-api-access-nz9rj") pod "0340751b-d8bb-42a8-8f18-3933dfad9975" (UID: "0340751b-d8bb-42a8-8f18-3933dfad9975"). InnerVolumeSpecName "kube-api-access-nz9rj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:40:21.357007 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.356990    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/964e3a22-70c5-4086-93dd-437a069cdf2d-kube-api-access-hj7qh" (OuterVolumeSpecName: "kube-api-access-hj7qh") pod "964e3a22-70c5-4086-93dd-437a069cdf2d" (UID: "964e3a22-70c5-4086-93dd-437a069cdf2d"). InnerVolumeSpecName "kube-api-access-hj7qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:40:21.360061 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.360026    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0340751b-d8bb-42a8-8f18-3933dfad9975-util" (OuterVolumeSpecName: "util") pod "0340751b-d8bb-42a8-8f18-3933dfad9975" (UID: "0340751b-d8bb-42a8-8f18-3933dfad9975"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:40:21.361208 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.361188    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964e3a22-70c5-4086-93dd-437a069cdf2d-util" (OuterVolumeSpecName: "util") pod "964e3a22-70c5-4086-93dd-437a069cdf2d" (UID: "964e3a22-70c5-4086-93dd-437a069cdf2d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:40:21.455788 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.455768    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0340751b-d8bb-42a8-8f18-3933dfad9975-bundle\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:40:21.455788 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.455788    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/964e3a22-70c5-4086-93dd-437a069cdf2d-util\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:40:21.455788 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.455797    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz9rj\" (UniqueName: \"kubernetes.io/projected/0340751b-d8bb-42a8-8f18-3933dfad9975-kube-api-access-nz9rj\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:40:21.455945 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.455806    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0340751b-d8bb-42a8-8f18-3933dfad9975-util\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:40:21.455945 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.455815    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj7qh\" (UniqueName: \"kubernetes.io/projected/964e3a22-70c5-4086-93dd-437a069cdf2d-kube-api-access-hj7qh\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:40:21.455945 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.455822    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/964e3a22-70c5-4086-93dd-437a069cdf2d-bundle\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:40:21.991793 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.991767    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5"
Jul 15 14:40:21.992228 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.991764    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5" event={"ID":"0340751b-d8bb-42a8-8f18-3933dfad9975","Type":"ContainerDied","Data":"a302b8f96a79e9984bf578e55cba7c894e65f351ff1789fad3a4dd534f6269a0"}
Jul 15 14:40:21.992228 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.991886    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a302b8f96a79e9984bf578e55cba7c894e65f351ff1789fad3a4dd534f6269a0"
Jul 15 14:40:21.993547 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.993524    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr"
Jul 15 14:40:21.993672 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.993552    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr" event={"ID":"964e3a22-70c5-4086-93dd-437a069cdf2d","Type":"ContainerDied","Data":"533e18cbb145df1c7f920fd2a67033cb60ace6c882047ae383b0ed55ff8268ad"}
Jul 15 14:40:21.993672 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.993594    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="533e18cbb145df1c7f920fd2a67033cb60ace6c882047ae383b0ed55ff8268ad"
Jul 15 14:40:21.995703 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.995679    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w" event={"ID":"cf9fd8d3-0197-47e6-8769-6e8d524e48be","Type":"ContainerDied","Data":"127c0a1945ff7e057949852561b7f2b15ce3230dbf26b5f189e063a969d1d25c"}
Jul 15 14:40:21.995796 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.995718    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w"
Jul 15 14:40:21.995847 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:21.995717    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="127c0a1945ff7e057949852561b7f2b15ce3230dbf26b5f189e063a969d1d25c"
Jul 15 14:40:39.257987 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:39.257960    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 14:40:39.258387 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:39.258009    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 14:40:39.262543 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:39.262524    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:40:39.262543 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:40:39.262539    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:41:44.946685 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.946651    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947034    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e5449f-588b-48be-8e1d-c46a444d4a0b" containerName="util"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947046    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e5449f-588b-48be-8e1d-c46a444d4a0b" containerName="util"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947063    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf9fd8d3-0197-47e6-8769-6e8d524e48be" containerName="pull"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947068    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf9fd8d3-0197-47e6-8769-6e8d524e48be" containerName="pull"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947074    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="964e3a22-70c5-4086-93dd-437a069cdf2d" containerName="extract"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947080    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="964e3a22-70c5-4086-93dd-437a069cdf2d" containerName="extract"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947089    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e5449f-588b-48be-8e1d-c46a444d4a0b" containerName="pull"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947095    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e5449f-588b-48be-8e1d-c46a444d4a0b" containerName="pull"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947100    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0340751b-d8bb-42a8-8f18-3933dfad9975" containerName="pull"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947105    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0340751b-d8bb-42a8-8f18-3933dfad9975" containerName="pull"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947111    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0340751b-d8bb-42a8-8f18-3933dfad9975" containerName="util"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947115    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0340751b-d8bb-42a8-8f18-3933dfad9975" containerName="util"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947121    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="964e3a22-70c5-4086-93dd-437a069cdf2d" containerName="pull"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947125    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="964e3a22-70c5-4086-93dd-437a069cdf2d" containerName="pull"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947131    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0340751b-d8bb-42a8-8f18-3933dfad9975" containerName="extract"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947136    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0340751b-d8bb-42a8-8f18-3933dfad9975" containerName="extract"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947142    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="964e3a22-70c5-4086-93dd-437a069cdf2d" containerName="util"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947147    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="964e3a22-70c5-4086-93dd-437a069cdf2d" containerName="util"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947152    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e5449f-588b-48be-8e1d-c46a444d4a0b" containerName="extract"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947156    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e5449f-588b-48be-8e1d-c46a444d4a0b" containerName="extract"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947162    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf9fd8d3-0197-47e6-8769-6e8d524e48be" containerName="extract"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947168    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf9fd8d3-0197-47e6-8769-6e8d524e48be" containerName="extract"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947175    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf9fd8d3-0197-47e6-8769-6e8d524e48be" containerName="util"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947181    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf9fd8d3-0197-47e6-8769-6e8d524e48be" containerName="util"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947235    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="964e3a22-70c5-4086-93dd-437a069cdf2d" containerName="extract"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947243    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0340751b-d8bb-42a8-8f18-3933dfad9975" containerName="extract"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947250    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="24e5449f-588b-48be-8e1d-c46a444d4a0b" containerName="extract"
Jul 15 14:41:44.949048 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.947256    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf9fd8d3-0197-47e6-8769-6e8d524e48be" containerName="extract"
Jul 15 14:41:44.950054 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.950039    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2ln65"
Jul 15 14:41:44.954757 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.954709    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 14:41:44.954757 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.954712    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 14:41:44.954992 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.954979    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 14:41:44.955881 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.955863    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rpvvg\""
Jul 15 14:41:44.963532 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:44.963515    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:41:45.011598 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.011571    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:41:45.103532 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.103504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrfgl\" (UniqueName: \"kubernetes.io/projected/4348bbf5-9721-47eb-bd68-568b6b77746b-kube-api-access-hrfgl\") pod \"limitador-limitador-54d6d988d5-2ln65\" (UID: \"4348bbf5-9721-47eb-bd68-568b6b77746b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2ln65"
Jul 15 14:41:45.103701 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.103574    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4348bbf5-9721-47eb-bd68-568b6b77746b-config-file\") pod \"limitador-limitador-54d6d988d5-2ln65\" (UID: \"4348bbf5-9721-47eb-bd68-568b6b77746b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2ln65"
Jul 15 14:41:45.204141 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.204064    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrfgl\" (UniqueName: \"kubernetes.io/projected/4348bbf5-9721-47eb-bd68-568b6b77746b-kube-api-access-hrfgl\") pod \"limitador-limitador-54d6d988d5-2ln65\" (UID: \"4348bbf5-9721-47eb-bd68-568b6b77746b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2ln65"
Jul 15 14:41:45.204141 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.204121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4348bbf5-9721-47eb-bd68-568b6b77746b-config-file\") pod \"limitador-limitador-54d6d988d5-2ln65\" (UID: \"4348bbf5-9721-47eb-bd68-568b6b77746b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2ln65"
Jul 15 14:41:45.204672 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.204655    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4348bbf5-9721-47eb-bd68-568b6b77746b-config-file\") pod \"limitador-limitador-54d6d988d5-2ln65\" (UID: \"4348bbf5-9721-47eb-bd68-568b6b77746b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2ln65"
Jul 15 14:41:45.214397 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.214371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrfgl\" (UniqueName: \"kubernetes.io/projected/4348bbf5-9721-47eb-bd68-568b6b77746b-kube-api-access-hrfgl\") pod \"limitador-limitador-54d6d988d5-2ln65\" (UID: \"4348bbf5-9721-47eb-bd68-568b6b77746b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2ln65"
Jul 15 14:41:45.260134 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.260108    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2ln65"
Jul 15 14:41:45.394143 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.394121    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:41:45.395967 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:41:45.395930    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4348bbf5_9721_47eb_bd68_568b6b77746b.slice/crio-8fe36d00187b6d85806a8fd671a6e544fa9335ee77b95962e40adac9d908ae77 WatchSource:0}: Error finding container 8fe36d00187b6d85806a8fd671a6e544fa9335ee77b95962e40adac9d908ae77: Status 404 returned error can't find the container with id 8fe36d00187b6d85806a8fd671a6e544fa9335ee77b95962e40adac9d908ae77
Jul 15 14:41:45.421404 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.421377    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2ln65" event={"ID":"4348bbf5-9721-47eb-bd68-568b6b77746b","Type":"ContainerStarted","Data":"8fe36d00187b6d85806a8fd671a6e544fa9335ee77b95962e40adac9d908ae77"}
Jul 15 14:41:45.715154 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.715127    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-f7294"]
Jul 15 14:41:45.719335 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.719321    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-f7294"
Jul 15 14:41:45.724003 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.723984    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-n7xmn\""
Jul 15 14:41:45.740621 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.740597    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f7294"]
Jul 15 14:41:45.808815 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.808777    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npjk8\" (UniqueName: \"kubernetes.io/projected/28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf-kube-api-access-npjk8\") pod \"authorino-75d556bd77-f7294\" (UID: \"28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf\") " pod="kuadrant-system/authorino-75d556bd77-f7294"
Jul 15 14:41:45.909615 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.909582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjk8\" (UniqueName: \"kubernetes.io/projected/28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf-kube-api-access-npjk8\") pod \"authorino-75d556bd77-f7294\" (UID: \"28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf\") " pod="kuadrant-system/authorino-75d556bd77-f7294"
Jul 15 14:41:45.929300 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:45.929275    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npjk8\" (UniqueName: \"kubernetes.io/projected/28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf-kube-api-access-npjk8\") pod \"authorino-75d556bd77-f7294\" (UID: \"28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf\") " pod="kuadrant-system/authorino-75d556bd77-f7294"
Jul 15 14:41:46.029594 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:46.029318    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-f7294"
Jul 15 14:41:46.204234 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:46.203636    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f7294"]
Jul 15 14:41:46.208689 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:41:46.208656    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28aaf2e7_4512_43eb_8a69_69fb1ecb1bcf.slice/crio-b78823c237ca106db7a41d5fe90045f93b9cb8967d6dbd4b01922eab6249aa26 WatchSource:0}: Error finding container b78823c237ca106db7a41d5fe90045f93b9cb8967d6dbd4b01922eab6249aa26: Status 404 returned error can't find the container with id b78823c237ca106db7a41d5fe90045f93b9cb8967d6dbd4b01922eab6249aa26
Jul 15 14:41:46.430181 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:46.430141    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-f7294" event={"ID":"28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf","Type":"ContainerStarted","Data":"b78823c237ca106db7a41d5fe90045f93b9cb8967d6dbd4b01922eab6249aa26"}
Jul 15 14:41:48.443709 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:48.443647    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2ln65" event={"ID":"4348bbf5-9721-47eb-bd68-568b6b77746b","Type":"ContainerStarted","Data":"8346000af90104e7f4d333c1bcdba294ed60ef7f3b1ea6e4e8da935cfeb57381"}
Jul 15 14:41:48.444177 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:48.443805    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2ln65"
Jul 15 14:41:48.468475 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:48.468399    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-2ln65" podStartSLOduration=1.809029352 podStartE2EDuration="4.468379223s" totalImagesPullingTime="2.659349871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:41:48.463995272 +0000 UTC m=+669.610676027" watchObservedRunningTime="2026-07-15 14:41:48.468379223 +0000 UTC m=+669.615059978"
Jul 15 14:41:50.456501 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:50.456465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-f7294" event={"ID":"28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf","Type":"ContainerStarted","Data":"5ff443980770ece85662c4de8e17024426e24be248ea9214212c73810793d54e"}
Jul 15 14:41:50.480760 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:50.480689    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-f7294" podStartSLOduration=1.60529436 podStartE2EDuration="5.480675007s" totalImagesPullingTime="3.875380647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:41:50.477948962 +0000 UTC m=+671.624629708" watchObservedRunningTime="2026-07-15 14:41:50.480675007 +0000 UTC m=+671.627355760"
Jul 15 14:41:59.450281 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:41:59.450245    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2ln65"
Jul 15 14:42:14.296105 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.296061    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tjp7g"]
Jul 15 14:42:14.299374 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.299352    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tjp7g"
Jul 15 14:42:14.312358 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.312337    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tjp7g"]
Jul 15 14:42:14.331625 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.331602    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqx4w\" (UniqueName: \"kubernetes.io/projected/d5233a86-54aa-489b-9e92-77bd5a243465-kube-api-access-nqx4w\") pod \"authorino-5d4b67c446-tjp7g\" (UID: \"d5233a86-54aa-489b-9e92-77bd5a243465\") " pod="kuadrant-system/authorino-5d4b67c446-tjp7g"
Jul 15 14:42:14.432651 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.432629    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqx4w\" (UniqueName: \"kubernetes.io/projected/d5233a86-54aa-489b-9e92-77bd5a243465-kube-api-access-nqx4w\") pod \"authorino-5d4b67c446-tjp7g\" (UID: \"d5233a86-54aa-489b-9e92-77bd5a243465\") " pod="kuadrant-system/authorino-5d4b67c446-tjp7g"
Jul 15 14:42:14.442933 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.442904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqx4w\" (UniqueName: \"kubernetes.io/projected/d5233a86-54aa-489b-9e92-77bd5a243465-kube-api-access-nqx4w\") pod \"authorino-5d4b67c446-tjp7g\" (UID: \"d5233a86-54aa-489b-9e92-77bd5a243465\") " pod="kuadrant-system/authorino-5d4b67c446-tjp7g"
Jul 15 14:42:14.510184 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.510163    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tjp7g"]
Jul 15 14:42:14.510385 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.510375    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tjp7g"
Jul 15 14:42:14.544648 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.544622    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-697d7c75b-7mkjs"]
Jul 15 14:42:14.548162 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.548118    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-697d7c75b-7mkjs"
Jul 15 14:42:14.558950 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.558926    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-697d7c75b-7mkjs"]
Jul 15 14:42:14.634385 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.634340    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hdj6\" (UniqueName: \"kubernetes.io/projected/856cb3af-6480-4e6c-a161-44e470759726-kube-api-access-4hdj6\") pod \"authorino-697d7c75b-7mkjs\" (UID: \"856cb3af-6480-4e6c-a161-44e470759726\") " pod="kuadrant-system/authorino-697d7c75b-7mkjs"
Jul 15 14:42:14.651702 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.651676    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tjp7g"]
Jul 15 14:42:14.653576 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:42:14.653551    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5233a86_54aa_489b_9e92_77bd5a243465.slice/crio-b6985297be10141ca4f827d36730e920d47d21f541806d3db0eac0e2428f0f94 WatchSource:0}: Error finding container b6985297be10141ca4f827d36730e920d47d21f541806d3db0eac0e2428f0f94: Status 404 returned error can't find the container with id b6985297be10141ca4f827d36730e920d47d21f541806d3db0eac0e2428f0f94
Jul 15 14:42:14.735270 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.735244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hdj6\" (UniqueName: \"kubernetes.io/projected/856cb3af-6480-4e6c-a161-44e470759726-kube-api-access-4hdj6\") pod \"authorino-697d7c75b-7mkjs\" (UID: \"856cb3af-6480-4e6c-a161-44e470759726\") " pod="kuadrant-system/authorino-697d7c75b-7mkjs"
Jul 15 14:42:14.749026 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.749007    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hdj6\" (UniqueName: \"kubernetes.io/projected/856cb3af-6480-4e6c-a161-44e470759726-kube-api-access-4hdj6\") pod \"authorino-697d7c75b-7mkjs\" (UID: \"856cb3af-6480-4e6c-a161-44e470759726\") " pod="kuadrant-system/authorino-697d7c75b-7mkjs"
Jul 15 14:42:14.764333 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.764308    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-697d7c75b-7mkjs"]
Jul 15 14:42:14.764554 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.764538    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-697d7c75b-7mkjs"
Jul 15 14:42:14.812634 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.812608    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58f5969fb-r62j8"]
Jul 15 14:42:14.816842 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.816816    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f5969fb-r62j8"
Jul 15 14:42:14.823343 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.823320    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 14:42:14.835919 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.835895    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh5bt\" (UniqueName: \"kubernetes.io/projected/6090521c-f80a-4b25-a483-2c647413e036-kube-api-access-sh5bt\") pod \"authorino-58f5969fb-r62j8\" (UID: \"6090521c-f80a-4b25-a483-2c647413e036\") " pod="kuadrant-system/authorino-58f5969fb-r62j8"
Jul 15 14:42:14.836030 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.835943    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6090521c-f80a-4b25-a483-2c647413e036-tls-cert\") pod \"authorino-58f5969fb-r62j8\" (UID: \"6090521c-f80a-4b25-a483-2c647413e036\") " pod="kuadrant-system/authorino-58f5969fb-r62j8"
Jul 15 14:42:14.838437 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.838417    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58f5969fb-r62j8"]
Jul 15 14:42:14.904597 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.904572    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-697d7c75b-7mkjs"]
Jul 15 14:42:14.905415 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:42:14.905393    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod856cb3af_6480_4e6c_a161_44e470759726.slice/crio-e1820aaeb219cf9d773316f07ab9c4d2ce55cd3db107d52000b0f893d4a1872c WatchSource:0}: Error finding container e1820aaeb219cf9d773316f07ab9c4d2ce55cd3db107d52000b0f893d4a1872c: Status 404 returned error can't find the container with id e1820aaeb219cf9d773316f07ab9c4d2ce55cd3db107d52000b0f893d4a1872c
Jul 15 14:42:14.936507 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.936483    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh5bt\" (UniqueName: \"kubernetes.io/projected/6090521c-f80a-4b25-a483-2c647413e036-kube-api-access-sh5bt\") pod \"authorino-58f5969fb-r62j8\" (UID: \"6090521c-f80a-4b25-a483-2c647413e036\") " pod="kuadrant-system/authorino-58f5969fb-r62j8"
Jul 15 14:42:14.936610 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.936512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6090521c-f80a-4b25-a483-2c647413e036-tls-cert\") pod \"authorino-58f5969fb-r62j8\" (UID: \"6090521c-f80a-4b25-a483-2c647413e036\") " pod="kuadrant-system/authorino-58f5969fb-r62j8"
Jul 15 14:42:14.938752 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.938716    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6090521c-f80a-4b25-a483-2c647413e036-tls-cert\") pod \"authorino-58f5969fb-r62j8\" (UID: \"6090521c-f80a-4b25-a483-2c647413e036\") " pod="kuadrant-system/authorino-58f5969fb-r62j8"
Jul 15 14:42:14.950600 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:14.950582    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh5bt\" (UniqueName: \"kubernetes.io/projected/6090521c-f80a-4b25-a483-2c647413e036-kube-api-access-sh5bt\") pod \"authorino-58f5969fb-r62j8\" (UID: \"6090521c-f80a-4b25-a483-2c647413e036\") " pod="kuadrant-system/authorino-58f5969fb-r62j8"
Jul 15 14:42:15.128899 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:15.128841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f5969fb-r62j8"
Jul 15 14:42:15.264054 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:15.264022    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58f5969fb-r62j8"]
Jul 15 14:42:15.267220 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:42:15.267195    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6090521c_f80a_4b25_a483_2c647413e036.slice/crio-9b4489604b9a6bb3200914999a1ff7c586da7a70851b560924d9ddcf23b6d46a WatchSource:0}: Error finding container 9b4489604b9a6bb3200914999a1ff7c586da7a70851b560924d9ddcf23b6d46a: Status 404 returned error can't find the container with id 9b4489604b9a6bb3200914999a1ff7c586da7a70851b560924d9ddcf23b6d46a
Jul 15 14:42:15.594307 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:15.594276    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-697d7c75b-7mkjs" event={"ID":"856cb3af-6480-4e6c-a161-44e470759726","Type":"ContainerStarted","Data":"bb6065ba3e8506e7049b4b97754b657da23cf1ba57660f611be095db7da32c0c"}
Jul 15 14:42:15.594728 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:15.594314    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-697d7c75b-7mkjs" event={"ID":"856cb3af-6480-4e6c-a161-44e470759726","Type":"ContainerStarted","Data":"e1820aaeb219cf9d773316f07ab9c4d2ce55cd3db107d52000b0f893d4a1872c"}
Jul 15 14:42:15.594728 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:15.594318    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-697d7c75b-7mkjs" podUID="856cb3af-6480-4e6c-a161-44e470759726" containerName="authorino" containerID="cri-o://bb6065ba3e8506e7049b4b97754b657da23cf1ba57660f611be095db7da32c0c" gracePeriod=30
Jul 15 14:42:15.595673 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:15.595647    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f5969fb-r62j8" event={"ID":"6090521c-f80a-4b25-a483-2c647413e036","Type":"ContainerStarted","Data":"9b4489604b9a6bb3200914999a1ff7c586da7a70851b560924d9ddcf23b6d46a"}
Jul 15 14:42:15.596926 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:15.596902    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tjp7g" event={"ID":"d5233a86-54aa-489b-9e92-77bd5a243465","Type":"ContainerStarted","Data":"b6985297be10141ca4f827d36730e920d47d21f541806d3db0eac0e2428f0f94"}
Jul 15 14:42:15.614127 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:15.614089    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-697d7c75b-7mkjs" podStartSLOduration=1.1857807519999999 podStartE2EDuration="1.61407588s" totalImagesPullingTime="428.295128ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:42:15.612622428 +0000 UTC m=+696.759303203" watchObservedRunningTime="2026-07-15 14:42:15.61407588 +0000 UTC m=+696.760756635"
Jul 15 14:42:15.844855 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:15.844828    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-697d7c75b-7mkjs"
Jul 15 14:42:15.945364 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:15.945337    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hdj6\" (UniqueName: \"kubernetes.io/projected/856cb3af-6480-4e6c-a161-44e470759726-kube-api-access-4hdj6\") pod \"856cb3af-6480-4e6c-a161-44e470759726\" (UID: \"856cb3af-6480-4e6c-a161-44e470759726\") "
Jul 15 14:42:15.947318 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:15.947293    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/856cb3af-6480-4e6c-a161-44e470759726-kube-api-access-4hdj6" (OuterVolumeSpecName: "kube-api-access-4hdj6") pod "856cb3af-6480-4e6c-a161-44e470759726" (UID: "856cb3af-6480-4e6c-a161-44e470759726"). InnerVolumeSpecName "kube-api-access-4hdj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:42:16.046918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.046886    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hdj6\" (UniqueName: \"kubernetes.io/projected/856cb3af-6480-4e6c-a161-44e470759726-kube-api-access-4hdj6\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:42:16.603665 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.603629    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f5969fb-r62j8" event={"ID":"6090521c-f80a-4b25-a483-2c647413e036","Type":"ContainerStarted","Data":"c64cbcaecac0859793a0efd5f269ee6bdd094b2715f42901bc7feb0ea51ee2ad"}
Jul 15 14:42:16.605236 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.605189    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tjp7g" event={"ID":"d5233a86-54aa-489b-9e92-77bd5a243465","Type":"ContainerStarted","Data":"b2eff8638111ca0cd016166e2663aaeba03ed30b723d76d515ed6ba97279513d"}
Jul 15 14:42:16.605236 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.605216    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-tjp7g" podUID="d5233a86-54aa-489b-9e92-77bd5a243465" containerName="authorino" containerID="cri-o://b2eff8638111ca0cd016166e2663aaeba03ed30b723d76d515ed6ba97279513d" gracePeriod=30
Jul 15 14:42:16.606565 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.606537    2581 generic.go:356] "Generic (PLEG): container finished" podID="856cb3af-6480-4e6c-a161-44e470759726" containerID="bb6065ba3e8506e7049b4b97754b657da23cf1ba57660f611be095db7da32c0c" exitCode=0
Jul 15 14:42:16.606656 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.606564    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-697d7c75b-7mkjs" event={"ID":"856cb3af-6480-4e6c-a161-44e470759726","Type":"ContainerDied","Data":"bb6065ba3e8506e7049b4b97754b657da23cf1ba57660f611be095db7da32c0c"}
Jul 15 14:42:16.606656 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.606588    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-697d7c75b-7mkjs"
Jul 15 14:42:16.606656 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.606605    2581 scope.go:117] "RemoveContainer" containerID="bb6065ba3e8506e7049b4b97754b657da23cf1ba57660f611be095db7da32c0c"
Jul 15 14:42:16.606800 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.606594    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-697d7c75b-7mkjs" event={"ID":"856cb3af-6480-4e6c-a161-44e470759726","Type":"ContainerDied","Data":"e1820aaeb219cf9d773316f07ab9c4d2ce55cd3db107d52000b0f893d4a1872c"}
Jul 15 14:42:16.616257 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.616239    2581 scope.go:117] "RemoveContainer" containerID="bb6065ba3e8506e7049b4b97754b657da23cf1ba57660f611be095db7da32c0c"
Jul 15 14:42:16.616488 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:42:16.616470    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb6065ba3e8506e7049b4b97754b657da23cf1ba57660f611be095db7da32c0c\": container with ID starting with bb6065ba3e8506e7049b4b97754b657da23cf1ba57660f611be095db7da32c0c not found: ID does not exist" containerID="bb6065ba3e8506e7049b4b97754b657da23cf1ba57660f611be095db7da32c0c"
Jul 15 14:42:16.616530 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.616496    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb6065ba3e8506e7049b4b97754b657da23cf1ba57660f611be095db7da32c0c"} err="failed to get container status \"bb6065ba3e8506e7049b4b97754b657da23cf1ba57660f611be095db7da32c0c\": rpc error: code = NotFound desc = could not find container \"bb6065ba3e8506e7049b4b97754b657da23cf1ba57660f611be095db7da32c0c\": container with ID starting with bb6065ba3e8506e7049b4b97754b657da23cf1ba57660f611be095db7da32c0c not found: ID does not exist"
Jul 15 14:42:16.629448 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.629412    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58f5969fb-r62j8" podStartSLOduration=2.03022994 podStartE2EDuration="2.629399279s" totalImagesPullingTime="599.169339ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:42:16.62812957 +0000 UTC m=+697.774810342" watchObservedRunningTime="2026-07-15 14:42:16.629399279 +0000 UTC m=+697.776080035"
Jul 15 14:42:16.651539 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.651503    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-tjp7g" podStartSLOduration=1.375319604 podStartE2EDuration="2.651490105s" totalImagesPullingTime="1.276170501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:42:16.650995552 +0000 UTC m=+697.797676308" watchObservedRunningTime="2026-07-15 14:42:16.651490105 +0000 UTC m=+697.798170860"
Jul 15 14:42:16.672512 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.672480    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f7294"]
Jul 15 14:42:16.672669 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.672649    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-f7294" podUID="28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf" containerName="authorino" containerID="cri-o://5ff443980770ece85662c4de8e17024426e24be248ea9214212c73810793d54e" gracePeriod=30
Jul 15 14:42:16.676077 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.676046    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-697d7c75b-7mkjs"]
Jul 15 14:42:16.686077 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.686056    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-697d7c75b-7mkjs"]
Jul 15 14:42:16.938679 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.938656    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tjp7g"
Jul 15 14:42:16.941724 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.941704    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-f7294"
Jul 15 14:42:16.953830 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.953809    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqx4w\" (UniqueName: \"kubernetes.io/projected/d5233a86-54aa-489b-9e92-77bd5a243465-kube-api-access-nqx4w\") pod \"d5233a86-54aa-489b-9e92-77bd5a243465\" (UID: \"d5233a86-54aa-489b-9e92-77bd5a243465\") "
Jul 15 14:42:16.953918 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.953874    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npjk8\" (UniqueName: \"kubernetes.io/projected/28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf-kube-api-access-npjk8\") pod \"28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf\" (UID: \"28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf\") "
Jul 15 14:42:16.955747 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.955695    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5233a86-54aa-489b-9e92-77bd5a243465-kube-api-access-nqx4w" (OuterVolumeSpecName: "kube-api-access-nqx4w") pod "d5233a86-54aa-489b-9e92-77bd5a243465" (UID: "d5233a86-54aa-489b-9e92-77bd5a243465"). InnerVolumeSpecName "kube-api-access-nqx4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:42:16.955747 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:16.955711    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf-kube-api-access-npjk8" (OuterVolumeSpecName: "kube-api-access-npjk8") pod "28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf" (UID: "28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf"). InnerVolumeSpecName "kube-api-access-npjk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:42:17.054678 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.054605    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npjk8\" (UniqueName: \"kubernetes.io/projected/28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf-kube-api-access-npjk8\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:42:17.054678 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.054630    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqx4w\" (UniqueName: \"kubernetes.io/projected/d5233a86-54aa-489b-9e92-77bd5a243465-kube-api-access-nqx4w\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:42:17.381787 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.381687    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="856cb3af-6480-4e6c-a161-44e470759726" path="/var/lib/kubelet/pods/856cb3af-6480-4e6c-a161-44e470759726/volumes"
Jul 15 14:42:17.614205 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.614169    2581 generic.go:356] "Generic (PLEG): container finished" podID="28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf" containerID="5ff443980770ece85662c4de8e17024426e24be248ea9214212c73810793d54e" exitCode=0
Jul 15 14:42:17.614632 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.614208    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-f7294"
Jul 15 14:42:17.614632 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.614257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-f7294" event={"ID":"28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf","Type":"ContainerDied","Data":"5ff443980770ece85662c4de8e17024426e24be248ea9214212c73810793d54e"}
Jul 15 14:42:17.614632 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.614296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-f7294" event={"ID":"28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf","Type":"ContainerDied","Data":"b78823c237ca106db7a41d5fe90045f93b9cb8967d6dbd4b01922eab6249aa26"}
Jul 15 14:42:17.614632 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.614313    2581 scope.go:117] "RemoveContainer" containerID="5ff443980770ece85662c4de8e17024426e24be248ea9214212c73810793d54e"
Jul 15 14:42:17.616828 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.616807    2581 generic.go:356] "Generic (PLEG): container finished" podID="d5233a86-54aa-489b-9e92-77bd5a243465" containerID="b2eff8638111ca0cd016166e2663aaeba03ed30b723d76d515ed6ba97279513d" exitCode=0
Jul 15 14:42:17.616911 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.616841    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tjp7g"
Jul 15 14:42:17.616911 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.616884    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tjp7g" event={"ID":"d5233a86-54aa-489b-9e92-77bd5a243465","Type":"ContainerDied","Data":"b2eff8638111ca0cd016166e2663aaeba03ed30b723d76d515ed6ba97279513d"}
Jul 15 14:42:17.616990 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.616915    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tjp7g" event={"ID":"d5233a86-54aa-489b-9e92-77bd5a243465","Type":"ContainerDied","Data":"b6985297be10141ca4f827d36730e920d47d21f541806d3db0eac0e2428f0f94"}
Jul 15 14:42:17.625556 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.625541    2581 scope.go:117] "RemoveContainer" containerID="5ff443980770ece85662c4de8e17024426e24be248ea9214212c73810793d54e"
Jul 15 14:42:17.625841 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:42:17.625824    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ff443980770ece85662c4de8e17024426e24be248ea9214212c73810793d54e\": container with ID starting with 5ff443980770ece85662c4de8e17024426e24be248ea9214212c73810793d54e not found: ID does not exist" containerID="5ff443980770ece85662c4de8e17024426e24be248ea9214212c73810793d54e"
Jul 15 14:42:17.625899 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.625850    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ff443980770ece85662c4de8e17024426e24be248ea9214212c73810793d54e"} err="failed to get container status \"5ff443980770ece85662c4de8e17024426e24be248ea9214212c73810793d54e\": rpc error: code = NotFound desc = could not find container \"5ff443980770ece85662c4de8e17024426e24be248ea9214212c73810793d54e\": container with ID starting with 5ff443980770ece85662c4de8e17024426e24be248ea9214212c73810793d54e not found: ID does not exist"
Jul 15 14:42:17.625899 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.625868    2581 scope.go:117] "RemoveContainer" containerID="b2eff8638111ca0cd016166e2663aaeba03ed30b723d76d515ed6ba97279513d"
Jul 15 14:42:17.633566 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.633551    2581 scope.go:117] "RemoveContainer" containerID="b2eff8638111ca0cd016166e2663aaeba03ed30b723d76d515ed6ba97279513d"
Jul 15 14:42:17.633800 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:42:17.633781    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2eff8638111ca0cd016166e2663aaeba03ed30b723d76d515ed6ba97279513d\": container with ID starting with b2eff8638111ca0cd016166e2663aaeba03ed30b723d76d515ed6ba97279513d not found: ID does not exist" containerID="b2eff8638111ca0cd016166e2663aaeba03ed30b723d76d515ed6ba97279513d"
Jul 15 14:42:17.633861 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.633810    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2eff8638111ca0cd016166e2663aaeba03ed30b723d76d515ed6ba97279513d"} err="failed to get container status \"b2eff8638111ca0cd016166e2663aaeba03ed30b723d76d515ed6ba97279513d\": rpc error: code = NotFound desc = could not find container \"b2eff8638111ca0cd016166e2663aaeba03ed30b723d76d515ed6ba97279513d\": container with ID starting with b2eff8638111ca0cd016166e2663aaeba03ed30b723d76d515ed6ba97279513d not found: ID does not exist"
Jul 15 14:42:17.651520 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.651499    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f7294"]
Jul 15 14:42:17.662401 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.662371    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f7294"]
Jul 15 14:42:17.689673 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.689652    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tjp7g"]
Jul 15 14:42:17.695711 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:17.695693    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tjp7g"]
Jul 15 14:42:19.380437 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:19.380406    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf" path="/var/lib/kubelet/pods/28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf/volumes"
Jul 15 14:42:19.380811 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:19.380697    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5233a86-54aa-489b-9e92-77bd5a243465" path="/var/lib/kubelet/pods/d5233a86-54aa-489b-9e92-77bd5a243465/volumes"
Jul 15 14:42:58.716939 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:42:58.716901    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:43:22.334115 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:43:22.334080    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:43:48.801908 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:43:48.801874    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:43:53.327574 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:43:53.327539    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:44:18.609892 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:18.609857    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:44:39.418122 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:39.418086    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:44:50.924580 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.924545    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"]
Jul 15 14:44:50.925021 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.924920    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf" containerName="authorino"
Jul 15 14:44:50.925021 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.924933    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf" containerName="authorino"
Jul 15 14:44:50.925021 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.924944    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856cb3af-6480-4e6c-a161-44e470759726" containerName="authorino"
Jul 15 14:44:50.925021 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.924949    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="856cb3af-6480-4e6c-a161-44e470759726" containerName="authorino"
Jul 15 14:44:50.925021 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.924962    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5233a86-54aa-489b-9e92-77bd5a243465" containerName="authorino"
Jul 15 14:44:50.925021 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.924968    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5233a86-54aa-489b-9e92-77bd5a243465" containerName="authorino"
Jul 15 14:44:50.925230 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.925028    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="28aaf2e7-4512-43eb-8a69-69fb1ecb1bcf" containerName="authorino"
Jul 15 14:44:50.925230 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.925037    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="856cb3af-6480-4e6c-a161-44e470759726" containerName="authorino"
Jul 15 14:44:50.925230 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.925046    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5233a86-54aa-489b-9e92-77bd5a243465" containerName="authorino"
Jul 15 14:44:50.928044 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.928026    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:50.939454 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.939431    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jhjp2\""
Jul 15 14:44:50.939575 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.939457    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 14:44:50.939575 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.939499    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 14:44:50.939776 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.939762    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 14:44:50.944634 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.944613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"]
Jul 15 14:44:50.978796 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.978774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51f13559-2d02-43ff-af2e-dce8f5960414-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:50.978892 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.978822    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svl8k\" (UniqueName: \"kubernetes.io/projected/51f13559-2d02-43ff-af2e-dce8f5960414-kube-api-access-svl8k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:50.978935 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.978892    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51f13559-2d02-43ff-af2e-dce8f5960414-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:50.978935 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.978931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51f13559-2d02-43ff-af2e-dce8f5960414-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:50.978997 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.978949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51f13559-2d02-43ff-af2e-dce8f5960414-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:50.978997 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:50.978970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51f13559-2d02-43ff-af2e-dce8f5960414-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:51.080291 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.080259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51f13559-2d02-43ff-af2e-dce8f5960414-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:51.080403 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.080322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svl8k\" (UniqueName: \"kubernetes.io/projected/51f13559-2d02-43ff-af2e-dce8f5960414-kube-api-access-svl8k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:51.080403 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.080369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51f13559-2d02-43ff-af2e-dce8f5960414-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:51.080502 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.080402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51f13559-2d02-43ff-af2e-dce8f5960414-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:51.080502 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.080439    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51f13559-2d02-43ff-af2e-dce8f5960414-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:51.080502 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.080465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51f13559-2d02-43ff-af2e-dce8f5960414-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:51.080697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.080672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51f13559-2d02-43ff-af2e-dce8f5960414-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:51.080781 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.080697    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51f13559-2d02-43ff-af2e-dce8f5960414-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:51.080880 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.080863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51f13559-2d02-43ff-af2e-dce8f5960414-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:51.082629 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.082612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51f13559-2d02-43ff-af2e-dce8f5960414-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:51.082817 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.082799    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51f13559-2d02-43ff-af2e-dce8f5960414-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:51.093621 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.093601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svl8k\" (UniqueName: \"kubernetes.io/projected/51f13559-2d02-43ff-af2e-dce8f5960414-kube-api-access-svl8k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q\" (UID: \"51f13559-2d02-43ff-af2e-dce8f5960414\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:51.236906 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.236850    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:44:51.367651 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.367624    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"]
Jul 15 14:44:51.369391 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:44:51.369363    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51f13559_2d02_43ff_af2e_dce8f5960414.slice/crio-cb52643e0df3268348f7ba6dc96510b3cb0522bc36cb1c4a0c8627ca066b6d11 WatchSource:0}: Error finding container cb52643e0df3268348f7ba6dc96510b3cb0522bc36cb1c4a0c8627ca066b6d11: Status 404 returned error can't find the container with id cb52643e0df3268348f7ba6dc96510b3cb0522bc36cb1c4a0c8627ca066b6d11
Jul 15 14:44:51.371056 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.371039    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 14:44:51.405670 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:51.405646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q" event={"ID":"51f13559-2d02-43ff-af2e-dce8f5960414","Type":"ContainerStarted","Data":"cb52643e0df3268348f7ba6dc96510b3cb0522bc36cb1c4a0c8627ca066b6d11"}
Jul 15 14:44:53.417104 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:53.417071    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q" event={"ID":"51f13559-2d02-43ff-af2e-dce8f5960414","Type":"ContainerStarted","Data":"6ae577b0c8eabfd9294311bea63049d261c0e4eb3abaebf894fc72146574dc87"}
Jul 15 14:44:53.440115 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:53.440070    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q" podStartSLOduration=2.176243943 podStartE2EDuration="3.440053982s" totalImagesPullingTime="1.263810039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:44:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:44:53.43827316 +0000 UTC m=+854.584953916" watchObservedRunningTime="2026-07-15 14:44:53.440053982 +0000 UTC m=+854.586734737"
Jul 15 14:44:53.606724 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:44:53.606691    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:45:00.145922 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:00.145885    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735445-sjkmr"]
Jul 15 14:45:00.149386 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:00.149366    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-sjkmr"
Jul 15 14:45:00.153248 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:00.153224    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 14:45:00.155889 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:00.155865    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735445-sjkmr"]
Jul 15 14:45:00.161098 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:00.161080    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-sjkmr"
Jul 15 14:45:00.308194 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:00.308172    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735445-sjkmr"]
Jul 15 14:45:00.308898 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:45:00.308876    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a31f668_259c_4f76_a428_96473bed96a1.slice/crio-3668448aaecf35351aee444ff1cd709c6c6e9400ca1369170aa3204ac1f9285a WatchSource:0}: Error finding container 3668448aaecf35351aee444ff1cd709c6c6e9400ca1369170aa3204ac1f9285a: Status 404 returned error can't find the container with id 3668448aaecf35351aee444ff1cd709c6c6e9400ca1369170aa3204ac1f9285a
Jul 15 14:45:00.453317 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:00.453280    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-sjkmr" event={"ID":"7a31f668-259c-4f76-a428-96473bed96a1","Type":"ContainerStarted","Data":"3668448aaecf35351aee444ff1cd709c6c6e9400ca1369170aa3204ac1f9285a"}
Jul 15 14:45:01.237624 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:01.237589    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:45:01.238083 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:01.237651    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:45:01.250050 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:01.250027    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:45:01.473269 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:01.473241    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q"
Jul 15 14:45:03.471560 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:03.471527    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-sjkmr" event={"ID":"7a31f668-259c-4f76-a428-96473bed96a1","Type":"ContainerStarted","Data":"e3d0f0c374c3eb1888172abe0185494d86ffdd1b69cd3c01c67e9c0132e9834e"}
Jul 15 14:45:03.494095 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:03.494047    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-sjkmr" podStartSLOduration=1.117240829 podStartE2EDuration="3.494032192s" totalImagesPullingTime="2.376791363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:45:03.492196856 +0000 UTC m=+864.638877613" watchObservedRunningTime="2026-07-15 14:45:03.494032192 +0000 UTC m=+864.640712948"
Jul 15 14:45:04.477891 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:04.477859    2581 generic.go:356] "Generic (PLEG): container finished" podID="7a31f668-259c-4f76-a428-96473bed96a1" containerID="e3d0f0c374c3eb1888172abe0185494d86ffdd1b69cd3c01c67e9c0132e9834e" exitCode=0
Jul 15 14:45:04.478264 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:04.477913    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-sjkmr" event={"ID":"7a31f668-259c-4f76-a428-96473bed96a1","Type":"ContainerDied","Data":"e3d0f0c374c3eb1888172abe0185494d86ffdd1b69cd3c01c67e9c0132e9834e"}
Jul 15 14:45:05.610465 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:05.610442    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-sjkmr"
Jul 15 14:45:06.489270 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:06.489242    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-sjkmr"
Jul 15 14:45:06.489449 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:06.489238    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-sjkmr" event={"ID":"7a31f668-259c-4f76-a428-96473bed96a1","Type":"ContainerDied","Data":"3668448aaecf35351aee444ff1cd709c6c6e9400ca1369170aa3204ac1f9285a"}
Jul 15 14:45:06.489449 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:06.489375    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3668448aaecf35351aee444ff1cd709c6c6e9400ca1369170aa3204ac1f9285a"
Jul 15 14:45:26.165262 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:26.165226    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-548d4964b9-rj6qb"]
Jul 15 14:45:26.165617 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:26.165603    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a31f668-259c-4f76-a428-96473bed96a1" containerName="cleanup"
Jul 15 14:45:26.165658 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:26.165617    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a31f668-259c-4f76-a428-96473bed96a1" containerName="cleanup"
Jul 15 14:45:26.165705 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:26.165692    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a31f668-259c-4f76-a428-96473bed96a1" containerName="cleanup"
Jul 15 14:45:26.171071 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:26.171053    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-548d4964b9-rj6qb"
Jul 15 14:45:26.185968 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:26.185946    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-548d4964b9-rj6qb"]
Jul 15 14:45:26.269278 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:26.269249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/535b6f4a-ad0a-49c4-8be6-303750523bf3-tls-cert\") pod \"authorino-548d4964b9-rj6qb\" (UID: \"535b6f4a-ad0a-49c4-8be6-303750523bf3\") " pod="kuadrant-system/authorino-548d4964b9-rj6qb"
Jul 15 14:45:26.269379 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:26.269325    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqhgc\" (UniqueName: \"kubernetes.io/projected/535b6f4a-ad0a-49c4-8be6-303750523bf3-kube-api-access-xqhgc\") pod \"authorino-548d4964b9-rj6qb\" (UID: \"535b6f4a-ad0a-49c4-8be6-303750523bf3\") " pod="kuadrant-system/authorino-548d4964b9-rj6qb"
Jul 15 14:45:26.370431 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:26.370399    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqhgc\" (UniqueName: \"kubernetes.io/projected/535b6f4a-ad0a-49c4-8be6-303750523bf3-kube-api-access-xqhgc\") pod \"authorino-548d4964b9-rj6qb\" (UID: \"535b6f4a-ad0a-49c4-8be6-303750523bf3\") " pod="kuadrant-system/authorino-548d4964b9-rj6qb"
Jul 15 14:45:26.370585 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:26.370439    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/535b6f4a-ad0a-49c4-8be6-303750523bf3-tls-cert\") pod \"authorino-548d4964b9-rj6qb\" (UID: \"535b6f4a-ad0a-49c4-8be6-303750523bf3\") " pod="kuadrant-system/authorino-548d4964b9-rj6qb"
Jul 15 14:45:26.373008 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:26.372980    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/535b6f4a-ad0a-49c4-8be6-303750523bf3-tls-cert\") pod \"authorino-548d4964b9-rj6qb\" (UID: \"535b6f4a-ad0a-49c4-8be6-303750523bf3\") " pod="kuadrant-system/authorino-548d4964b9-rj6qb"
Jul 15 14:45:26.382755 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:26.382711    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqhgc\" (UniqueName: \"kubernetes.io/projected/535b6f4a-ad0a-49c4-8be6-303750523bf3-kube-api-access-xqhgc\") pod \"authorino-548d4964b9-rj6qb\" (UID: \"535b6f4a-ad0a-49c4-8be6-303750523bf3\") " pod="kuadrant-system/authorino-548d4964b9-rj6qb"
Jul 15 14:45:26.502534 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:26.502500    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-548d4964b9-rj6qb"
Jul 15 14:45:26.648206 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:26.648173    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-548d4964b9-rj6qb"]
Jul 15 14:45:26.651413 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:45:26.651387    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod535b6f4a_ad0a_49c4_8be6_303750523bf3.slice/crio-329094362d553848e78ae99ba581590ff7a2bd07b54ea6506b18e4d0bd5d31c2 WatchSource:0}: Error finding container 329094362d553848e78ae99ba581590ff7a2bd07b54ea6506b18e4d0bd5d31c2: Status 404 returned error can't find the container with id 329094362d553848e78ae99ba581590ff7a2bd07b54ea6506b18e4d0bd5d31c2
Jul 15 14:45:27.593161 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:27.593114    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-548d4964b9-rj6qb" event={"ID":"535b6f4a-ad0a-49c4-8be6-303750523bf3","Type":"ContainerStarted","Data":"f176aed3782b3e7fc6c3a55b1696295be94e1361c8f51f5363c77eeab6ab4332"}
Jul 15 14:45:27.593676 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:27.593182    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-548d4964b9-rj6qb" event={"ID":"535b6f4a-ad0a-49c4-8be6-303750523bf3","Type":"ContainerStarted","Data":"329094362d553848e78ae99ba581590ff7a2bd07b54ea6506b18e4d0bd5d31c2"}
Jul 15 14:45:27.637437 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:27.637372    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-548d4964b9-rj6qb" podStartSLOduration=1.2513874569999999 podStartE2EDuration="1.637349242s" totalImagesPullingTime="385.961785ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:45:27.635845781 +0000 UTC m=+888.782526537" watchObservedRunningTime="2026-07-15 14:45:27.637349242 +0000 UTC m=+888.784030001"
Jul 15 14:45:27.723869 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:27.723833    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58f5969fb-r62j8"]
Jul 15 14:45:27.724069 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:27.724044    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58f5969fb-r62j8" podUID="6090521c-f80a-4b25-a483-2c647413e036" containerName="authorino" containerID="cri-o://c64cbcaecac0859793a0efd5f269ee6bdd094b2715f42901bc7feb0ea51ee2ad" gracePeriod=30
Jul 15 14:45:27.984703 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:27.984674    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f5969fb-r62j8"
Jul 15 14:45:28.091362 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.091333    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh5bt\" (UniqueName: \"kubernetes.io/projected/6090521c-f80a-4b25-a483-2c647413e036-kube-api-access-sh5bt\") pod \"6090521c-f80a-4b25-a483-2c647413e036\" (UID: \"6090521c-f80a-4b25-a483-2c647413e036\") "
Jul 15 14:45:28.091526 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.091417    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6090521c-f80a-4b25-a483-2c647413e036-tls-cert\") pod \"6090521c-f80a-4b25-a483-2c647413e036\" (UID: \"6090521c-f80a-4b25-a483-2c647413e036\") "
Jul 15 14:45:28.093489 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.093462    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6090521c-f80a-4b25-a483-2c647413e036-kube-api-access-sh5bt" (OuterVolumeSpecName: "kube-api-access-sh5bt") pod "6090521c-f80a-4b25-a483-2c647413e036" (UID: "6090521c-f80a-4b25-a483-2c647413e036"). InnerVolumeSpecName "kube-api-access-sh5bt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:45:28.103946 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.103919    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6090521c-f80a-4b25-a483-2c647413e036-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6090521c-f80a-4b25-a483-2c647413e036" (UID: "6090521c-f80a-4b25-a483-2c647413e036"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:45:28.192351 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.192320    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh5bt\" (UniqueName: \"kubernetes.io/projected/6090521c-f80a-4b25-a483-2c647413e036-kube-api-access-sh5bt\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:45:28.192351 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.192348    2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6090521c-f80a-4b25-a483-2c647413e036-tls-cert\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:45:28.601047 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.600960    2581 generic.go:356] "Generic (PLEG): container finished" podID="6090521c-f80a-4b25-a483-2c647413e036" containerID="c64cbcaecac0859793a0efd5f269ee6bdd094b2715f42901bc7feb0ea51ee2ad" exitCode=0
Jul 15 14:45:28.601047 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.601011    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f5969fb-r62j8"
Jul 15 14:45:28.601047 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.601011    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f5969fb-r62j8" event={"ID":"6090521c-f80a-4b25-a483-2c647413e036","Type":"ContainerDied","Data":"c64cbcaecac0859793a0efd5f269ee6bdd094b2715f42901bc7feb0ea51ee2ad"}
Jul 15 14:45:28.601613 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.601065    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f5969fb-r62j8" event={"ID":"6090521c-f80a-4b25-a483-2c647413e036","Type":"ContainerDied","Data":"9b4489604b9a6bb3200914999a1ff7c586da7a70851b560924d9ddcf23b6d46a"}
Jul 15 14:45:28.601613 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.601087    2581 scope.go:117] "RemoveContainer" containerID="c64cbcaecac0859793a0efd5f269ee6bdd094b2715f42901bc7feb0ea51ee2ad"
Jul 15 14:45:28.610779 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.610761    2581 scope.go:117] "RemoveContainer" containerID="c64cbcaecac0859793a0efd5f269ee6bdd094b2715f42901bc7feb0ea51ee2ad"
Jul 15 14:45:28.611072 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:45:28.611052    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c64cbcaecac0859793a0efd5f269ee6bdd094b2715f42901bc7feb0ea51ee2ad\": container with ID starting with c64cbcaecac0859793a0efd5f269ee6bdd094b2715f42901bc7feb0ea51ee2ad not found: ID does not exist" containerID="c64cbcaecac0859793a0efd5f269ee6bdd094b2715f42901bc7feb0ea51ee2ad"
Jul 15 14:45:28.611188 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.611079    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c64cbcaecac0859793a0efd5f269ee6bdd094b2715f42901bc7feb0ea51ee2ad"} err="failed to get container status \"c64cbcaecac0859793a0efd5f269ee6bdd094b2715f42901bc7feb0ea51ee2ad\": rpc error: code = NotFound desc = could not find container \"c64cbcaecac0859793a0efd5f269ee6bdd094b2715f42901bc7feb0ea51ee2ad\": container with ID starting with c64cbcaecac0859793a0efd5f269ee6bdd094b2715f42901bc7feb0ea51ee2ad not found: ID does not exist"
Jul 15 14:45:28.643779 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.643726    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58f5969fb-r62j8"]
Jul 15 14:45:28.647235 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:28.647209    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58f5969fb-r62j8"]
Jul 15 14:45:29.381278 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:29.381245    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6090521c-f80a-4b25-a483-2c647413e036" path="/var/lib/kubelet/pods/6090521c-f80a-4b25-a483-2c647413e036/volumes"
Jul 15 14:45:39.300444 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:39.300354    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 14:45:39.301047 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:39.301027    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 14:45:39.304820 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:39.304801    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:45:39.305549 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:45:39.305531    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:46:17.127746 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:46:17.127702    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:46:31.306792 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:46:31.306751    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:46:41.910698 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:46:41.910669    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:46:54.304939 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:46:54.304904    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:47:02.431241 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:47:02.431212    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:47:24.606328 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:47:24.606293    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:47:36.117880 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:47:36.117845    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:48:15.334686 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:48:15.334644    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:48:25.013473 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:48:25.013438    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:48:34.049603 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:48:34.049524    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:48:45.797776 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:48:45.797728    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:48:57.400617 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:48:57.400583    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:49:07.002880 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:49:07.002845    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:49:17.308287 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:49:17.308253    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:49:26.797995 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:49:26.797959    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:49:52.413304 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:49:52.413271    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:50:02.425211 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:50:02.425172    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:50:27.202089 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:50:27.202057    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:50:37.498689 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:50:37.498656    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:50:39.334897 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:50:39.334864    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 14:50:39.337721 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:50:39.337694    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 14:50:39.339500 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:50:39.339477    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:50:39.342322 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:50:39.342300    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:50:53.402542 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:50:53.402513    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:51:02.719059 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:51:02.719026    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:51:14.207529 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:51:14.207497    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:51:26.100947 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:51:26.100913    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:53:21.038015 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:53:21.037982    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:53:35.004108 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:53:35.004075    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:53:54.002949 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:53:54.002912    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:54:03.816610 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:54:03.816574    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:54:13.700233 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:54:13.700190    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:54:22.835575 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:54:22.835537    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:54:33.894692 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:54:33.894609    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:54:45.405994 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:54:45.405965    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:54:52.920454 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:54:52.920421    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:55:06.526167 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:55:06.526131    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:55:26.908073 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:55:26.908040    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:55:34.110135 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:55:34.110103    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:55:39.369611 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:55:39.369579    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 14:55:39.374499 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:55:39.374477    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:55:39.376790 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:55:39.376766    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 14:55:39.381799 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:55:39.381782    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 14:55:44.213788 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:55:44.213754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:55:53.802616 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:55:53.802581    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:56:03.329791 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:56:03.329760    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:56:16.406871 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:56:16.406831    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:56:26.338912 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:56:26.338879    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:56:36.018105 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:56:36.018073    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:56:45.497693 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:56:45.497656    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:56:56.001458 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:56:56.001420    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:57:05.692850 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:57:05.692816    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:57:18.003070 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:57:18.003031    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:57:27.207689 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:57:27.207650    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:57:36.904327 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:57:36.904131    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:57:46.414676 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:57:46.414642    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:58:08.515336 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:58:08.515292    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:58:22.691291 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:58:22.691254    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:58:33.602137 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:58:33.602096    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:58:46.192799 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:58:46.192766    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:59:04.476155 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:04.476121    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd"]
Jul 15 14:59:04.476508 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:04.476487    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6090521c-f80a-4b25-a483-2c647413e036" containerName="authorino"
Jul 15 14:59:04.476508 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:04.476497    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6090521c-f80a-4b25-a483-2c647413e036" containerName="authorino"
Jul 15 14:59:04.476578 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:04.476565    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6090521c-f80a-4b25-a483-2c647413e036" containerName="authorino"
Jul 15 14:59:04.479821 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:04.479801    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd"
Jul 15 14:59:04.482875 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:04.482856    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 14:59:04.482994 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:04.482879    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 14:59:04.488575 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:04.488555    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd"]
Jul 15 14:59:04.520360 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:04.520326    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7758938e-ceb3-4a06-ba4c-f033089a8cab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd\" (UID: \"7758938e-ceb3-4a06-ba4c-f033089a8cab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd"
Jul 15 14:59:04.621329 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:04.621298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7758938e-ceb3-4a06-ba4c-f033089a8cab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd\" (UID: \"7758938e-ceb3-4a06-ba4c-f033089a8cab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd"
Jul 15 14:59:04.621965 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:04.621942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7758938e-ceb3-4a06-ba4c-f033089a8cab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd\" (UID: \"7758938e-ceb3-4a06-ba4c-f033089a8cab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd"
Jul 15 14:59:04.791836 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:04.791773    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd"
Jul 15 14:59:04.922947 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:04.922911    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd"]
Jul 15 14:59:04.924780 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:59:04.924751    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7758938e_ceb3_4a06_ba4c_f033089a8cab.slice/crio-65b79ecad67e740c83d41468496e2f121fdba8ad28b2842355361a164dec8d98 WatchSource:0}: Error finding container 65b79ecad67e740c83d41468496e2f121fdba8ad28b2842355361a164dec8d98: Status 404 returned error can't find the container with id 65b79ecad67e740c83d41468496e2f121fdba8ad28b2842355361a164dec8d98
Jul 15 14:59:05.848986 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:05.848900    2581 generic.go:356] "Generic (PLEG): container finished" podID="7758938e-ceb3-4a06-ba4c-f033089a8cab" containerID="6f8755c93df48bd868cf3d6db52598ea150fc6edf2d804ae6a4af1237492e6c6" exitCode=7
Jul 15 14:59:05.849342 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:05.848985    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd" event={"ID":"7758938e-ceb3-4a06-ba4c-f033089a8cab","Type":"ContainerDied","Data":"6f8755c93df48bd868cf3d6db52598ea150fc6edf2d804ae6a4af1237492e6c6"}
Jul 15 14:59:05.849342 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:05.849070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd" event={"ID":"7758938e-ceb3-4a06-ba4c-f033089a8cab","Type":"ContainerStarted","Data":"65b79ecad67e740c83d41468496e2f121fdba8ad28b2842355361a164dec8d98"}
Jul 15 14:59:05.849342 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:05.849112    2581 scope.go:117] "RemoveContainer" containerID="6f8755c93df48bd868cf3d6db52598ea150fc6edf2d804ae6a4af1237492e6c6"
Jul 15 14:59:06.856774 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:06.856666    2581 generic.go:356] "Generic (PLEG): container finished" podID="7758938e-ceb3-4a06-ba4c-f033089a8cab" containerID="ca39b9de6de928fdf2919b9ec0cde166ca712634be787b8bcf49b9cef42cda1b" exitCode=7
Jul 15 14:59:06.857140 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:06.856765    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd" event={"ID":"7758938e-ceb3-4a06-ba4c-f033089a8cab","Type":"ContainerDied","Data":"ca39b9de6de928fdf2919b9ec0cde166ca712634be787b8bcf49b9cef42cda1b"}
Jul 15 14:59:06.857140 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:06.856822    2581 scope.go:117] "RemoveContainer" containerID="6f8755c93df48bd868cf3d6db52598ea150fc6edf2d804ae6a4af1237492e6c6"
Jul 15 14:59:06.857140 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:06.857041    2581 scope.go:117] "RemoveContainer" containerID="ca39b9de6de928fdf2919b9ec0cde166ca712634be787b8bcf49b9cef42cda1b"
Jul 15 14:59:06.857289 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:59:06.857261    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd_odh-ai-gateway-infra(7758938e-ceb3-4a06-ba4c-f033089a8cab)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd" podUID="7758938e-ceb3-4a06-ba4c-f033089a8cab"
Jul 15 14:59:07.863827 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:07.863799    2581 scope.go:117] "RemoveContainer" containerID="ca39b9de6de928fdf2919b9ec0cde166ca712634be787b8bcf49b9cef42cda1b"
Jul 15 14:59:07.864202 ip-10-0-131-157 kubenswrapper[2581]: E0715 14:59:07.863977    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd_odh-ai-gateway-infra(7758938e-ceb3-4a06-ba4c-f033089a8cab)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd" podUID="7758938e-ceb3-4a06-ba4c-f033089a8cab"
Jul 15 14:59:08.103913 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:08.103878    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 14:59:20.375182 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:20.375153    2581 scope.go:117] "RemoveContainer" containerID="ca39b9de6de928fdf2919b9ec0cde166ca712634be787b8bcf49b9cef42cda1b"
Jul 15 14:59:20.942521 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:20.942493    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd" event={"ID":"7758938e-ceb3-4a06-ba4c-f033089a8cab","Type":"ContainerStarted","Data":"26e8e4c734ff71ecdb9ad9c4e3d7b1c25d3e4d33cbb115563c9918b45674dfef"}
Jul 15 14:59:20.961779 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:20.961720    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd" podStartSLOduration=16.961706885 podStartE2EDuration="16.961706885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:59:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:59:20.959211099 +0000 UTC m=+1722.105891856" watchObservedRunningTime="2026-07-15 14:59:20.961706885 +0000 UTC m=+1722.108387644"
Jul 15 14:59:21.949677 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:21.949647    2581 generic.go:356] "Generic (PLEG): container finished" podID="7758938e-ceb3-4a06-ba4c-f033089a8cab" containerID="26e8e4c734ff71ecdb9ad9c4e3d7b1c25d3e4d33cbb115563c9918b45674dfef" exitCode=0
Jul 15 14:59:21.950082 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:21.949703    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd" event={"ID":"7758938e-ceb3-4a06-ba4c-f033089a8cab","Type":"ContainerDied","Data":"26e8e4c734ff71ecdb9ad9c4e3d7b1c25d3e4d33cbb115563c9918b45674dfef"}
Jul 15 14:59:21.950082 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:21.949764    2581 scope.go:117] "RemoveContainer" containerID="ca39b9de6de928fdf2919b9ec0cde166ca712634be787b8bcf49b9cef42cda1b"
Jul 15 14:59:21.970578 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:21.970553    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd"]
Jul 15 14:59:23.091782 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:23.091756    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd"
Jul 15 14:59:23.159977 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:23.159952    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7758938e-ceb3-4a06-ba4c-f033089a8cab-maas-api-service-ca\") pod \"7758938e-ceb3-4a06-ba4c-f033089a8cab\" (UID: \"7758938e-ceb3-4a06-ba4c-f033089a8cab\") "
Jul 15 14:59:23.160282 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:23.160261    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7758938e-ceb3-4a06-ba4c-f033089a8cab-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7758938e-ceb3-4a06-ba4c-f033089a8cab" (UID: "7758938e-ceb3-4a06-ba4c-f033089a8cab"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:59:23.261615 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:23.261550    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7758938e-ceb3-4a06-ba4c-f033089a8cab-maas-api-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:59:23.961921 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:23.961894    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd"
Jul 15 14:59:23.962109 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:23.961936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd" event={"ID":"7758938e-ceb3-4a06-ba4c-f033089a8cab","Type":"ContainerDied","Data":"65b79ecad67e740c83d41468496e2f121fdba8ad28b2842355361a164dec8d98"}
Jul 15 14:59:23.962109 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:23.961990    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65b79ecad67e740c83d41468496e2f121fdba8ad28b2842355361a164dec8d98"
Jul 15 14:59:23.992945 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:23.992916    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd"]
Jul 15 14:59:23.999228 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:23.999208    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-7lvhd"]
Jul 15 14:59:25.379827 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:25.379794    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7758938e-ceb3-4a06-ba4c-f033089a8cab" path="/var/lib/kubelet/pods/7758938e-ceb3-4a06-ba4c-f033089a8cab/volumes"
Jul 15 14:59:54.523895 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.523865    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp"]
Jul 15 14:59:54.524352 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.524212    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7758938e-ceb3-4a06-ba4c-f033089a8cab" containerName="revoke-keys"
Jul 15 14:59:54.524352 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.524222    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7758938e-ceb3-4a06-ba4c-f033089a8cab" containerName="revoke-keys"
Jul 15 14:59:54.524352 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.524241    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7758938e-ceb3-4a06-ba4c-f033089a8cab" containerName="revoke-keys"
Jul 15 14:59:54.524352 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.524247    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7758938e-ceb3-4a06-ba4c-f033089a8cab" containerName="revoke-keys"
Jul 15 14:59:54.524352 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.524253    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7758938e-ceb3-4a06-ba4c-f033089a8cab" containerName="revoke-keys"
Jul 15 14:59:54.524352 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.524259    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7758938e-ceb3-4a06-ba4c-f033089a8cab" containerName="revoke-keys"
Jul 15 14:59:54.524352 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.524311    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7758938e-ceb3-4a06-ba4c-f033089a8cab" containerName="revoke-keys"
Jul 15 14:59:54.524352 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.524319    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7758938e-ceb3-4a06-ba4c-f033089a8cab" containerName="revoke-keys"
Jul 15 14:59:54.527388 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.527371    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp"
Jul 15 14:59:54.530547 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.530527    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 14:59:54.531697 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.531682    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 14:59:54.536556 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.536533    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp"]
Jul 15 14:59:54.617071 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.617044    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c60ce0b-8d6b-4ece-84a2-8c71d6023732-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp\" (UID: \"2c60ce0b-8d6b-4ece-84a2-8c71d6023732\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp"
Jul 15 14:59:54.717704 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.717674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c60ce0b-8d6b-4ece-84a2-8c71d6023732-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp\" (UID: \"2c60ce0b-8d6b-4ece-84a2-8c71d6023732\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp"
Jul 15 14:59:54.718341 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.718321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c60ce0b-8d6b-4ece-84a2-8c71d6023732-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp\" (UID: \"2c60ce0b-8d6b-4ece-84a2-8c71d6023732\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp"
Jul 15 14:59:54.838556 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.838486    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp"
Jul 15 14:59:54.972515 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:54.972472    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp"]
Jul 15 14:59:54.973633 ip-10-0-131-157 kubenswrapper[2581]: W0715 14:59:54.973601    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c60ce0b_8d6b_4ece_84a2_8c71d6023732.slice/crio-7d18b1d02be582dba222d4f04966881d5e547e89fdcbd9365a5ebc38bbc2ef5f WatchSource:0}: Error finding container 7d18b1d02be582dba222d4f04966881d5e547e89fdcbd9365a5ebc38bbc2ef5f: Status 404 returned error can't find the container with id 7d18b1d02be582dba222d4f04966881d5e547e89fdcbd9365a5ebc38bbc2ef5f
Jul 15 14:59:55.120076 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:55.120011    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp" event={"ID":"2c60ce0b-8d6b-4ece-84a2-8c71d6023732","Type":"ContainerStarted","Data":"7d18b1d02be582dba222d4f04966881d5e547e89fdcbd9365a5ebc38bbc2ef5f"}
Jul 15 14:59:56.126931 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:56.126891    2581 generic.go:356] "Generic (PLEG): container finished" podID="2c60ce0b-8d6b-4ece-84a2-8c71d6023732" containerID="e0ceb7871af62ef8e15675a6b8ed0ba5844fb40b36da1c018d2bda957934b9fb" exitCode=0
Jul 15 14:59:56.127299 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:56.126981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp" event={"ID":"2c60ce0b-8d6b-4ece-84a2-8c71d6023732","Type":"ContainerDied","Data":"e0ceb7871af62ef8e15675a6b8ed0ba5844fb40b36da1c018d2bda957934b9fb"}
Jul 15 14:59:57.258689 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:57.258667    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp"
Jul 15 14:59:57.339877 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:57.339850    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c60ce0b-8d6b-4ece-84a2-8c71d6023732-maas-api-service-ca\") pod \"2c60ce0b-8d6b-4ece-84a2-8c71d6023732\" (UID: \"2c60ce0b-8d6b-4ece-84a2-8c71d6023732\") "
Jul 15 14:59:57.340213 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:57.340189    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c60ce0b-8d6b-4ece-84a2-8c71d6023732-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2c60ce0b-8d6b-4ece-84a2-8c71d6023732" (UID: "2c60ce0b-8d6b-4ece-84a2-8c71d6023732"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:59:57.440792 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:57.440771    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c60ce0b-8d6b-4ece-84a2-8c71d6023732-maas-api-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 14:59:58.139264 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:58.139235    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp"
Jul 15 14:59:58.139452 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:58.139276    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp" event={"ID":"2c60ce0b-8d6b-4ece-84a2-8c71d6023732","Type":"ContainerDied","Data":"7d18b1d02be582dba222d4f04966881d5e547e89fdcbd9365a5ebc38bbc2ef5f"}
Jul 15 14:59:58.139452 ip-10-0-131-157 kubenswrapper[2581]: I0715 14:59:58.139322    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d18b1d02be582dba222d4f04966881d5e547e89fdcbd9365a5ebc38bbc2ef5f"
Jul 15 15:00:00.149822 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:00.149781    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735460-tstd9"]
Jul 15 15:00:00.150330 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:00.150310    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c60ce0b-8d6b-4ece-84a2-8c71d6023732" containerName="revoke-keys"
Jul 15 15:00:00.150427 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:00.150334    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c60ce0b-8d6b-4ece-84a2-8c71d6023732" containerName="revoke-keys"
Jul 15 15:00:00.150486 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:00.150461    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7758938e-ceb3-4a06-ba4c-f033089a8cab" containerName="revoke-keys"
Jul 15 15:00:00.150486 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:00.150477    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c60ce0b-8d6b-4ece-84a2-8c71d6023732" containerName="revoke-keys"
Jul 15 15:00:00.153574 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:00.153552    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735460-tstd9"
Jul 15 15:00:00.157218 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:00.157194    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:00:00.163990 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:00.163969    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735460-tstd9"]
Jul 15 15:00:00.164132 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:00.164117    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735460-tstd9"
Jul 15 15:00:00.305814 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:00.305786    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735460-tstd9"]
Jul 15 15:00:00.305981 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:00:00.305958    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3b78c8_d17b_4139_8580_0735d66fb605.slice/crio-5e72cd3bb99d60e4f8ece5b90c59ce52e0238978322ff889e862b041cd985360 WatchSource:0}: Error finding container 5e72cd3bb99d60e4f8ece5b90c59ce52e0238978322ff889e862b041cd985360: Status 404 returned error can't find the container with id 5e72cd3bb99d60e4f8ece5b90c59ce52e0238978322ff889e862b041cd985360
Jul 15 15:00:01.156869 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:01.156830    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735460-tstd9" event={"ID":"4b3b78c8-d17b-4139-8580-0735d66fb605","Type":"ContainerStarted","Data":"c8df02553aa50a9d7a9c92d31bdcaea34a3cec330071c554692c969ec90669a5"}
Jul 15 15:00:01.157331 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:01.156966    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735460-tstd9" event={"ID":"4b3b78c8-d17b-4139-8580-0735d66fb605","Type":"ContainerStarted","Data":"5e72cd3bb99d60e4f8ece5b90c59ce52e0238978322ff889e862b041cd985360"}
Jul 15 15:00:01.180552 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:01.180504    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735460-tstd9" podStartSLOduration=1.180490246 podStartE2EDuration="1.180490246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:00:01.180203752 +0000 UTC m=+1762.326884510" watchObservedRunningTime="2026-07-15 15:00:01.180490246 +0000 UTC m=+1762.327171001"
Jul 15 15:00:02.163753 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:02.163695    2581 generic.go:356] "Generic (PLEG): container finished" podID="4b3b78c8-d17b-4139-8580-0735d66fb605" containerID="c8df02553aa50a9d7a9c92d31bdcaea34a3cec330071c554692c969ec90669a5" exitCode=0
Jul 15 15:00:02.164136 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:02.163771    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735460-tstd9" event={"ID":"4b3b78c8-d17b-4139-8580-0735d66fb605","Type":"ContainerDied","Data":"c8df02553aa50a9d7a9c92d31bdcaea34a3cec330071c554692c969ec90669a5"}
Jul 15 15:00:03.296232 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:03.296208    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735460-tstd9"
Jul 15 15:00:04.176113 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:04.176074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735460-tstd9" event={"ID":"4b3b78c8-d17b-4139-8580-0735d66fb605","Type":"ContainerDied","Data":"5e72cd3bb99d60e4f8ece5b90c59ce52e0238978322ff889e862b041cd985360"}
Jul 15 15:00:04.176113 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:04.176100    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735460-tstd9"
Jul 15 15:00:04.176375 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:04.176158    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e72cd3bb99d60e4f8ece5b90c59ce52e0238978322ff889e862b041cd985360"
Jul 15 15:00:08.110753 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:08.110698    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:00:26.183483 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:26.183449    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch"]
Jul 15 15:00:26.183960 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:26.183829    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b3b78c8-d17b-4139-8580-0735d66fb605" containerName="cleanup"
Jul 15 15:00:26.183960 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:26.183842    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b3b78c8-d17b-4139-8580-0735d66fb605" containerName="cleanup"
Jul 15 15:00:26.183960 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:26.183901    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b3b78c8-d17b-4139-8580-0735d66fb605" containerName="cleanup"
Jul 15 15:00:26.186832 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:26.186816    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch"
Jul 15 15:00:26.189677 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:26.189658    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:00:26.189677 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:26.189672    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:00:26.199240 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:26.199209    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch"]
Jul 15 15:00:26.282650 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:26.282620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/913ae3f0-d7d3-43b5-9590-c8da5e1add76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch\" (UID: \"913ae3f0-d7d3-43b5-9590-c8da5e1add76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch"
Jul 15 15:00:26.383406 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:26.383381    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/913ae3f0-d7d3-43b5-9590-c8da5e1add76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch\" (UID: \"913ae3f0-d7d3-43b5-9590-c8da5e1add76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch"
Jul 15 15:00:26.383970 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:26.383951    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/913ae3f0-d7d3-43b5-9590-c8da5e1add76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch\" (UID: \"913ae3f0-d7d3-43b5-9590-c8da5e1add76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch"
Jul 15 15:00:26.499450 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:26.499388    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch"
Jul 15 15:00:26.635903 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:26.635876    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch"]
Jul 15 15:00:26.637707 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:00:26.637676    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913ae3f0_d7d3_43b5_9590_c8da5e1add76.slice/crio-78bfa026947fa73084f2ca0523d58a5339ec465749b2fc170fb498efc20691b2 WatchSource:0}: Error finding container 78bfa026947fa73084f2ca0523d58a5339ec465749b2fc170fb498efc20691b2: Status 404 returned error can't find the container with id 78bfa026947fa73084f2ca0523d58a5339ec465749b2fc170fb498efc20691b2
Jul 15 15:00:27.295795 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:27.295763    2581 generic.go:356] "Generic (PLEG): container finished" podID="913ae3f0-d7d3-43b5-9590-c8da5e1add76" containerID="9ea2cd91390e7c07bd3a903823f6e3dfddcfcc8fda3f11cf37f3af625506b827" exitCode=7
Jul 15 15:00:27.296097 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:27.295800    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch" event={"ID":"913ae3f0-d7d3-43b5-9590-c8da5e1add76","Type":"ContainerDied","Data":"9ea2cd91390e7c07bd3a903823f6e3dfddcfcc8fda3f11cf37f3af625506b827"}
Jul 15 15:00:27.296097 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:27.295849    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch" event={"ID":"913ae3f0-d7d3-43b5-9590-c8da5e1add76","Type":"ContainerStarted","Data":"78bfa026947fa73084f2ca0523d58a5339ec465749b2fc170fb498efc20691b2"}
Jul 15 15:00:27.296097 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:27.296033    2581 scope.go:117] "RemoveContainer" containerID="9ea2cd91390e7c07bd3a903823f6e3dfddcfcc8fda3f11cf37f3af625506b827"
Jul 15 15:00:28.303422 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:28.303387    2581 generic.go:356] "Generic (PLEG): container finished" podID="913ae3f0-d7d3-43b5-9590-c8da5e1add76" containerID="a89ba47f24f65a8cbb12ab5bd38ebb46db7417a2e4bc49fd4df8b1091fbe7bd9" exitCode=7
Jul 15 15:00:28.303904 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:28.303471    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch" event={"ID":"913ae3f0-d7d3-43b5-9590-c8da5e1add76","Type":"ContainerDied","Data":"a89ba47f24f65a8cbb12ab5bd38ebb46db7417a2e4bc49fd4df8b1091fbe7bd9"}
Jul 15 15:00:28.303904 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:28.303540    2581 scope.go:117] "RemoveContainer" containerID="9ea2cd91390e7c07bd3a903823f6e3dfddcfcc8fda3f11cf37f3af625506b827"
Jul 15 15:00:28.303904 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:28.303686    2581 scope.go:117] "RemoveContainer" containerID="a89ba47f24f65a8cbb12ab5bd38ebb46db7417a2e4bc49fd4df8b1091fbe7bd9"
Jul 15 15:00:28.303904 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:00:28.303891    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch_odh-ai-gateway-infra(913ae3f0-d7d3-43b5-9590-c8da5e1add76)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch" podUID="913ae3f0-d7d3-43b5-9590-c8da5e1add76"
Jul 15 15:00:29.311682 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:29.311656    2581 scope.go:117] "RemoveContainer" containerID="a89ba47f24f65a8cbb12ab5bd38ebb46db7417a2e4bc49fd4df8b1091fbe7bd9"
Jul 15 15:00:29.312092 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:00:29.311825    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch_odh-ai-gateway-infra(913ae3f0-d7d3-43b5-9590-c8da5e1add76)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch" podUID="913ae3f0-d7d3-43b5-9590-c8da5e1add76"
Jul 15 15:00:29.894477 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:29.894443    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:00:39.409008 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:39.408978    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 15:00:39.413703 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:39.413683    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 15:00:39.415783 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:39.415765    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 15:00:39.420085 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:39.420066    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 15:00:41.375637 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:41.375607    2581 scope.go:117] "RemoveContainer" containerID="a89ba47f24f65a8cbb12ab5bd38ebb46db7417a2e4bc49fd4df8b1091fbe7bd9"
Jul 15 15:00:42.384315 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:42.384237    2581 generic.go:356] "Generic (PLEG): container finished" podID="913ae3f0-d7d3-43b5-9590-c8da5e1add76" containerID="c810abde1e38fc45b1135ceabe43592b0986439413c67fc063e3b86d6afe43c9" exitCode=0
Jul 15 15:00:42.384681 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:42.384305    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch" event={"ID":"913ae3f0-d7d3-43b5-9590-c8da5e1add76","Type":"ContainerDied","Data":"c810abde1e38fc45b1135ceabe43592b0986439413c67fc063e3b86d6afe43c9"}
Jul 15 15:00:42.384681 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:42.384389    2581 scope.go:117] "RemoveContainer" containerID="a89ba47f24f65a8cbb12ab5bd38ebb46db7417a2e4bc49fd4df8b1091fbe7bd9"
Jul 15 15:00:43.414331 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:43.414294    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch"]
Jul 15 15:00:43.523113 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:43.523093    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch"
Jul 15 15:00:43.626823 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:43.626797    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/913ae3f0-d7d3-43b5-9590-c8da5e1add76-maas-api-service-ca\") pod \"913ae3f0-d7d3-43b5-9590-c8da5e1add76\" (UID: \"913ae3f0-d7d3-43b5-9590-c8da5e1add76\") "
Jul 15 15:00:43.627165 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:43.627143    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/913ae3f0-d7d3-43b5-9590-c8da5e1add76-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "913ae3f0-d7d3-43b5-9590-c8da5e1add76" (UID: "913ae3f0-d7d3-43b5-9590-c8da5e1add76"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:00:43.728416 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:43.728392    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/913ae3f0-d7d3-43b5-9590-c8da5e1add76-maas-api-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:00:44.396654 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:44.396625    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch"
Jul 15 15:00:44.396871 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:44.396676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch" event={"ID":"913ae3f0-d7d3-43b5-9590-c8da5e1add76","Type":"ContainerDied","Data":"78bfa026947fa73084f2ca0523d58a5339ec465749b2fc170fb498efc20691b2"}
Jul 15 15:00:44.396871 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:44.396720    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78bfa026947fa73084f2ca0523d58a5339ec465749b2fc170fb498efc20691b2"
Jul 15 15:00:44.435022 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:44.434995    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch"]
Jul 15 15:00:44.437904 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:44.437881    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pfrch"]
Jul 15 15:00:45.379970 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:00:45.379935    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="913ae3f0-d7d3-43b5-9590-c8da5e1add76" path="/var/lib/kubelet/pods/913ae3f0-d7d3-43b5-9590-c8da5e1add76/volumes"
Jul 15 15:01:16.224809 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.224774    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr"]
Jul 15 15:01:16.225264 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.225123    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="913ae3f0-d7d3-43b5-9590-c8da5e1add76" containerName="revoke-keys"
Jul 15 15:01:16.225264 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.225138    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="913ae3f0-d7d3-43b5-9590-c8da5e1add76" containerName="revoke-keys"
Jul 15 15:01:16.225264 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.225150    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="913ae3f0-d7d3-43b5-9590-c8da5e1add76" containerName="revoke-keys"
Jul 15 15:01:16.225264 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.225155    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="913ae3f0-d7d3-43b5-9590-c8da5e1add76" containerName="revoke-keys"
Jul 15 15:01:16.225264 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.225256    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="913ae3f0-d7d3-43b5-9590-c8da5e1add76" containerName="revoke-keys"
Jul 15 15:01:16.225264 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.225264    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="913ae3f0-d7d3-43b5-9590-c8da5e1add76" containerName="revoke-keys"
Jul 15 15:01:16.228333 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.228316    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr"
Jul 15 15:01:16.231300 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.231271    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:01:16.231300 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.231282    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:01:16.236952 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.236930    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr"]
Jul 15 15:01:16.280460 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.280426    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f1756c5-dcdb-4754-8563-26173161007e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr\" (UID: \"3f1756c5-dcdb-4754-8563-26173161007e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr"
Jul 15 15:01:16.381190 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.381164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f1756c5-dcdb-4754-8563-26173161007e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr\" (UID: \"3f1756c5-dcdb-4754-8563-26173161007e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr"
Jul 15 15:01:16.381704 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.381688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f1756c5-dcdb-4754-8563-26173161007e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr\" (UID: \"3f1756c5-dcdb-4754-8563-26173161007e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr"
Jul 15 15:01:16.540194 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.540136    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr"
Jul 15 15:01:16.674330 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:16.674307    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr"]
Jul 15 15:01:16.676090 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:01:16.676065    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f1756c5_dcdb_4754_8563_26173161007e.slice/crio-9f155823a7f178a692b2c109005926f125158e84442fbdce7dc2d0107d30a790 WatchSource:0}: Error finding container 9f155823a7f178a692b2c109005926f125158e84442fbdce7dc2d0107d30a790: Status 404 returned error can't find the container with id 9f155823a7f178a692b2c109005926f125158e84442fbdce7dc2d0107d30a790
Jul 15 15:01:17.567013 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:17.566982    2581 generic.go:356] "Generic (PLEG): container finished" podID="3f1756c5-dcdb-4754-8563-26173161007e" containerID="3910196f6ebf1cc48954fce705c3431a56da778beff9382fb49878590f883d4e" exitCode=0
Jul 15 15:01:17.567352 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:17.567066    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr" event={"ID":"3f1756c5-dcdb-4754-8563-26173161007e","Type":"ContainerDied","Data":"3910196f6ebf1cc48954fce705c3431a56da778beff9382fb49878590f883d4e"}
Jul 15 15:01:17.567352 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:17.567121    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr" event={"ID":"3f1756c5-dcdb-4754-8563-26173161007e","Type":"ContainerStarted","Data":"9f155823a7f178a692b2c109005926f125158e84442fbdce7dc2d0107d30a790"}
Jul 15 15:01:18.699255 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:18.699230    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr"
Jul 15 15:01:18.800787 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:18.800755    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f1756c5-dcdb-4754-8563-26173161007e-maas-api-service-ca\") pod \"3f1756c5-dcdb-4754-8563-26173161007e\" (UID: \"3f1756c5-dcdb-4754-8563-26173161007e\") "
Jul 15 15:01:18.801005 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:18.800985    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1756c5-dcdb-4754-8563-26173161007e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3f1756c5-dcdb-4754-8563-26173161007e" (UID: "3f1756c5-dcdb-4754-8563-26173161007e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:01:18.901977 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:18.901914    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f1756c5-dcdb-4754-8563-26173161007e-maas-api-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:01:19.578583 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:19.578560    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr"
Jul 15 15:01:19.578784 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:19.578603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr" event={"ID":"3f1756c5-dcdb-4754-8563-26173161007e","Type":"ContainerDied","Data":"9f155823a7f178a692b2c109005926f125158e84442fbdce7dc2d0107d30a790"}
Jul 15 15:01:19.578784 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:19.578652    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f155823a7f178a692b2c109005926f125158e84442fbdce7dc2d0107d30a790"
Jul 15 15:01:29.400204 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:29.400167    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:01:38.503318 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:38.503280    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:01:39.226850 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.226816    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9"]
Jul 15 15:01:39.227188 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.227175    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="913ae3f0-d7d3-43b5-9590-c8da5e1add76" containerName="revoke-keys"
Jul 15 15:01:39.227232 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.227189    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="913ae3f0-d7d3-43b5-9590-c8da5e1add76" containerName="revoke-keys"
Jul 15 15:01:39.227232 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.227201    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1756c5-dcdb-4754-8563-26173161007e" containerName="revoke-keys"
Jul 15 15:01:39.227232 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.227206    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1756c5-dcdb-4754-8563-26173161007e" containerName="revoke-keys"
Jul 15 15:01:39.227334 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.227257    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="913ae3f0-d7d3-43b5-9590-c8da5e1add76" containerName="revoke-keys"
Jul 15 15:01:39.227334 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.227268    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f1756c5-dcdb-4754-8563-26173161007e" containerName="revoke-keys"
Jul 15 15:01:39.234487 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.234470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9"
Jul 15 15:01:39.243570 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.243552    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:01:39.245760 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.244226    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:01:39.253666 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.253641    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9"]
Jul 15 15:01:39.364958 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.364927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3757228-cca8-46f4-bd16-3a8ec105c85c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9\" (UID: \"a3757228-cca8-46f4-bd16-3a8ec105c85c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9"
Jul 15 15:01:39.465477 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.465450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3757228-cca8-46f4-bd16-3a8ec105c85c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9\" (UID: \"a3757228-cca8-46f4-bd16-3a8ec105c85c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9"
Jul 15 15:01:39.466076 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.466052    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3757228-cca8-46f4-bd16-3a8ec105c85c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9\" (UID: \"a3757228-cca8-46f4-bd16-3a8ec105c85c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9"
Jul 15 15:01:39.545377 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.545321    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9"
Jul 15 15:01:39.677494 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:39.677468    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9"]
Jul 15 15:01:39.679289 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:01:39.679255    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3757228_cca8_46f4_bd16_3a8ec105c85c.slice/crio-a8ad146ccb2f42bc1acec57bca4787696c2d94a39bf1a24a2cdc4b17143a1c27 WatchSource:0}: Error finding container a8ad146ccb2f42bc1acec57bca4787696c2d94a39bf1a24a2cdc4b17143a1c27: Status 404 returned error can't find the container with id a8ad146ccb2f42bc1acec57bca4787696c2d94a39bf1a24a2cdc4b17143a1c27
Jul 15 15:01:40.690342 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:40.690307    2581 generic.go:356] "Generic (PLEG): container finished" podID="a3757228-cca8-46f4-bd16-3a8ec105c85c" containerID="d5330695a1c39e40e02a078424741f2c32a4b9cc4b1b68bbe97ff68540612e75" exitCode=7
Jul 15 15:01:40.690699 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:40.690390    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9" event={"ID":"a3757228-cca8-46f4-bd16-3a8ec105c85c","Type":"ContainerDied","Data":"d5330695a1c39e40e02a078424741f2c32a4b9cc4b1b68bbe97ff68540612e75"}
Jul 15 15:01:40.690699 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:40.690448    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9" event={"ID":"a3757228-cca8-46f4-bd16-3a8ec105c85c","Type":"ContainerStarted","Data":"a8ad146ccb2f42bc1acec57bca4787696c2d94a39bf1a24a2cdc4b17143a1c27"}
Jul 15 15:01:40.690699 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:40.690535    2581 scope.go:117] "RemoveContainer" containerID="d5330695a1c39e40e02a078424741f2c32a4b9cc4b1b68bbe97ff68540612e75"
Jul 15 15:01:41.697725 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:41.697692    2581 generic.go:356] "Generic (PLEG): container finished" podID="a3757228-cca8-46f4-bd16-3a8ec105c85c" containerID="096f35da7c8ff69131f456f9017b43bf15d40b8c2945213d858fb74c2db0fe92" exitCode=7
Jul 15 15:01:41.698143 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:41.697763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9" event={"ID":"a3757228-cca8-46f4-bd16-3a8ec105c85c","Type":"ContainerDied","Data":"096f35da7c8ff69131f456f9017b43bf15d40b8c2945213d858fb74c2db0fe92"}
Jul 15 15:01:41.698143 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:41.697824    2581 scope.go:117] "RemoveContainer" containerID="d5330695a1c39e40e02a078424741f2c32a4b9cc4b1b68bbe97ff68540612e75"
Jul 15 15:01:41.698143 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:41.698032    2581 scope.go:117] "RemoveContainer" containerID="096f35da7c8ff69131f456f9017b43bf15d40b8c2945213d858fb74c2db0fe92"
Jul 15 15:01:41.698310 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:01:41.698277    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9_odh-ai-gateway-infra(a3757228-cca8-46f4-bd16-3a8ec105c85c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9" podUID="a3757228-cca8-46f4-bd16-3a8ec105c85c"
Jul 15 15:01:42.704861 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:42.704837    2581 scope.go:117] "RemoveContainer" containerID="096f35da7c8ff69131f456f9017b43bf15d40b8c2945213d858fb74c2db0fe92"
Jul 15 15:01:42.705223 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:01:42.705016    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9_odh-ai-gateway-infra(a3757228-cca8-46f4-bd16-3a8ec105c85c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9" podUID="a3757228-cca8-46f4-bd16-3a8ec105c85c"
Jul 15 15:01:57.375220 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:57.375192    2581 scope.go:117] "RemoveContainer" containerID="096f35da7c8ff69131f456f9017b43bf15d40b8c2945213d858fb74c2db0fe92"
Jul 15 15:01:57.786377 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:57.786342    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9" event={"ID":"a3757228-cca8-46f4-bd16-3a8ec105c85c","Type":"ContainerStarted","Data":"78e4af2d272beb3eb7d34edbb5c9076541094be2c4cb126d880ee6b12d5757dc"}
Jul 15 15:01:57.803714 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:57.803673    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9" podStartSLOduration=18.803660805 podStartE2EDuration="18.803660805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:01:57.802634414 +0000 UTC m=+1878.949315170" watchObservedRunningTime="2026-07-15 15:01:57.803660805 +0000 UTC m=+1878.950341560"
Jul 15 15:01:58.793529 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:58.793499    2581 generic.go:356] "Generic (PLEG): container finished" podID="a3757228-cca8-46f4-bd16-3a8ec105c85c" containerID="78e4af2d272beb3eb7d34edbb5c9076541094be2c4cb126d880ee6b12d5757dc" exitCode=0
Jul 15 15:01:58.793943 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:58.793570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9" event={"ID":"a3757228-cca8-46f4-bd16-3a8ec105c85c","Type":"ContainerDied","Data":"78e4af2d272beb3eb7d34edbb5c9076541094be2c4cb126d880ee6b12d5757dc"}
Jul 15 15:01:58.793943 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:58.793633    2581 scope.go:117] "RemoveContainer" containerID="096f35da7c8ff69131f456f9017b43bf15d40b8c2945213d858fb74c2db0fe92"
Jul 15 15:01:58.821226 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:58.821185    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9"]
Jul 15 15:01:59.936676 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:01:59.936650    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9"
Jul 15 15:02:00.026836 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:00.026787    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3757228-cca8-46f4-bd16-3a8ec105c85c-maas-api-service-ca\") pod \"a3757228-cca8-46f4-bd16-3a8ec105c85c\" (UID: \"a3757228-cca8-46f4-bd16-3a8ec105c85c\") "
Jul 15 15:02:00.027183 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:00.027162    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3757228-cca8-46f4-bd16-3a8ec105c85c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a3757228-cca8-46f4-bd16-3a8ec105c85c" (UID: "a3757228-cca8-46f4-bd16-3a8ec105c85c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:02:00.128091 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:00.127999    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3757228-cca8-46f4-bd16-3a8ec105c85c-maas-api-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:02:00.806817 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:00.806789    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9"
Jul 15 15:02:00.807064 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:00.806815    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9" event={"ID":"a3757228-cca8-46f4-bd16-3a8ec105c85c","Type":"ContainerDied","Data":"a8ad146ccb2f42bc1acec57bca4787696c2d94a39bf1a24a2cdc4b17143a1c27"}
Jul 15 15:02:00.807064 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:00.806856    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8ad146ccb2f42bc1acec57bca4787696c2d94a39bf1a24a2cdc4b17143a1c27"
Jul 15 15:02:00.842021 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:00.841991    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9"]
Jul 15 15:02:00.848529 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:00.848506    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-9rvb9"]
Jul 15 15:02:01.380141 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:01.380110    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3757228-cca8-46f4-bd16-3a8ec105c85c" path="/var/lib/kubelet/pods/a3757228-cca8-46f4-bd16-3a8ec105c85c/volumes"
Jul 15 15:02:39.234750 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.234709    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz"]
Jul 15 15:02:39.237073 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.235083    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3757228-cca8-46f4-bd16-3a8ec105c85c" containerName="revoke-keys"
Jul 15 15:02:39.237073 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.235095    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3757228-cca8-46f4-bd16-3a8ec105c85c" containerName="revoke-keys"
Jul 15 15:02:39.237073 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.235102    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3757228-cca8-46f4-bd16-3a8ec105c85c" containerName="revoke-keys"
Jul 15 15:02:39.237073 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.235108    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3757228-cca8-46f4-bd16-3a8ec105c85c" containerName="revoke-keys"
Jul 15 15:02:39.237073 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.235128    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3757228-cca8-46f4-bd16-3a8ec105c85c" containerName="revoke-keys"
Jul 15 15:02:39.237073 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.235135    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3757228-cca8-46f4-bd16-3a8ec105c85c" containerName="revoke-keys"
Jul 15 15:02:39.237073 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.235189    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3757228-cca8-46f4-bd16-3a8ec105c85c" containerName="revoke-keys"
Jul 15 15:02:39.237073 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.235200    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3757228-cca8-46f4-bd16-3a8ec105c85c" containerName="revoke-keys"
Jul 15 15:02:39.237073 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.235205    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3757228-cca8-46f4-bd16-3a8ec105c85c" containerName="revoke-keys"
Jul 15 15:02:39.238040 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.238025    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz"
Jul 15 15:02:39.240773 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.240724    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:02:39.240773 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.240772    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:02:39.245840 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.245717    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz"]
Jul 15 15:02:39.323663 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.323634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d101c08-abd1-4186-85ac-d053f5e17fa3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz\" (UID: \"2d101c08-abd1-4186-85ac-d053f5e17fa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz"
Jul 15 15:02:39.424939 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.424910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d101c08-abd1-4186-85ac-d053f5e17fa3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz\" (UID: \"2d101c08-abd1-4186-85ac-d053f5e17fa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz"
Jul 15 15:02:39.425470 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.425452    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d101c08-abd1-4186-85ac-d053f5e17fa3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz\" (UID: \"2d101c08-abd1-4186-85ac-d053f5e17fa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz"
Jul 15 15:02:39.550507 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.550448    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz"
Jul 15 15:02:39.676331 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:39.676309    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz"]
Jul 15 15:02:39.678084 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:02:39.678057    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d101c08_abd1_4186_85ac_d053f5e17fa3.slice/crio-754625d09c657cc20701be87f7d8a544190ddcfdef89c2a2b18e2176164c489f WatchSource:0}: Error finding container 754625d09c657cc20701be87f7d8a544190ddcfdef89c2a2b18e2176164c489f: Status 404 returned error can't find the container with id 754625d09c657cc20701be87f7d8a544190ddcfdef89c2a2b18e2176164c489f
Jul 15 15:02:40.014443 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:40.014408    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz" event={"ID":"2d101c08-abd1-4186-85ac-d053f5e17fa3","Type":"ContainerStarted","Data":"ac67590f32152b80417d66ab2c95b1f3d17927e92e714af9423b793a2698626f"}
Jul 15 15:02:40.014611 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:40.014474    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz" event={"ID":"2d101c08-abd1-4186-85ac-d053f5e17fa3","Type":"ContainerStarted","Data":"754625d09c657cc20701be87f7d8a544190ddcfdef89c2a2b18e2176164c489f"}
Jul 15 15:02:40.031408 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:40.031361    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz" podStartSLOduration=1.031345632 podStartE2EDuration="1.031345632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:02:40.029976606 +0000 UTC m=+1921.176657394" watchObservedRunningTime="2026-07-15 15:02:40.031345632 +0000 UTC m=+1921.178026427"
Jul 15 15:02:41.021214 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:41.021178    2581 generic.go:356] "Generic (PLEG): container finished" podID="2d101c08-abd1-4186-85ac-d053f5e17fa3" containerID="ac67590f32152b80417d66ab2c95b1f3d17927e92e714af9423b793a2698626f" exitCode=0
Jul 15 15:02:41.021610 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:41.021288    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz" event={"ID":"2d101c08-abd1-4186-85ac-d053f5e17fa3","Type":"ContainerDied","Data":"ac67590f32152b80417d66ab2c95b1f3d17927e92e714af9423b793a2698626f"}
Jul 15 15:02:42.154902 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:42.154877    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz"
Jul 15 15:02:42.241844 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:42.241815    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d101c08-abd1-4186-85ac-d053f5e17fa3-maas-api-service-ca\") pod \"2d101c08-abd1-4186-85ac-d053f5e17fa3\" (UID: \"2d101c08-abd1-4186-85ac-d053f5e17fa3\") "
Jul 15 15:02:42.242187 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:42.242162    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d101c08-abd1-4186-85ac-d053f5e17fa3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2d101c08-abd1-4186-85ac-d053f5e17fa3" (UID: "2d101c08-abd1-4186-85ac-d053f5e17fa3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:02:42.343040 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:42.342968    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d101c08-abd1-4186-85ac-d053f5e17fa3-maas-api-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:02:43.034305 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:43.034275    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz"
Jul 15 15:02:43.034487 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:43.034280    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz" event={"ID":"2d101c08-abd1-4186-85ac-d053f5e17fa3","Type":"ContainerDied","Data":"754625d09c657cc20701be87f7d8a544190ddcfdef89c2a2b18e2176164c489f"}
Jul 15 15:02:43.034487 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:43.034399    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="754625d09c657cc20701be87f7d8a544190ddcfdef89c2a2b18e2176164c489f"
Jul 15 15:02:52.799802 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:02:52.799762    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:03:09.399585 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:09.399551    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:03:11.103136 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:11.103105    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l"]
Jul 15 15:03:11.103560 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:11.103462    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d101c08-abd1-4186-85ac-d053f5e17fa3" containerName="revoke-keys"
Jul 15 15:03:11.103560 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:11.103473    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d101c08-abd1-4186-85ac-d053f5e17fa3" containerName="revoke-keys"
Jul 15 15:03:11.103560 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:11.103531    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d101c08-abd1-4186-85ac-d053f5e17fa3" containerName="revoke-keys"
Jul 15 15:03:11.106610 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:11.106592    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l"
Jul 15 15:03:11.109454 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:11.109432    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:03:11.109454 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:11.109444    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:03:11.115221 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:11.115197    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l"]
Jul 15 15:03:11.179962 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:11.179926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80cd0bb-45d5-4167-ace0-875adc01644a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l\" (UID: \"b80cd0bb-45d5-4167-ace0-875adc01644a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l"
Jul 15 15:03:11.280994 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:11.280966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80cd0bb-45d5-4167-ace0-875adc01644a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l\" (UID: \"b80cd0bb-45d5-4167-ace0-875adc01644a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l"
Jul 15 15:03:11.281663 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:11.281638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80cd0bb-45d5-4167-ace0-875adc01644a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l\" (UID: \"b80cd0bb-45d5-4167-ace0-875adc01644a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l"
Jul 15 15:03:11.418820 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:11.418803    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l"
Jul 15 15:03:11.548234 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:11.548203    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l"]
Jul 15 15:03:11.549317 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:03:11.549286    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80cd0bb_45d5_4167_ace0_875adc01644a.slice/crio-76ff09e6fdbc52e0bb63344524063fe46271e8359100bf0395a1c4d7df112572 WatchSource:0}: Error finding container 76ff09e6fdbc52e0bb63344524063fe46271e8359100bf0395a1c4d7df112572: Status 404 returned error can't find the container with id 76ff09e6fdbc52e0bb63344524063fe46271e8359100bf0395a1c4d7df112572
Jul 15 15:03:12.200843 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:12.200816    2581 generic.go:356] "Generic (PLEG): container finished" podID="b80cd0bb-45d5-4167-ace0-875adc01644a" containerID="6123c01f995b313289e3f0b30dda750992e4ede414a3a22aecec18671641e822" exitCode=7
Jul 15 15:03:12.201127 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:12.200901    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l" event={"ID":"b80cd0bb-45d5-4167-ace0-875adc01644a","Type":"ContainerDied","Data":"6123c01f995b313289e3f0b30dda750992e4ede414a3a22aecec18671641e822"}
Jul 15 15:03:12.201127 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:12.200949    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l" event={"ID":"b80cd0bb-45d5-4167-ace0-875adc01644a","Type":"ContainerStarted","Data":"76ff09e6fdbc52e0bb63344524063fe46271e8359100bf0395a1c4d7df112572"}
Jul 15 15:03:12.201127 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:12.201039    2581 scope.go:117] "RemoveContainer" containerID="6123c01f995b313289e3f0b30dda750992e4ede414a3a22aecec18671641e822"
Jul 15 15:03:13.208039 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:13.208006    2581 generic.go:356] "Generic (PLEG): container finished" podID="b80cd0bb-45d5-4167-ace0-875adc01644a" containerID="0c17ab2cb65e95c788d29a4d844569dd6edc9ceb9b797dad49184d628e345ffc" exitCode=7
Jul 15 15:03:13.208451 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:13.208048    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l" event={"ID":"b80cd0bb-45d5-4167-ace0-875adc01644a","Type":"ContainerDied","Data":"0c17ab2cb65e95c788d29a4d844569dd6edc9ceb9b797dad49184d628e345ffc"}
Jul 15 15:03:13.208451 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:13.208092    2581 scope.go:117] "RemoveContainer" containerID="6123c01f995b313289e3f0b30dda750992e4ede414a3a22aecec18671641e822"
Jul 15 15:03:13.208451 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:13.208252    2581 scope.go:117] "RemoveContainer" containerID="0c17ab2cb65e95c788d29a4d844569dd6edc9ceb9b797dad49184d628e345ffc"
Jul 15 15:03:13.208577 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:03:13.208465    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l_odh-ai-gateway-infra(b80cd0bb-45d5-4167-ace0-875adc01644a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l" podUID="b80cd0bb-45d5-4167-ace0-875adc01644a"
Jul 15 15:03:14.214564 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:14.214538    2581 scope.go:117] "RemoveContainer" containerID="0c17ab2cb65e95c788d29a4d844569dd6edc9ceb9b797dad49184d628e345ffc"
Jul 15 15:03:14.214944 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:03:14.214692    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l_odh-ai-gateway-infra(b80cd0bb-45d5-4167-ace0-875adc01644a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l" podUID="b80cd0bb-45d5-4167-ace0-875adc01644a"
Jul 15 15:03:29.377415 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:29.377386    2581 scope.go:117] "RemoveContainer" containerID="0c17ab2cb65e95c788d29a4d844569dd6edc9ceb9b797dad49184d628e345ffc"
Jul 15 15:03:30.303186 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:30.303097    2581 generic.go:356] "Generic (PLEG): container finished" podID="b80cd0bb-45d5-4167-ace0-875adc01644a" containerID="a4c8cec1518433de5d70979032a087735b3425438cbd1944e85d1b96bcb89736" exitCode=0
Jul 15 15:03:30.303186 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:30.303169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l" event={"ID":"b80cd0bb-45d5-4167-ace0-875adc01644a","Type":"ContainerDied","Data":"a4c8cec1518433de5d70979032a087735b3425438cbd1944e85d1b96bcb89736"}
Jul 15 15:03:30.303400 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:30.303249    2581 scope.go:117] "RemoveContainer" containerID="0c17ab2cb65e95c788d29a4d844569dd6edc9ceb9b797dad49184d628e345ffc"
Jul 15 15:03:31.336712 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:31.336670    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l"]
Jul 15 15:03:31.436819 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:31.436797    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l"
Jul 15 15:03:31.535811 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:31.535785    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80cd0bb-45d5-4167-ace0-875adc01644a-maas-api-service-ca\") pod \"b80cd0bb-45d5-4167-ace0-875adc01644a\" (UID: \"b80cd0bb-45d5-4167-ace0-875adc01644a\") "
Jul 15 15:03:31.536099 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:31.536076    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b80cd0bb-45d5-4167-ace0-875adc01644a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b80cd0bb-45d5-4167-ace0-875adc01644a" (UID: "b80cd0bb-45d5-4167-ace0-875adc01644a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:03:31.636778 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:31.636713    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80cd0bb-45d5-4167-ace0-875adc01644a-maas-api-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:03:32.317018 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:32.316987    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l"
Jul 15 15:03:32.317214 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:32.317021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l" event={"ID":"b80cd0bb-45d5-4167-ace0-875adc01644a","Type":"ContainerDied","Data":"76ff09e6fdbc52e0bb63344524063fe46271e8359100bf0395a1c4d7df112572"}
Jul 15 15:03:32.317214 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:32.317060    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76ff09e6fdbc52e0bb63344524063fe46271e8359100bf0395a1c4d7df112572"
Jul 15 15:03:32.354717 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:32.354691    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l"]
Jul 15 15:03:32.358585 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:32.358563    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-nss8l"]
Jul 15 15:03:33.380542 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:03:33.380508    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b80cd0bb-45d5-4167-ace0-875adc01644a" path="/var/lib/kubelet/pods/b80cd0bb-45d5-4167-ace0-875adc01644a/volumes"
Jul 15 15:04:11.148049 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.148014    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv"]
Jul 15 15:04:11.148463 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.148357    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80cd0bb-45d5-4167-ace0-875adc01644a" containerName="revoke-keys"
Jul 15 15:04:11.148463 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.148368    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80cd0bb-45d5-4167-ace0-875adc01644a" containerName="revoke-keys"
Jul 15 15:04:11.148463 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.148384    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80cd0bb-45d5-4167-ace0-875adc01644a" containerName="revoke-keys"
Jul 15 15:04:11.148463 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.148390    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80cd0bb-45d5-4167-ace0-875adc01644a" containerName="revoke-keys"
Jul 15 15:04:11.148463 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.148395    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80cd0bb-45d5-4167-ace0-875adc01644a" containerName="revoke-keys"
Jul 15 15:04:11.148463 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.148401    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80cd0bb-45d5-4167-ace0-875adc01644a" containerName="revoke-keys"
Jul 15 15:04:11.148463 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.148462    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b80cd0bb-45d5-4167-ace0-875adc01644a" containerName="revoke-keys"
Jul 15 15:04:11.148721 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.148471    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b80cd0bb-45d5-4167-ace0-875adc01644a" containerName="revoke-keys"
Jul 15 15:04:11.151767 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.151750    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv"
Jul 15 15:04:11.154393 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.154369    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:04:11.154510 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.154369    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:04:11.160325 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.160303    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv"]
Jul 15 15:04:11.253279 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.253241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71dcd6be-1774-43a4-b73e-f26459c35185-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv\" (UID: \"71dcd6be-1774-43a4-b73e-f26459c35185\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv"
Jul 15 15:04:11.353695 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.353656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71dcd6be-1774-43a4-b73e-f26459c35185-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv\" (UID: \"71dcd6be-1774-43a4-b73e-f26459c35185\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv"
Jul 15 15:04:11.354300 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.354276    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71dcd6be-1774-43a4-b73e-f26459c35185-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv\" (UID: \"71dcd6be-1774-43a4-b73e-f26459c35185\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv"
Jul 15 15:04:11.463097 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.463076    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv"
Jul 15 15:04:11.594523 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:11.594492    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv"]
Jul 15 15:04:11.595557 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:04:11.595531    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71dcd6be_1774_43a4_b73e_f26459c35185.slice/crio-6ca20e5e11c635a77911b59a64ca9f475515d960e454f0eaff808768b853828b WatchSource:0}: Error finding container 6ca20e5e11c635a77911b59a64ca9f475515d960e454f0eaff808768b853828b: Status 404 returned error can't find the container with id 6ca20e5e11c635a77911b59a64ca9f475515d960e454f0eaff808768b853828b
Jul 15 15:04:12.542100 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:12.542067    2581 generic.go:356] "Generic (PLEG): container finished" podID="71dcd6be-1774-43a4-b73e-f26459c35185" containerID="8c611f827368a2971c8bc8e12d2d3dca0e402ed07a75186d6b3e495960fa9c78" exitCode=0
Jul 15 15:04:12.542509 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:12.542153    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv" event={"ID":"71dcd6be-1774-43a4-b73e-f26459c35185","Type":"ContainerDied","Data":"8c611f827368a2971c8bc8e12d2d3dca0e402ed07a75186d6b3e495960fa9c78"}
Jul 15 15:04:12.542509 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:12.542202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv" event={"ID":"71dcd6be-1774-43a4-b73e-f26459c35185","Type":"ContainerStarted","Data":"6ca20e5e11c635a77911b59a64ca9f475515d960e454f0eaff808768b853828b"}
Jul 15 15:04:13.674604 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:13.674578    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv"
Jul 15 15:04:13.771837 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:13.771807    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71dcd6be-1774-43a4-b73e-f26459c35185-maas-api-service-ca\") pod \"71dcd6be-1774-43a4-b73e-f26459c35185\" (UID: \"71dcd6be-1774-43a4-b73e-f26459c35185\") "
Jul 15 15:04:13.772137 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:13.772117    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71dcd6be-1774-43a4-b73e-f26459c35185-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "71dcd6be-1774-43a4-b73e-f26459c35185" (UID: "71dcd6be-1774-43a4-b73e-f26459c35185"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:04:13.873222 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:13.873167    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71dcd6be-1774-43a4-b73e-f26459c35185-maas-api-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:04:14.553818 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:14.553791    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv"
Jul 15 15:04:14.553991 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:14.553829    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv" event={"ID":"71dcd6be-1774-43a4-b73e-f26459c35185","Type":"ContainerDied","Data":"6ca20e5e11c635a77911b59a64ca9f475515d960e454f0eaff808768b853828b"}
Jul 15 15:04:14.553991 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:14.553872    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ca20e5e11c635a77911b59a64ca9f475515d960e454f0eaff808768b853828b"
Jul 15 15:04:24.489991 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:04:24.489957    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:05:39.445970 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:05:39.445940    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 15:05:39.450723 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:05:39.450703    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 15:05:39.454872 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:05:39.454853    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 15:05:39.458927 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:05:39.458911    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 15:05:39.493434 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:05:39.493407    2581 scope.go:117] "RemoveContainer" containerID="26e8e4c734ff71ecdb9ad9c4e3d7b1c25d3e4d33cbb115563c9918b45674dfef"
Jul 15 15:06:00.791779 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:00.791722    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:06:09.894581 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:09.894545    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:06:20.801846 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:20.801811    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:06:26.412099 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:26.412056    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg"]
Jul 15 15:06:26.412639 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:26.412599    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71dcd6be-1774-43a4-b73e-f26459c35185" containerName="revoke-keys"
Jul 15 15:06:26.412639 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:26.412619    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71dcd6be-1774-43a4-b73e-f26459c35185" containerName="revoke-keys"
Jul 15 15:06:26.412785 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:26.412712    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b80cd0bb-45d5-4167-ace0-875adc01644a" containerName="revoke-keys"
Jul 15 15:06:26.412785 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:26.412727    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71dcd6be-1774-43a4-b73e-f26459c35185" containerName="revoke-keys"
Jul 15 15:06:26.415972 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:26.415953    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg"
Jul 15 15:06:26.418964 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:26.418944    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:06:26.419069 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:26.418949    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:06:26.423632 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:26.423612    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg"]
Jul 15 15:06:26.526754 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:26.526702    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5d7da3-d067-44e8-8883-1e21d408a778-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg\" (UID: \"2d5d7da3-d067-44e8-8883-1e21d408a778\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg"
Jul 15 15:06:26.628128 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:26.628099    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5d7da3-d067-44e8-8883-1e21d408a778-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg\" (UID: \"2d5d7da3-d067-44e8-8883-1e21d408a778\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg"
Jul 15 15:06:26.628642 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:26.628623    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5d7da3-d067-44e8-8883-1e21d408a778-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg\" (UID: \"2d5d7da3-d067-44e8-8883-1e21d408a778\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg"
Jul 15 15:06:26.728908 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:26.728879    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg"
Jul 15 15:06:26.858131 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:26.858103    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg"]
Jul 15 15:06:26.860232 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:06:26.860203    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d5d7da3_d067_44e8_8883_1e21d408a778.slice/crio-ef36bef53bf8e9f4c484092d10dd5ffe3d1b6c299d8753e0cdc504083177a706 WatchSource:0}: Error finding container ef36bef53bf8e9f4c484092d10dd5ffe3d1b6c299d8753e0cdc504083177a706: Status 404 returned error can't find the container with id ef36bef53bf8e9f4c484092d10dd5ffe3d1b6c299d8753e0cdc504083177a706
Jul 15 15:06:27.278407 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:27.278375    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg" event={"ID":"2d5d7da3-d067-44e8-8883-1e21d408a778","Type":"ContainerStarted","Data":"2812b1fbc211aedb75f17495fc5e1ee19007734e52f3a1417e64daebba29fb53"}
Jul 15 15:06:27.278565 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:27.278425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg" event={"ID":"2d5d7da3-d067-44e8-8883-1e21d408a778","Type":"ContainerStarted","Data":"ef36bef53bf8e9f4c484092d10dd5ffe3d1b6c299d8753e0cdc504083177a706"}
Jul 15 15:06:27.294708 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:27.294659    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg" podStartSLOduration=1.294644375 podStartE2EDuration="1.294644375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:06:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:06:27.293594525 +0000 UTC m=+2148.440275281" watchObservedRunningTime="2026-07-15 15:06:27.294644375 +0000 UTC m=+2148.441325131"
Jul 15 15:06:28.285137 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:28.285100    2581 generic.go:356] "Generic (PLEG): container finished" podID="2d5d7da3-d067-44e8-8883-1e21d408a778" containerID="2812b1fbc211aedb75f17495fc5e1ee19007734e52f3a1417e64daebba29fb53" exitCode=0
Jul 15 15:06:28.285551 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:28.285187    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg" event={"ID":"2d5d7da3-d067-44e8-8883-1e21d408a778","Type":"ContainerDied","Data":"2812b1fbc211aedb75f17495fc5e1ee19007734e52f3a1417e64daebba29fb53"}
Jul 15 15:06:29.418130 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:29.418106    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg"
Jul 15 15:06:29.553817 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:29.553723    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5d7da3-d067-44e8-8883-1e21d408a778-maas-api-service-ca\") pod \"2d5d7da3-d067-44e8-8883-1e21d408a778\" (UID: \"2d5d7da3-d067-44e8-8883-1e21d408a778\") "
Jul 15 15:06:29.554031 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:29.554011    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d5d7da3-d067-44e8-8883-1e21d408a778-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2d5d7da3-d067-44e8-8883-1e21d408a778" (UID: "2d5d7da3-d067-44e8-8883-1e21d408a778"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:06:29.655176 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:29.655142    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5d7da3-d067-44e8-8883-1e21d408a778-maas-api-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:06:30.297196 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:30.297170    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg"
Jul 15 15:06:30.297414 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:30.297168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg" event={"ID":"2d5d7da3-d067-44e8-8883-1e21d408a778","Type":"ContainerDied","Data":"ef36bef53bf8e9f4c484092d10dd5ffe3d1b6c299d8753e0cdc504083177a706"}
Jul 15 15:06:30.297414 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:30.297303    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef36bef53bf8e9f4c484092d10dd5ffe3d1b6c299d8753e0cdc504083177a706"
Jul 15 15:06:39.593538 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:06:39.593461    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:07:21.199475 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:21.199435    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:07:25.191659 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.191624    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"]
Jul 15 15:07:25.192138 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.192122    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d5d7da3-d067-44e8-8883-1e21d408a778" containerName="revoke-keys"
Jul 15 15:07:25.192236 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.192140    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d5d7da3-d067-44e8-8883-1e21d408a778" containerName="revoke-keys"
Jul 15 15:07:25.192236 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.192198    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d5d7da3-d067-44e8-8883-1e21d408a778" containerName="revoke-keys"
Jul 15 15:07:25.195298 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.195252    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.199302 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.199277    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ef5b05d8\"/\"openshift-service-ca.crt\""
Jul 15 15:07:25.199428 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.199315    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ef5b05d8\"/\"kube-root-ca.crt\""
Jul 15 15:07:25.199428 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.199345    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ef5b05d8\"/\"default-dockercfg-llgpz\""
Jul 15 15:07:25.199551 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.199418    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ef5b05d8\"/\"e2e-lifecycle-model-ef5b05d8-kserve-self-signed-certs\""
Jul 15 15:07:25.206339 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.206315    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"]
Jul 15 15:07:25.301943 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.301912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-dshm\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.302100 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.301972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-model-cache\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.302100 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.301998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-tmp-dir\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.302100 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.302022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9lgd\" (UniqueName: \"kubernetes.io/projected/e39b366d-3b73-4f5d-8745-f7656a5bd344-kube-api-access-d9lgd\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.302100 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.302081    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e39b366d-3b73-4f5d-8745-f7656a5bd344-tls-certs\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.302268 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.302104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-home\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.403172 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.403145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-model-cache\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.403287 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.403174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-tmp-dir\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.403287 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.403194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9lgd\" (UniqueName: \"kubernetes.io/projected/e39b366d-3b73-4f5d-8745-f7656a5bd344-kube-api-access-d9lgd\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.403287 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.403236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e39b366d-3b73-4f5d-8745-f7656a5bd344-tls-certs\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.403287 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.403261    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-home\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.403449 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.403330    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-dshm\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.403608 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.403586    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-tmp-dir\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.403679 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.403621    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-model-cache\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.403755 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.403672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-home\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.405496 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.405470    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-dshm\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.405781 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.405765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e39b366d-3b73-4f5d-8745-f7656a5bd344-tls-certs\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.411125 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.411100    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9lgd\" (UniqueName: \"kubernetes.io/projected/e39b366d-3b73-4f5d-8745-f7656a5bd344-kube-api-access-d9lgd\") pod \"e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") " pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.506688 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.506630    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:25.646848 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:25.646825    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"]
Jul 15 15:07:25.648391 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:07:25.648366    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode39b366d_3b73_4f5d_8745_f7656a5bd344.slice/crio-c3a08d97460eb7ea706b6d444d822325453fa1054296a4e57381fe52b2e44037 WatchSource:0}: Error finding container c3a08d97460eb7ea706b6d444d822325453fa1054296a4e57381fe52b2e44037: Status 404 returned error can't find the container with id c3a08d97460eb7ea706b6d444d822325453fa1054296a4e57381fe52b2e44037
Jul 15 15:07:26.613326 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:26.613294    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw" event={"ID":"e39b366d-3b73-4f5d-8745-f7656a5bd344","Type":"ContainerStarted","Data":"112059a7b390a26466ddaeca07ebf5583028be54367fe26a634ed64fd9153415"}
Jul 15 15:07:26.613326 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:26.613336    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw" event={"ID":"e39b366d-3b73-4f5d-8745-f7656a5bd344","Type":"ContainerStarted","Data":"c3a08d97460eb7ea706b6d444d822325453fa1054296a4e57381fe52b2e44037"}
Jul 15 15:07:26.630723 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:26.630680    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw" podStartSLOduration=1.630664297 podStartE2EDuration="1.630664297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:07:26.629986049 +0000 UTC m=+2207.776666806" watchObservedRunningTime="2026-07-15 15:07:26.630664297 +0000 UTC m=+2207.777345078"
Jul 15 15:07:29.987547 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:29.987512    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:07:35.507311 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:35.507282    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:35.507672 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:35.507325    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:35.519922 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:35.519898    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:35.674662 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:35.674635    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:07:39.530037 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:39.530007    2581 scope.go:117] "RemoveContainer" containerID="c810abde1e38fc45b1135ceabe43592b0986439413c67fc063e3b86d6afe43c9"
Jul 15 15:07:45.988958 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:45.988927    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:07:52.243774 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:52.243725    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx"]
Jul 15 15:07:52.247239 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:52.247221    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx"
Jul 15 15:07:52.250117 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:52.250094    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:07:52.250238 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:52.250161    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:07:52.256043 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:52.256023    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx"]
Jul 15 15:07:52.334759 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:52.334701    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37e06f9-c2ac-47d4-b56d-48602798eff4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx\" (UID: \"b37e06f9-c2ac-47d4-b56d-48602798eff4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx"
Jul 15 15:07:52.435878 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:52.435843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37e06f9-c2ac-47d4-b56d-48602798eff4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx\" (UID: \"b37e06f9-c2ac-47d4-b56d-48602798eff4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx"
Jul 15 15:07:52.436406 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:52.436389    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37e06f9-c2ac-47d4-b56d-48602798eff4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx\" (UID: \"b37e06f9-c2ac-47d4-b56d-48602798eff4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx"
Jul 15 15:07:52.558210 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:52.558145    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx"
Jul 15 15:07:52.685829 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:52.685800    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx"]
Jul 15 15:07:52.687344 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:07:52.687319    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb37e06f9_c2ac_47d4_b56d_48602798eff4.slice/crio-d52614e1472deb93a3001ca212c8efb320c0152b0788cb5b28526a21d4a2fd84 WatchSource:0}: Error finding container d52614e1472deb93a3001ca212c8efb320c0152b0788cb5b28526a21d4a2fd84: Status 404 returned error can't find the container with id d52614e1472deb93a3001ca212c8efb320c0152b0788cb5b28526a21d4a2fd84
Jul 15 15:07:52.759073 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:52.759046    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx" event={"ID":"b37e06f9-c2ac-47d4-b56d-48602798eff4","Type":"ContainerStarted","Data":"d52614e1472deb93a3001ca212c8efb320c0152b0788cb5b28526a21d4a2fd84"}
Jul 15 15:07:53.765960 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:53.765928    2581 generic.go:356] "Generic (PLEG): container finished" podID="b37e06f9-c2ac-47d4-b56d-48602798eff4" containerID="d050b6f6ecaae6e0b98167603119798adb9a982c4368f48bff22678b20c18f33" exitCode=0
Jul 15 15:07:53.766331 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:53.766009    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx" event={"ID":"b37e06f9-c2ac-47d4-b56d-48602798eff4","Type":"ContainerDied","Data":"d050b6f6ecaae6e0b98167603119798adb9a982c4368f48bff22678b20c18f33"}
Jul 15 15:07:54.903128 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:54.903100    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx"
Jul 15 15:07:55.057480 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:55.057390    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37e06f9-c2ac-47d4-b56d-48602798eff4-maas-api-service-ca\") pod \"b37e06f9-c2ac-47d4-b56d-48602798eff4\" (UID: \"b37e06f9-c2ac-47d4-b56d-48602798eff4\") "
Jul 15 15:07:55.057824 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:55.057796    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b37e06f9-c2ac-47d4-b56d-48602798eff4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b37e06f9-c2ac-47d4-b56d-48602798eff4" (UID: "b37e06f9-c2ac-47d4-b56d-48602798eff4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:07:55.159020 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:55.158989    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b37e06f9-c2ac-47d4-b56d-48602798eff4-maas-api-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:07:55.777626 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:55.777598    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx"
Jul 15 15:07:55.777788 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:55.777599    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx" event={"ID":"b37e06f9-c2ac-47d4-b56d-48602798eff4","Type":"ContainerDied","Data":"d52614e1472deb93a3001ca212c8efb320c0152b0788cb5b28526a21d4a2fd84"}
Jul 15 15:07:55.777788 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:07:55.777721    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d52614e1472deb93a3001ca212c8efb320c0152b0788cb5b28526a21d4a2fd84"
Jul 15 15:08:06.491409 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:06.491370    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:08:12.315561 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:12.315521    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"]
Jul 15 15:08:27.336019 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.335961    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw" podUID="e39b366d-3b73-4f5d-8745-f7656a5bd344" containerName="main" containerID="cri-o://112059a7b390a26466ddaeca07ebf5583028be54367fe26a634ed64fd9153415" gracePeriod=45
Jul 15 15:08:27.580580 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.580554    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:08:27.618379 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.618311    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-dshm\") pod \"e39b366d-3b73-4f5d-8745-f7656a5bd344\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") "
Jul 15 15:08:27.618379 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.618361    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9lgd\" (UniqueName: \"kubernetes.io/projected/e39b366d-3b73-4f5d-8745-f7656a5bd344-kube-api-access-d9lgd\") pod \"e39b366d-3b73-4f5d-8745-f7656a5bd344\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") "
Jul 15 15:08:27.618591 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.618423    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-tmp-dir\") pod \"e39b366d-3b73-4f5d-8745-f7656a5bd344\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") "
Jul 15 15:08:27.618591 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.618461    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-home\") pod \"e39b366d-3b73-4f5d-8745-f7656a5bd344\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") "
Jul 15 15:08:27.618591 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.618535    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e39b366d-3b73-4f5d-8745-f7656a5bd344-tls-certs\") pod \"e39b366d-3b73-4f5d-8745-f7656a5bd344\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") "
Jul 15 15:08:27.618591 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.618580    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-model-cache\") pod \"e39b366d-3b73-4f5d-8745-f7656a5bd344\" (UID: \"e39b366d-3b73-4f5d-8745-f7656a5bd344\") "
Jul 15 15:08:27.618816 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.618780    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-home" (OuterVolumeSpecName: "home") pod "e39b366d-3b73-4f5d-8745-f7656a5bd344" (UID: "e39b366d-3b73-4f5d-8745-f7656a5bd344"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:08:27.618905 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.618886    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-home\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:08:27.619079 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.619003    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e39b366d-3b73-4f5d-8745-f7656a5bd344" (UID: "e39b366d-3b73-4f5d-8745-f7656a5bd344"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:08:27.619079 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.619018    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-model-cache" (OuterVolumeSpecName: "model-cache") pod "e39b366d-3b73-4f5d-8745-f7656a5bd344" (UID: "e39b366d-3b73-4f5d-8745-f7656a5bd344"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:08:27.620604 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.620578    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-dshm" (OuterVolumeSpecName: "dshm") pod "e39b366d-3b73-4f5d-8745-f7656a5bd344" (UID: "e39b366d-3b73-4f5d-8745-f7656a5bd344"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:08:27.620844 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.620808    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e39b366d-3b73-4f5d-8745-f7656a5bd344-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e39b366d-3b73-4f5d-8745-f7656a5bd344" (UID: "e39b366d-3b73-4f5d-8745-f7656a5bd344"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:08:27.620970 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.620892    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e39b366d-3b73-4f5d-8745-f7656a5bd344-kube-api-access-d9lgd" (OuterVolumeSpecName: "kube-api-access-d9lgd") pod "e39b366d-3b73-4f5d-8745-f7656a5bd344" (UID: "e39b366d-3b73-4f5d-8745-f7656a5bd344"). InnerVolumeSpecName "kube-api-access-d9lgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:08:27.719649 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.719617    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-model-cache\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:08:27.719649 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.719643    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-dshm\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:08:27.719649 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.719652    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9lgd\" (UniqueName: \"kubernetes.io/projected/e39b366d-3b73-4f5d-8745-f7656a5bd344-kube-api-access-d9lgd\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:08:27.719889 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.719661    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39b366d-3b73-4f5d-8745-f7656a5bd344-tmp-dir\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:08:27.719889 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.719671    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e39b366d-3b73-4f5d-8745-f7656a5bd344-tls-certs\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:08:27.960251 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.960213    2581 generic.go:356] "Generic (PLEG): container finished" podID="e39b366d-3b73-4f5d-8745-f7656a5bd344" containerID="112059a7b390a26466ddaeca07ebf5583028be54367fe26a634ed64fd9153415" exitCode=0
Jul 15 15:08:27.960415 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.960253    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"
Jul 15 15:08:27.960415 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.960296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw" event={"ID":"e39b366d-3b73-4f5d-8745-f7656a5bd344","Type":"ContainerDied","Data":"112059a7b390a26466ddaeca07ebf5583028be54367fe26a634ed64fd9153415"}
Jul 15 15:08:27.960415 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.960335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw" event={"ID":"e39b366d-3b73-4f5d-8745-f7656a5bd344","Type":"ContainerDied","Data":"c3a08d97460eb7ea706b6d444d822325453fa1054296a4e57381fe52b2e44037"}
Jul 15 15:08:27.960415 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.960353    2581 scope.go:117] "RemoveContainer" containerID="112059a7b390a26466ddaeca07ebf5583028be54367fe26a634ed64fd9153415"
Jul 15 15:08:27.970001 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.969983    2581 scope.go:117] "RemoveContainer" containerID="112059a7b390a26466ddaeca07ebf5583028be54367fe26a634ed64fd9153415"
Jul 15 15:08:27.970223 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:08:27.970204    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"112059a7b390a26466ddaeca07ebf5583028be54367fe26a634ed64fd9153415\": container with ID starting with 112059a7b390a26466ddaeca07ebf5583028be54367fe26a634ed64fd9153415 not found: ID does not exist" containerID="112059a7b390a26466ddaeca07ebf5583028be54367fe26a634ed64fd9153415"
Jul 15 15:08:27.970286 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.970236    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112059a7b390a26466ddaeca07ebf5583028be54367fe26a634ed64fd9153415"} err="failed to get container status \"112059a7b390a26466ddaeca07ebf5583028be54367fe26a634ed64fd9153415\": rpc error: code = NotFound desc = could not find container \"112059a7b390a26466ddaeca07ebf5583028be54367fe26a634ed64fd9153415\": container with ID starting with 112059a7b390a26466ddaeca07ebf5583028be54367fe26a634ed64fd9153415 not found: ID does not exist"
Jul 15 15:08:27.982439 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.982418    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"]
Jul 15 15:08:27.986235 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:27.986216    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-ef5b05d8/e2e-lifecycle-model-ef5b05d8-kserve-c8578ff59-7qckw"]
Jul 15 15:08:29.379989 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:29.379957    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e39b366d-3b73-4f5d-8745-f7656a5bd344" path="/var/lib/kubelet/pods/e39b366d-3b73-4f5d-8745-f7656a5bd344/volumes"
Jul 15 15:08:39.554744 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:08:39.554703    2581 scope.go:117] "RemoveContainer" containerID="78e4af2d272beb3eb7d34edbb5c9076541094be2c4cb126d880ee6b12d5757dc"
Jul 15 15:09:13.404134 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:09:13.404101    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:09:27.595422 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:09:27.595391    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:09:39.579251 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:09:39.579163    2581 scope.go:117] "RemoveContainer" containerID="a4c8cec1518433de5d70979032a087735b3425438cbd1944e85d1b96bcb89736"
Jul 15 15:10:15.395678 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:15.395646    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:10:26.993836 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:26.993799    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:10:27.891779 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:27.891749    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"]
Jul 15 15:10:27.892102 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:27.892090    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b37e06f9-c2ac-47d4-b56d-48602798eff4" containerName="revoke-keys"
Jul 15 15:10:27.892157 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:27.892103    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b37e06f9-c2ac-47d4-b56d-48602798eff4" containerName="revoke-keys"
Jul 15 15:10:27.892157 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:27.892117    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e39b366d-3b73-4f5d-8745-f7656a5bd344" containerName="main"
Jul 15 15:10:27.892157 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:27.892123    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e39b366d-3b73-4f5d-8745-f7656a5bd344" containerName="main"
Jul 15 15:10:27.892247 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:27.892181    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e39b366d-3b73-4f5d-8745-f7656a5bd344" containerName="main"
Jul 15 15:10:27.892247 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:27.892192    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b37e06f9-c2ac-47d4-b56d-48602798eff4" containerName="revoke-keys"
Jul 15 15:10:27.895296 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:27.895266    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:27.898206 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:27.898184    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-73bd17\"/\"openshift-service-ca.crt\""
Jul 15 15:10:27.899536 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:27.899514    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-73bd17\"/\"test-model-73bd17-kserve-self-signed-certs\""
Jul 15 15:10:27.899660 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:27.899576    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-73bd17\"/\"default-dockercfg-snljb\""
Jul 15 15:10:27.899660 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:27.899647    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-73bd17\"/\"kube-root-ca.crt\""
Jul 15 15:10:27.904699 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:27.904677    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"]
Jul 15 15:10:28.075797 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.072586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lpsc\" (UniqueName: \"kubernetes.io/projected/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-kube-api-access-2lpsc\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.075797 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.072671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-tmp-dir\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.075797 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.072713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-model-cache\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.075797 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.072754    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-dshm\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.075797 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.072804    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-tls-certs\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.075797 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.072827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-home\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.173181 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.173153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lpsc\" (UniqueName: \"kubernetes.io/projected/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-kube-api-access-2lpsc\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.173343 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.173219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-tmp-dir\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.173343 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.173247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-model-cache\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.173343 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.173264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-dshm\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.173343 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.173290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-tls-certs\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.173343 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.173310    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-home\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.173702 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.173666    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-tmp-dir\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.173801 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.173728    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-model-cache\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.173801 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.173792    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-home\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.175597 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.175579    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-dshm\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.175795 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.175777    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-tls-certs\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.184092 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.184072    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lpsc\" (UniqueName: \"kubernetes.io/projected/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-kube-api-access-2lpsc\") pod \"test-model-73bd17-kserve-6469d4df89-jsz4c\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") " pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.205485 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.205461    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:28.334242 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.334217    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"]
Jul 15 15:10:28.335481 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:10:28.335458    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2786d60f_e42a_4977_bea8_eb61e9e2c6ca.slice/crio-def12913b08107d32250063cccd564a6f7219e5484ce1612ecd8190b8acd67fb WatchSource:0}: Error finding container def12913b08107d32250063cccd564a6f7219e5484ce1612ecd8190b8acd67fb: Status 404 returned error can't find the container with id def12913b08107d32250063cccd564a6f7219e5484ce1612ecd8190b8acd67fb
Jul 15 15:10:28.611995 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.611917    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c" event={"ID":"2786d60f-e42a-4977-bea8-eb61e9e2c6ca","Type":"ContainerStarted","Data":"dc914a4621e52e8aea69a16a04bee2407e3c451010e388d1aaf64a6508e07b24"}
Jul 15 15:10:28.611995 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.611957    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c" event={"ID":"2786d60f-e42a-4977-bea8-eb61e9e2c6ca","Type":"ContainerStarted","Data":"def12913b08107d32250063cccd564a6f7219e5484ce1612ecd8190b8acd67fb"}
Jul 15 15:10:28.630032 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:28.629991    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c" podStartSLOduration=1.629976232 podStartE2EDuration="1.629976232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:10:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:10:28.628274256 +0000 UTC m=+2389.774955037" watchObservedRunningTime="2026-07-15 15:10:28.629976232 +0000 UTC m=+2389.776656988"
Jul 15 15:10:35.496659 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:35.496619    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:10:38.206268 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:38.206233    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:38.206668 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:38.206281    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:38.218523 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:38.218495    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:38.678220 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:38.678197    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:10:39.487258 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:39.487235    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 15:10:39.491661 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:39.491641    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 15:10:39.497334 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:39.497314    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 15:10:39.501824 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:39.501807    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 15:10:58.995933 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:58.995900    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"]
Jul 15 15:10:58.999364 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:58.999342    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.003707 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.003664    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6bbf18\"/\"openshift-service-ca.crt\""
Jul 15 15:10:59.003707 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.003668    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6bbf18\"/\"default-dockercfg-gqk4t\""
Jul 15 15:10:59.003904 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.003687    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6bbf18\"/\"kube-root-ca.crt\""
Jul 15 15:10:59.003904 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.003668    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6bbf18\"/\"test-model-6bbf18-kserve-self-signed-certs\""
Jul 15 15:10:59.015329 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.015307    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"]
Jul 15 15:10:59.125449 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.125425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-home\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.125558 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.125485    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-model-cache\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.125558 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.125521    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20baad8d-c062-44a9-8c33-afd7d6f0b937-tls-certs\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.125558 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.125551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-dshm\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.125664 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.125608    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-tmp-dir\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.125664 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.125628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8g66\" (UniqueName: \"kubernetes.io/projected/20baad8d-c062-44a9-8c33-afd7d6f0b937-kube-api-access-n8g66\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.226563 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.226542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-model-cache\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.226680 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.226573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20baad8d-c062-44a9-8c33-afd7d6f0b937-tls-certs\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.226680 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.226598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-dshm\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.226680 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.226623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-tmp-dir\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.226680 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.226639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8g66\" (UniqueName: \"kubernetes.io/projected/20baad8d-c062-44a9-8c33-afd7d6f0b937-kube-api-access-n8g66\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.226680 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.226679    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-home\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.227021 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.227000    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-model-cache\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.227021 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.227013    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-tmp-dir\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.227120 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.227067    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-home\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.228900 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.228879    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-dshm\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.229019 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.229003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20baad8d-c062-44a9-8c33-afd7d6f0b937-tls-certs\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.247722 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.247671    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8g66\" (UniqueName: \"kubernetes.io/projected/20baad8d-c062-44a9-8c33-afd7d6f0b937-kube-api-access-n8g66\") pod \"test-model-6bbf18-kserve-6666ccb4b7-2nm2z\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") " pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.308775 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.308751    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:10:59.442548 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.442522    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"]
Jul 15 15:10:59.444312 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:10:59.444286    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20baad8d_c062_44a9_8c33_afd7d6f0b937.slice/crio-cdb8ab17749f888420b2aaf7aa40b2e36e5b295eca52c4b10f3731d6f4a9f519 WatchSource:0}: Error finding container cdb8ab17749f888420b2aaf7aa40b2e36e5b295eca52c4b10f3731d6f4a9f519: Status 404 returned error can't find the container with id cdb8ab17749f888420b2aaf7aa40b2e36e5b295eca52c4b10f3731d6f4a9f519
Jul 15 15:10:59.790356 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.790266    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z" event={"ID":"20baad8d-c062-44a9-8c33-afd7d6f0b937","Type":"ContainerStarted","Data":"6231058023ded985e83652983ca4760ae38fe30cc7d3c204aa2fba2631e223b6"}
Jul 15 15:10:59.790356 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.790307    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z" event={"ID":"20baad8d-c062-44a9-8c33-afd7d6f0b937","Type":"ContainerStarted","Data":"cdb8ab17749f888420b2aaf7aa40b2e36e5b295eca52c4b10f3731d6f4a9f519"}
Jul 15 15:10:59.811491 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:10:59.811433    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z" podStartSLOduration=1.811419 podStartE2EDuration="1.811419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:10:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:10:59.807833101 +0000 UTC m=+2420.954513855" watchObservedRunningTime="2026-07-15 15:10:59.811419 +0000 UTC m=+2420.958099754"
Jul 15 15:11:03.002941 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:03.002913    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:11:09.309412 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:09.309377    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:11:09.309842 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:09.309428    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:11:09.322180 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:09.322157    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:11:09.853683 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:09.853650    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:11:16.898632 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:16.898600    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:11:18.456972 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:18.456942    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"]
Jul 15 15:11:19.526653 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:19.526620    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"]
Jul 15 15:11:30.194075 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:30.194039    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:11:33.476486 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.476444    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c" podUID="2786d60f-e42a-4977-bea8-eb61e9e2c6ca" containerName="main" containerID="cri-o://dc914a4621e52e8aea69a16a04bee2407e3c451010e388d1aaf64a6508e07b24" gracePeriod=45
Jul 15 15:11:33.737078 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.737027    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:11:33.908705 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.908666    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lpsc\" (UniqueName: \"kubernetes.io/projected/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-kube-api-access-2lpsc\") pod \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") "
Jul 15 15:11:33.908705 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.908707    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-tmp-dir\") pod \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") "
Jul 15 15:11:33.908938 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.908723    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-model-cache\") pod \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") "
Jul 15 15:11:33.908938 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.908872    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-tls-certs\") pod \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") "
Jul 15 15:11:33.909063 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.908946    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-model-cache" (OuterVolumeSpecName: "model-cache") pod "2786d60f-e42a-4977-bea8-eb61e9e2c6ca" (UID: "2786d60f-e42a-4977-bea8-eb61e9e2c6ca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:11:33.909063 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.908964    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2786d60f-e42a-4977-bea8-eb61e9e2c6ca" (UID: "2786d60f-e42a-4977-bea8-eb61e9e2c6ca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:11:33.909063 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.908981    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-dshm\") pod \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") "
Jul 15 15:11:33.909063 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.909028    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-home\") pod \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\" (UID: \"2786d60f-e42a-4977-bea8-eb61e9e2c6ca\") "
Jul 15 15:11:33.909305 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.909287    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-tmp-dir\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:11:33.909363 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.909311    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-model-cache\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:11:33.909363 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.909313    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-home" (OuterVolumeSpecName: "home") pod "2786d60f-e42a-4977-bea8-eb61e9e2c6ca" (UID: "2786d60f-e42a-4977-bea8-eb61e9e2c6ca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:11:33.910902 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.910884    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-dshm" (OuterVolumeSpecName: "dshm") pod "2786d60f-e42a-4977-bea8-eb61e9e2c6ca" (UID: "2786d60f-e42a-4977-bea8-eb61e9e2c6ca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:11:33.910962 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.910905    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-kube-api-access-2lpsc" (OuterVolumeSpecName: "kube-api-access-2lpsc") pod "2786d60f-e42a-4977-bea8-eb61e9e2c6ca" (UID: "2786d60f-e42a-4977-bea8-eb61e9e2c6ca"). InnerVolumeSpecName "kube-api-access-2lpsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:11:33.910998 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.910977    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2786d60f-e42a-4977-bea8-eb61e9e2c6ca" (UID: "2786d60f-e42a-4977-bea8-eb61e9e2c6ca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:11:33.982204 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.982172    2581 generic.go:356] "Generic (PLEG): container finished" podID="2786d60f-e42a-4977-bea8-eb61e9e2c6ca" containerID="dc914a4621e52e8aea69a16a04bee2407e3c451010e388d1aaf64a6508e07b24" exitCode=0
Jul 15 15:11:33.982344 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.982217    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"
Jul 15 15:11:33.982344 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.982256    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c" event={"ID":"2786d60f-e42a-4977-bea8-eb61e9e2c6ca","Type":"ContainerDied","Data":"dc914a4621e52e8aea69a16a04bee2407e3c451010e388d1aaf64a6508e07b24"}
Jul 15 15:11:33.982344 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.982298    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c" event={"ID":"2786d60f-e42a-4977-bea8-eb61e9e2c6ca","Type":"ContainerDied","Data":"def12913b08107d32250063cccd564a6f7219e5484ce1612ecd8190b8acd67fb"}
Jul 15 15:11:33.982344 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.982314    2581 scope.go:117] "RemoveContainer" containerID="dc914a4621e52e8aea69a16a04bee2407e3c451010e388d1aaf64a6508e07b24"
Jul 15 15:11:33.991170 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.991151    2581 scope.go:117] "RemoveContainer" containerID="dc914a4621e52e8aea69a16a04bee2407e3c451010e388d1aaf64a6508e07b24"
Jul 15 15:11:33.991415 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:11:33.991396    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc914a4621e52e8aea69a16a04bee2407e3c451010e388d1aaf64a6508e07b24\": container with ID starting with dc914a4621e52e8aea69a16a04bee2407e3c451010e388d1aaf64a6508e07b24 not found: ID does not exist" containerID="dc914a4621e52e8aea69a16a04bee2407e3c451010e388d1aaf64a6508e07b24"
Jul 15 15:11:33.991477 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:33.991424    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc914a4621e52e8aea69a16a04bee2407e3c451010e388d1aaf64a6508e07b24"} err="failed to get container status \"dc914a4621e52e8aea69a16a04bee2407e3c451010e388d1aaf64a6508e07b24\": rpc error: code = NotFound desc = could not find container \"dc914a4621e52e8aea69a16a04bee2407e3c451010e388d1aaf64a6508e07b24\": container with ID starting with dc914a4621e52e8aea69a16a04bee2407e3c451010e388d1aaf64a6508e07b24 not found: ID does not exist"
Jul 15 15:11:34.005065 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.005045    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"]
Jul 15 15:11:34.007361 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.007341    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-73bd17/test-model-73bd17-kserve-6469d4df89-jsz4c"]
Jul 15 15:11:34.010313 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.010295    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-dshm\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:11:34.010366 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.010316    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-home\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:11:34.010366 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.010326    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lpsc\" (UniqueName: \"kubernetes.io/projected/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-kube-api-access-2lpsc\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:11:34.010366 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.010336    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2786d60f-e42a-4977-bea8-eb61e9e2c6ca-tls-certs\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:11:34.546931 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.546891    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z" podUID="20baad8d-c062-44a9-8c33-afd7d6f0b937" containerName="main" containerID="cri-o://6231058023ded985e83652983ca4760ae38fe30cc7d3c204aa2fba2631e223b6" gracePeriod=45
Jul 15 15:11:34.792842 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.792820    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:11:34.918373 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.918306    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-dshm\") pod \"20baad8d-c062-44a9-8c33-afd7d6f0b937\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") "
Jul 15 15:11:34.918373 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.918337    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8g66\" (UniqueName: \"kubernetes.io/projected/20baad8d-c062-44a9-8c33-afd7d6f0b937-kube-api-access-n8g66\") pod \"20baad8d-c062-44a9-8c33-afd7d6f0b937\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") "
Jul 15 15:11:34.918373 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.918359    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-tmp-dir\") pod \"20baad8d-c062-44a9-8c33-afd7d6f0b937\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") "
Jul 15 15:11:34.918649 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.918394    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-home\") pod \"20baad8d-c062-44a9-8c33-afd7d6f0b937\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") "
Jul 15 15:11:34.918649 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.918433    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20baad8d-c062-44a9-8c33-afd7d6f0b937-tls-certs\") pod \"20baad8d-c062-44a9-8c33-afd7d6f0b937\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") "
Jul 15 15:11:34.918649 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.918494    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-model-cache\") pod \"20baad8d-c062-44a9-8c33-afd7d6f0b937\" (UID: \"20baad8d-c062-44a9-8c33-afd7d6f0b937\") "
Jul 15 15:11:34.918649 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.918630    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "20baad8d-c062-44a9-8c33-afd7d6f0b937" (UID: "20baad8d-c062-44a9-8c33-afd7d6f0b937"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:11:34.918875 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.918654    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-home" (OuterVolumeSpecName: "home") pod "20baad8d-c062-44a9-8c33-afd7d6f0b937" (UID: "20baad8d-c062-44a9-8c33-afd7d6f0b937"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:11:34.918875 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.918790    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-model-cache" (OuterVolumeSpecName: "model-cache") pod "20baad8d-c062-44a9-8c33-afd7d6f0b937" (UID: "20baad8d-c062-44a9-8c33-afd7d6f0b937"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:11:34.918875 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.918853    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-tmp-dir\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:11:34.918875 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.918874    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-home\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:11:34.920651 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.920623    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20baad8d-c062-44a9-8c33-afd7d6f0b937-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "20baad8d-c062-44a9-8c33-afd7d6f0b937" (UID: "20baad8d-c062-44a9-8c33-afd7d6f0b937"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:11:34.920651 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.920622    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-dshm" (OuterVolumeSpecName: "dshm") pod "20baad8d-c062-44a9-8c33-afd7d6f0b937" (UID: "20baad8d-c062-44a9-8c33-afd7d6f0b937"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:11:34.920829 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.920666    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20baad8d-c062-44a9-8c33-afd7d6f0b937-kube-api-access-n8g66" (OuterVolumeSpecName: "kube-api-access-n8g66") pod "20baad8d-c062-44a9-8c33-afd7d6f0b937" (UID: "20baad8d-c062-44a9-8c33-afd7d6f0b937"). InnerVolumeSpecName "kube-api-access-n8g66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:11:34.989710 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.989685    2581 generic.go:356] "Generic (PLEG): container finished" podID="20baad8d-c062-44a9-8c33-afd7d6f0b937" containerID="6231058023ded985e83652983ca4760ae38fe30cc7d3c204aa2fba2631e223b6" exitCode=0
Jul 15 15:11:34.989844 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.989727    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"
Jul 15 15:11:34.989844 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.989775    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z" event={"ID":"20baad8d-c062-44a9-8c33-afd7d6f0b937","Type":"ContainerDied","Data":"6231058023ded985e83652983ca4760ae38fe30cc7d3c204aa2fba2631e223b6"}
Jul 15 15:11:34.989844 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.989824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z" event={"ID":"20baad8d-c062-44a9-8c33-afd7d6f0b937","Type":"ContainerDied","Data":"cdb8ab17749f888420b2aaf7aa40b2e36e5b295eca52c4b10f3731d6f4a9f519"}
Jul 15 15:11:34.989996 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.989846    2581 scope.go:117] "RemoveContainer" containerID="6231058023ded985e83652983ca4760ae38fe30cc7d3c204aa2fba2631e223b6"
Jul 15 15:11:34.998928 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.998911    2581 scope.go:117] "RemoveContainer" containerID="6231058023ded985e83652983ca4760ae38fe30cc7d3c204aa2fba2631e223b6"
Jul 15 15:11:34.999179 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:11:34.999161    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6231058023ded985e83652983ca4760ae38fe30cc7d3c204aa2fba2631e223b6\": container with ID starting with 6231058023ded985e83652983ca4760ae38fe30cc7d3c204aa2fba2631e223b6 not found: ID does not exist" containerID="6231058023ded985e83652983ca4760ae38fe30cc7d3c204aa2fba2631e223b6"
Jul 15 15:11:34.999226 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:34.999188    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6231058023ded985e83652983ca4760ae38fe30cc7d3c204aa2fba2631e223b6"} err="failed to get container status \"6231058023ded985e83652983ca4760ae38fe30cc7d3c204aa2fba2631e223b6\": rpc error: code = NotFound desc = could not find container \"6231058023ded985e83652983ca4760ae38fe30cc7d3c204aa2fba2631e223b6\": container with ID starting with 6231058023ded985e83652983ca4760ae38fe30cc7d3c204aa2fba2631e223b6 not found: ID does not exist"
Jul 15 15:11:35.011682 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:35.011658    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"]
Jul 15 15:11:35.015921 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:35.015901    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-6bbf18/test-model-6bbf18-kserve-6666ccb4b7-2nm2z"]
Jul 15 15:11:35.019902 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:35.019886    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-dshm\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:11:35.019964 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:35.019905    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8g66\" (UniqueName: \"kubernetes.io/projected/20baad8d-c062-44a9-8c33-afd7d6f0b937-kube-api-access-n8g66\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:11:35.019964 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:35.019917    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20baad8d-c062-44a9-8c33-afd7d6f0b937-tls-certs\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:11:35.019964 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:35.019927    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20baad8d-c062-44a9-8c33-afd7d6f0b937-model-cache\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:11:35.380501 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:35.380469    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20baad8d-c062-44a9-8c33-afd7d6f0b937" path="/var/lib/kubelet/pods/20baad8d-c062-44a9-8c33-afd7d6f0b937/volumes"
Jul 15 15:11:35.380877 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:35.380862    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2786d60f-e42a-4977-bea8-eb61e9e2c6ca" path="/var/lib/kubelet/pods/2786d60f-e42a-4977-bea8-eb61e9e2c6ca/volumes"
Jul 15 15:11:40.297869 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:40.297831    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:11:45.784656 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:45.784619    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc"]
Jul 15 15:11:45.785028 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:45.784981    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20baad8d-c062-44a9-8c33-afd7d6f0b937" containerName="main"
Jul 15 15:11:45.785028 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:45.784992    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="20baad8d-c062-44a9-8c33-afd7d6f0b937" containerName="main"
Jul 15 15:11:45.785028 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:45.785011    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2786d60f-e42a-4977-bea8-eb61e9e2c6ca" containerName="main"
Jul 15 15:11:45.785028 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:45.785016    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2786d60f-e42a-4977-bea8-eb61e9e2c6ca" containerName="main"
Jul 15 15:11:45.785158 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:45.785085    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="20baad8d-c062-44a9-8c33-afd7d6f0b937" containerName="main"
Jul 15 15:11:45.785158 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:45.785096    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2786d60f-e42a-4977-bea8-eb61e9e2c6ca" containerName="main"
Jul 15 15:11:45.789514 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:45.789497    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc"
Jul 15 15:11:45.793622 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:45.793591    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:11:45.793787 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:45.793593    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:11:45.795982 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:45.795956    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc"]
Jul 15 15:11:45.800751 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:45.800711    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4105a553-2fc6-4074-9ba0-ad7e537684e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc\" (UID: \"4105a553-2fc6-4074-9ba0-ad7e537684e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc"
Jul 15 15:11:45.901886 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:45.901855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4105a553-2fc6-4074-9ba0-ad7e537684e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc\" (UID: \"4105a553-2fc6-4074-9ba0-ad7e537684e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc"
Jul 15 15:11:45.902438 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:45.902406    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4105a553-2fc6-4074-9ba0-ad7e537684e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc\" (UID: \"4105a553-2fc6-4074-9ba0-ad7e537684e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc"
Jul 15 15:11:46.101672 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:46.101598    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc"
Jul 15 15:11:46.240336 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:46.240306    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc"]
Jul 15 15:11:46.241482 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:11:46.241455    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4105a553_2fc6_4074_9ba0_ad7e537684e9.slice/crio-66947f7dffd8061d8289c63780d22dc9cb2e936e846359be6e9f61c90e2939a5 WatchSource:0}: Error finding container 66947f7dffd8061d8289c63780d22dc9cb2e936e846359be6e9f61c90e2939a5: Status 404 returned error can't find the container with id 66947f7dffd8061d8289c63780d22dc9cb2e936e846359be6e9f61c90e2939a5
Jul 15 15:11:47.058189 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:47.058162    2581 generic.go:356] "Generic (PLEG): container finished" podID="4105a553-2fc6-4074-9ba0-ad7e537684e9" containerID="44236c42b33400fda3f69ff0d0728494b57a26766e23114c2fc808d379d0c7b5" exitCode=0
Jul 15 15:11:47.058537 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:47.058207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc" event={"ID":"4105a553-2fc6-4074-9ba0-ad7e537684e9","Type":"ContainerDied","Data":"44236c42b33400fda3f69ff0d0728494b57a26766e23114c2fc808d379d0c7b5"}
Jul 15 15:11:47.058537 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:47.058262    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc" event={"ID":"4105a553-2fc6-4074-9ba0-ad7e537684e9","Type":"ContainerStarted","Data":"66947f7dffd8061d8289c63780d22dc9cb2e936e846359be6e9f61c90e2939a5"}
Jul 15 15:11:48.191759 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:48.191723    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc"
Jul 15 15:11:48.219364 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:48.219340    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4105a553-2fc6-4074-9ba0-ad7e537684e9-maas-api-service-ca\") pod \"4105a553-2fc6-4074-9ba0-ad7e537684e9\" (UID: \"4105a553-2fc6-4074-9ba0-ad7e537684e9\") "
Jul 15 15:11:48.219678 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:48.219658    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4105a553-2fc6-4074-9ba0-ad7e537684e9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4105a553-2fc6-4074-9ba0-ad7e537684e9" (UID: "4105a553-2fc6-4074-9ba0-ad7e537684e9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:11:48.319904 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:48.319848    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4105a553-2fc6-4074-9ba0-ad7e537684e9-maas-api-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:11:49.070157 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:49.070122    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc" event={"ID":"4105a553-2fc6-4074-9ba0-ad7e537684e9","Type":"ContainerDied","Data":"66947f7dffd8061d8289c63780d22dc9cb2e936e846359be6e9f61c90e2939a5"}
Jul 15 15:11:49.070157 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:49.070153    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc"
Jul 15 15:11:49.070374 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:49.070172    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66947f7dffd8061d8289c63780d22dc9cb2e936e846359be6e9f61c90e2939a5"
Jul 15 15:11:59.496053 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:11:59.496017    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:12:20.316388 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:20.316353    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:12:23.144341 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.144300    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"]
Jul 15 15:12:23.144719 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.144691    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4105a553-2fc6-4074-9ba0-ad7e537684e9" containerName="revoke-keys"
Jul 15 15:12:23.144719 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.144702    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4105a553-2fc6-4074-9ba0-ad7e537684e9" containerName="revoke-keys"
Jul 15 15:12:23.144824 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.144801    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4105a553-2fc6-4074-9ba0-ad7e537684e9" containerName="revoke-keys"
Jul 15 15:12:23.148111 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.148096    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:12:23.150793 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.150768    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0614af-serving-cert\""
Jul 15 15:12:23.151891 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.151871    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tfwqq\""
Jul 15 15:12:23.152010 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.151900    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:12:23.152010 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.151937    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 15:12:23.163965 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.163940    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"]
Jul 15 15:12:23.307144 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.307103    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d6b27d-e807-4df2-9a2e-37cc9db49edf-openshift-service-ca\") pod \"maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw\" (UID: \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:12:23.307311 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.307172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42vn8\" (UniqueName: \"kubernetes.io/projected/39d6b27d-e807-4df2-9a2e-37cc9db49edf-kube-api-access-42vn8\") pod \"maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw\" (UID: \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:12:23.307311 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.307208    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d6b27d-e807-4df2-9a2e-37cc9db49edf-maas-api-tls\") pod \"maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw\" (UID: \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:12:23.407773 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.407675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42vn8\" (UniqueName: \"kubernetes.io/projected/39d6b27d-e807-4df2-9a2e-37cc9db49edf-kube-api-access-42vn8\") pod \"maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw\" (UID: \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:12:23.407773 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.407720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d6b27d-e807-4df2-9a2e-37cc9db49edf-maas-api-tls\") pod \"maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw\" (UID: \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:12:23.407953 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.407788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d6b27d-e807-4df2-9a2e-37cc9db49edf-openshift-service-ca\") pod \"maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw\" (UID: \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:12:23.407953 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:12:23.407868    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-serving-cert: secret "maas-api-e2e-api-b-0614af-serving-cert" not found
Jul 15 15:12:23.407953 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:12:23.407939    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39d6b27d-e807-4df2-9a2e-37cc9db49edf-maas-api-tls podName:39d6b27d-e807-4df2-9a2e-37cc9db49edf nodeName:}" failed. No retries permitted until 2026-07-15 15:12:23.907919509 +0000 UTC m=+2505.054600255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/39d6b27d-e807-4df2-9a2e-37cc9db49edf-maas-api-tls") pod "maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw" (UID: "39d6b27d-e807-4df2-9a2e-37cc9db49edf") : secret "maas-api-e2e-api-b-0614af-serving-cert" not found
Jul 15 15:12:23.408355 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.408339    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d6b27d-e807-4df2-9a2e-37cc9db49edf-openshift-service-ca\") pod \"maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw\" (UID: \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:12:23.416669 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.416646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42vn8\" (UniqueName: \"kubernetes.io/projected/39d6b27d-e807-4df2-9a2e-37cc9db49edf-kube-api-access-42vn8\") pod \"maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw\" (UID: \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:12:23.912570 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.912536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d6b27d-e807-4df2-9a2e-37cc9db49edf-maas-api-tls\") pod \"maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw\" (UID: \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:12:23.914990 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:23.914969    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d6b27d-e807-4df2-9a2e-37cc9db49edf-maas-api-tls\") pod \"maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw\" (UID: \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:12:24.058600 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:24.058569    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:12:24.197821 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:12:24.197793    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d6b27d_e807_4df2_9a2e_37cc9db49edf.slice/crio-68037e5954d8eadad978e77aa69b89cc8f6a1e63983d21c05d49f6c524e8dcc8 WatchSource:0}: Error finding container 68037e5954d8eadad978e77aa69b89cc8f6a1e63983d21c05d49f6c524e8dcc8: Status 404 returned error can't find the container with id 68037e5954d8eadad978e77aa69b89cc8f6a1e63983d21c05d49f6c524e8dcc8
Jul 15 15:12:24.199655 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:24.199631    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:12:24.201576 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:24.201549    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"]
Jul 15 15:12:24.260852 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:24.260824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw" event={"ID":"39d6b27d-e807-4df2-9a2e-37cc9db49edf","Type":"ContainerStarted","Data":"68037e5954d8eadad978e77aa69b89cc8f6a1e63983d21c05d49f6c524e8dcc8"}
Jul 15 15:12:27.284071 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:27.284035    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw" event={"ID":"39d6b27d-e807-4df2-9a2e-37cc9db49edf","Type":"ContainerStarted","Data":"0a9f06b86b746e0aba3bab332c7c42d5ef2c41ccc887981f4cd1f6cb8842cb96"}
Jul 15 15:12:27.284565 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:27.284171    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:12:27.305582 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:27.305539    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw" podStartSLOduration=1.8982141289999999 podStartE2EDuration="4.305525134s" totalImagesPullingTime="2.407311005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:12:27.302792811 +0000 UTC m=+2508.449473567" watchObservedRunningTime="2026-07-15 15:12:27.305525134 +0000 UTC m=+2508.452205889"
Jul 15 15:12:33.294414 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:33.294381    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:12:34.127110 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:34.127067    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:12:49.991158 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:12:49.991122    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:13:12.313047 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:12.313011    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"]
Jul 15 15:13:12.313964 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:12.313285    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw" podUID="39d6b27d-e807-4df2-9a2e-37cc9db49edf" containerName="maas-api" containerID="cri-o://0a9f06b86b746e0aba3bab332c7c42d5ef2c41ccc887981f4cd1f6cb8842cb96" gracePeriod=30
Jul 15 15:13:12.538122 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:12.538093    2581 generic.go:356] "Generic (PLEG): container finished" podID="39d6b27d-e807-4df2-9a2e-37cc9db49edf" containerID="0a9f06b86b746e0aba3bab332c7c42d5ef2c41ccc887981f4cd1f6cb8842cb96" exitCode=0
Jul 15 15:13:12.538205 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:12.538167    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw" event={"ID":"39d6b27d-e807-4df2-9a2e-37cc9db49edf","Type":"ContainerDied","Data":"0a9f06b86b746e0aba3bab332c7c42d5ef2c41ccc887981f4cd1f6cb8842cb96"}
Jul 15 15:13:12.556942 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:12.556921    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:13:12.591323 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:12.591253    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d6b27d-e807-4df2-9a2e-37cc9db49edf-openshift-service-ca\") pod \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\" (UID: \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\") "
Jul 15 15:13:12.591323 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:12.591317    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42vn8\" (UniqueName: \"kubernetes.io/projected/39d6b27d-e807-4df2-9a2e-37cc9db49edf-kube-api-access-42vn8\") pod \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\" (UID: \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\") "
Jul 15 15:13:12.591517 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:12.591447    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d6b27d-e807-4df2-9a2e-37cc9db49edf-maas-api-tls\") pod \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\" (UID: \"39d6b27d-e807-4df2-9a2e-37cc9db49edf\") "
Jul 15 15:13:12.591676 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:12.591652    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d6b27d-e807-4df2-9a2e-37cc9db49edf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "39d6b27d-e807-4df2-9a2e-37cc9db49edf" (UID: "39d6b27d-e807-4df2-9a2e-37cc9db49edf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:13:12.591819 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:12.591804    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d6b27d-e807-4df2-9a2e-37cc9db49edf-openshift-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:13:12.593612 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:12.593579    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39d6b27d-e807-4df2-9a2e-37cc9db49edf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "39d6b27d-e807-4df2-9a2e-37cc9db49edf" (UID: "39d6b27d-e807-4df2-9a2e-37cc9db49edf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:13:12.593714 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:12.593673    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39d6b27d-e807-4df2-9a2e-37cc9db49edf-kube-api-access-42vn8" (OuterVolumeSpecName: "kube-api-access-42vn8") pod "39d6b27d-e807-4df2-9a2e-37cc9db49edf" (UID: "39d6b27d-e807-4df2-9a2e-37cc9db49edf"). InnerVolumeSpecName "kube-api-access-42vn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:13:12.692498 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:12.692477    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42vn8\" (UniqueName: \"kubernetes.io/projected/39d6b27d-e807-4df2-9a2e-37cc9db49edf-kube-api-access-42vn8\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:13:12.692498 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:12.692498    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d6b27d-e807-4df2-9a2e-37cc9db49edf-maas-api-tls\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:13:13.545110 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:13.545075    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw" event={"ID":"39d6b27d-e807-4df2-9a2e-37cc9db49edf","Type":"ContainerDied","Data":"68037e5954d8eadad978e77aa69b89cc8f6a1e63983d21c05d49f6c524e8dcc8"}
Jul 15 15:13:13.545110 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:13.545098    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"
Jul 15 15:13:13.545565 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:13.545137    2581 scope.go:117] "RemoveContainer" containerID="0a9f06b86b746e0aba3bab332c7c42d5ef2c41ccc887981f4cd1f6cb8842cb96"
Jul 15 15:13:13.562835 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:13.562808    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"]
Jul 15 15:13:13.566655 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:13.566630    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0614af-59c49fc7d-jxdbw"]
Jul 15 15:13:15.380776 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:15.380726    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39d6b27d-e807-4df2-9a2e-37cc9db49edf" path="/var/lib/kubelet/pods/39d6b27d-e807-4df2-9a2e-37cc9db49edf/volumes"
Jul 15 15:13:15.392277 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:15.392251    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:13:31.508188 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.508151    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"]
Jul 15 15:13:31.508721 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.508702    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d6b27d-e807-4df2-9a2e-37cc9db49edf" containerName="maas-api"
Jul 15 15:13:31.508790 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.508725    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d6b27d-e807-4df2-9a2e-37cc9db49edf" containerName="maas-api"
Jul 15 15:13:31.508870 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.508857    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="39d6b27d-e807-4df2-9a2e-37cc9db49edf" containerName="maas-api"
Jul 15 15:13:31.511493 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.511468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:13:31.514321 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.514300    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:13:31.514532 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.514499    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-e7a94a-serving-cert\""
Jul 15 15:13:31.514622 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.514561    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 15:13:31.515615 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.515598    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tfwqq\""
Jul 15 15:13:31.520602 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.520582    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"]
Jul 15 15:13:31.642490 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.642457    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a405b87-d8f7-4904-864d-86dac25fcadd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p\" (UID: \"0a405b87-d8f7-4904-864d-86dac25fcadd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:13:31.642490 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.642493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxfh7\" (UniqueName: \"kubernetes.io/projected/0a405b87-d8f7-4904-864d-86dac25fcadd-kube-api-access-xxfh7\") pod \"maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p\" (UID: \"0a405b87-d8f7-4904-864d-86dac25fcadd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:13:31.642812 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.642578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a405b87-d8f7-4904-864d-86dac25fcadd-maas-api-tls\") pod \"maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p\" (UID: \"0a405b87-d8f7-4904-864d-86dac25fcadd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:13:31.743468 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.743439    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a405b87-d8f7-4904-864d-86dac25fcadd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p\" (UID: \"0a405b87-d8f7-4904-864d-86dac25fcadd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:13:31.743594 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.743471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxfh7\" (UniqueName: \"kubernetes.io/projected/0a405b87-d8f7-4904-864d-86dac25fcadd-kube-api-access-xxfh7\") pod \"maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p\" (UID: \"0a405b87-d8f7-4904-864d-86dac25fcadd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:13:31.743594 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.743532    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a405b87-d8f7-4904-864d-86dac25fcadd-maas-api-tls\") pod \"maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p\" (UID: \"0a405b87-d8f7-4904-864d-86dac25fcadd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:13:31.744199 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.744181    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a405b87-d8f7-4904-864d-86dac25fcadd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p\" (UID: \"0a405b87-d8f7-4904-864d-86dac25fcadd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:13:31.745946 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.745929    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a405b87-d8f7-4904-864d-86dac25fcadd-maas-api-tls\") pod \"maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p\" (UID: \"0a405b87-d8f7-4904-864d-86dac25fcadd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:13:31.752191 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.752162    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxfh7\" (UniqueName: \"kubernetes.io/projected/0a405b87-d8f7-4904-864d-86dac25fcadd-kube-api-access-xxfh7\") pod \"maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p\" (UID: \"0a405b87-d8f7-4904-864d-86dac25fcadd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:13:31.824127 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.824073    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:13:31.960487 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:31.960454    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"]
Jul 15 15:13:31.962180 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:13:31.962152    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a405b87_d8f7_4904_864d_86dac25fcadd.slice/crio-6afc7866ab5f80cb50b0edd7e03823fa2b01b4b4df77dae287b45df9fecd41ed WatchSource:0}: Error finding container 6afc7866ab5f80cb50b0edd7e03823fa2b01b4b4df77dae287b45df9fecd41ed: Status 404 returned error can't find the container with id 6afc7866ab5f80cb50b0edd7e03823fa2b01b4b4df77dae287b45df9fecd41ed
Jul 15 15:13:32.648471 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:32.648438    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p" event={"ID":"0a405b87-d8f7-4904-864d-86dac25fcadd","Type":"ContainerStarted","Data":"6afc7866ab5f80cb50b0edd7e03823fa2b01b4b4df77dae287b45df9fecd41ed"}
Jul 15 15:13:33.655197 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:33.655098    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p" event={"ID":"0a405b87-d8f7-4904-864d-86dac25fcadd","Type":"ContainerStarted","Data":"b88269854237f86888afaf8b006f0211aa2187d72e14757755ef886c3021c49d"}
Jul 15 15:13:33.655540 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:33.655248    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:13:33.673758 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:33.673695    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p" podStartSLOduration=1.401783294 podStartE2EDuration="2.673681438s" totalImagesPullingTime="1.271898144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:13:33.672151771 +0000 UTC m=+2574.818832529" watchObservedRunningTime="2026-07-15 15:13:33.673681438 +0000 UTC m=+2574.820362212"
Jul 15 15:13:36.296742 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:36.296698    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:13:39.545742 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.545692    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"]
Jul 15 15:13:39.548992 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.548965    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:13:39.551677 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.551658    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-9f9f5c-serving-cert\""
Jul 15 15:13:39.558193 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.558168    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"]
Jul 15 15:13:39.665808 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.665782    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:13:39.710774 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.710750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19881a50-c5ec-40e2-8a8f-7e73e4040acf-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4\" (UID: \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:13:39.710885 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.710803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdf5n\" (UniqueName: \"kubernetes.io/projected/19881a50-c5ec-40e2-8a8f-7e73e4040acf-kube-api-access-rdf5n\") pod \"maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4\" (UID: \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:13:39.710885 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.710822    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19881a50-c5ec-40e2-8a8f-7e73e4040acf-maas-api-tls\") pod \"maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4\" (UID: \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:13:39.811905 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.811842    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdf5n\" (UniqueName: \"kubernetes.io/projected/19881a50-c5ec-40e2-8a8f-7e73e4040acf-kube-api-access-rdf5n\") pod \"maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4\" (UID: \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:13:39.811905 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.811873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19881a50-c5ec-40e2-8a8f-7e73e4040acf-maas-api-tls\") pod \"maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4\" (UID: \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:13:39.812084 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.812058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19881a50-c5ec-40e2-8a8f-7e73e4040acf-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4\" (UID: \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:13:39.812614 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.812590    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19881a50-c5ec-40e2-8a8f-7e73e4040acf-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4\" (UID: \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:13:39.814295 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.814272    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19881a50-c5ec-40e2-8a8f-7e73e4040acf-maas-api-tls\") pod \"maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4\" (UID: \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:13:39.821418 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.821393    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdf5n\" (UniqueName: \"kubernetes.io/projected/19881a50-c5ec-40e2-8a8f-7e73e4040acf-kube-api-access-rdf5n\") pod \"maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4\" (UID: \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:13:39.861771 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.861748    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:13:39.991589 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:39.991558    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"]
Jul 15 15:13:39.992470 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:13:39.992443    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19881a50_c5ec_40e2_8a8f_7e73e4040acf.slice/crio-7bab1c21c06460f06e78365e69d95292244790f8ee17b9722501222d7d646a1e WatchSource:0}: Error finding container 7bab1c21c06460f06e78365e69d95292244790f8ee17b9722501222d7d646a1e: Status 404 returned error can't find the container with id 7bab1c21c06460f06e78365e69d95292244790f8ee17b9722501222d7d646a1e
Jul 15 15:13:40.697686 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:40.697653    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4" event={"ID":"19881a50-c5ec-40e2-8a8f-7e73e4040acf","Type":"ContainerStarted","Data":"86c870e0cf442ebe6f9a7f4a4245dc9005e98d446622d1e366e11a4018de2caa"}
Jul 15 15:13:40.698096 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:40.697717    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4" event={"ID":"19881a50-c5ec-40e2-8a8f-7e73e4040acf","Type":"ContainerStarted","Data":"7bab1c21c06460f06e78365e69d95292244790f8ee17b9722501222d7d646a1e"}
Jul 15 15:13:40.698096 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:40.697761    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:13:40.714967 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:40.714923    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4" podStartSLOduration=1.291767769 podStartE2EDuration="1.714908224s" totalImagesPullingTime="423.140455ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:13:40.714152296 +0000 UTC m=+2581.860833062" watchObservedRunningTime="2026-07-15 15:13:40.714908224 +0000 UTC m=+2581.861588987"
Jul 15 15:13:45.796288 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:45.796257    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:13:46.708728 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:46.708697    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:13:55.299005 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.298973    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"]
Jul 15 15:13:55.301557 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.301538    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.305810 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.305786    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e7a94a\"/\"openshift-service-ca.crt\""
Jul 15 15:13:55.305929 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.305828    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e7a94a\"/\"auth-test-model-e7a94a-kserve-self-signed-certs\""
Jul 15 15:13:55.305929 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.305854    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e7a94a\"/\"default-dockercfg-4bfkl\""
Jul 15 15:13:55.305929 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.305922    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e7a94a\"/\"kube-root-ca.crt\""
Jul 15 15:13:55.311702 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.311681    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"]
Jul 15 15:13:55.436720 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.436693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-home\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.436884 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.436741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjtqn\" (UniqueName: \"kubernetes.io/projected/0768f5e8-598d-4de6-8c68-43a3bbf69a44-kube-api-access-hjtqn\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.436884 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.436841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-dshm\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.436884 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.436865    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-tmp-dir\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.436992 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.436903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0768f5e8-598d-4de6-8c68-43a3bbf69a44-tls-certs\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.436992 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.436963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-model-cache\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.538228 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.538196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-dshm\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.538228 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.538227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-tmp-dir\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.538431 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.538252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0768f5e8-598d-4de6-8c68-43a3bbf69a44-tls-certs\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.538431 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.538352    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-model-cache\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.538431 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.538412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-home\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.538601 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.538454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjtqn\" (UniqueName: \"kubernetes.io/projected/0768f5e8-598d-4de6-8c68-43a3bbf69a44-kube-api-access-hjtqn\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.538672 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.538652    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-tmp-dir\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.538777 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.538757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-model-cache\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.538848 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.538790    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-home\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.540551 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.540530    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-dshm\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.540883 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.540863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0768f5e8-598d-4de6-8c68-43a3bbf69a44-tls-certs\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.546476 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.546455    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjtqn\" (UniqueName: \"kubernetes.io/projected/0768f5e8-598d-4de6-8c68-43a3bbf69a44-kube-api-access-hjtqn\") pod \"auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") " pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.612760 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.612692    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:13:55.745088 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.745057    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"]
Jul 15 15:13:55.746177 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:13:55.746152    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0768f5e8_598d_4de6_8c68_43a3bbf69a44.slice/crio-c8ee64c21d5c22dbca89b7c1d97c611dd479d8606f0c03f65bcc419210e3ccdc WatchSource:0}: Error finding container c8ee64c21d5c22dbca89b7c1d97c611dd479d8606f0c03f65bcc419210e3ccdc: Status 404 returned error can't find the container with id c8ee64c21d5c22dbca89b7c1d97c611dd479d8606f0c03f65bcc419210e3ccdc
Jul 15 15:13:55.783490 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:55.783467    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4" event={"ID":"0768f5e8-598d-4de6-8c68-43a3bbf69a44","Type":"ContainerStarted","Data":"c8ee64c21d5c22dbca89b7c1d97c611dd479d8606f0c03f65bcc419210e3ccdc"}
Jul 15 15:13:56.791488 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:56.791453    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4" event={"ID":"0768f5e8-598d-4de6-8c68-43a3bbf69a44","Type":"ContainerStarted","Data":"56f1d7367528b597b959159c2a3c50fc3e3b0198906f0b1d4770899698736129"}
Jul 15 15:13:56.812745 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:56.812675    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4" podStartSLOduration=1.812662593 podStartE2EDuration="1.812662593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:13:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:13:56.810859942 +0000 UTC m=+2597.957540698" watchObservedRunningTime="2026-07-15 15:13:56.812662593 +0000 UTC m=+2597.959343386"
Jul 15 15:13:59.596645 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:13:59.596613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:14:05.612883 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:05.612849    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:14:05.613316 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:05.612901    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:14:05.624999 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:05.624977    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:14:05.849995 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:05.849967    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:14:21.697187 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.697148    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"]
Jul 15 15:14:21.700340 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.700319    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.705103 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.705073    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9f9f5c\"/\"default-dockercfg-cgcxp\""
Jul 15 15:14:21.705271 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.705132    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9f9f5c\"/\"openshift-service-ca.crt\""
Jul 15 15:14:21.705332 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.705315    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9f9f5c\"/\"kube-root-ca.crt\""
Jul 15 15:14:21.705424 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.705405    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9f9f5c\"/\"auth-test-model-9f9f5c-kserve-self-signed-certs\""
Jul 15 15:14:21.709239 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.709215    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"]
Jul 15 15:14:21.748640 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.748609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk49b\" (UniqueName: \"kubernetes.io/projected/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-kube-api-access-pk49b\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.748808 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.748644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-tmp-dir\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.748808 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.748665    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-home\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.748808 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.748759    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-dshm\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.748808 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.748805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-tls-certs\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.748968 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.748881    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-model-cache\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.850046 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.850013    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk49b\" (UniqueName: \"kubernetes.io/projected/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-kube-api-access-pk49b\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.850046 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.850047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-tmp-dir\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.850239 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.850067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-home\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.850239 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.850100    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-dshm\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.850239 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.850146    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-tls-certs\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.850355 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.850299    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-model-cache\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.850490 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.850471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-tmp-dir\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.850537 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.850495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-home\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.850651 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.850632    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-model-cache\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.852232 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.852214    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-dshm\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.852388 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.852370    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-tls-certs\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:21.860221 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:21.860189    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk49b\" (UniqueName: \"kubernetes.io/projected/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-kube-api-access-pk49b\") pod \"auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") " pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:22.012821 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:22.012796    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:22.150983 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:22.150958    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"]
Jul 15 15:14:22.153172 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:14:22.153146    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a83f16b_a8a1_48a9_bfc5_4e31c7c24dc3.slice/crio-a2fc9c52e1b62166a81dcd610ea385552145370cc3914785fe6c54aa885cc444 WatchSource:0}: Error finding container a2fc9c52e1b62166a81dcd610ea385552145370cc3914785fe6c54aa885cc444: Status 404 returned error can't find the container with id a2fc9c52e1b62166a81dcd610ea385552145370cc3914785fe6c54aa885cc444
Jul 15 15:14:22.937832 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:22.937793    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m" event={"ID":"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3","Type":"ContainerStarted","Data":"52a53d81dcf1a20299f5d7c67387c1ca74535974d14f74e489553fe048b1ab6e"}
Jul 15 15:14:22.938252 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:22.937839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m" event={"ID":"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3","Type":"ContainerStarted","Data":"a2fc9c52e1b62166a81dcd610ea385552145370cc3914785fe6c54aa885cc444"}
Jul 15 15:14:22.956820 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:22.956773    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m" podStartSLOduration=1.956757918 podStartE2EDuration="1.956757918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:14:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:14:22.954431641 +0000 UTC m=+2624.101112442" watchObservedRunningTime="2026-07-15 15:14:22.956757918 +0000 UTC m=+2624.103438673"
Jul 15 15:14:25.391799 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:25.391757    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:14:32.013495 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:32.013456    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:32.013921 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:32.013508    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:32.025875 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:32.025854    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:33.003303 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:33.003274    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:14:43.301850 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:14:43.301813    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:15:01.796675 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:15:01.796635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:15:16.992020 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:15:16.991986    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:15:34.309073 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:15:34.308994    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:15:39.526154 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:15:39.526125    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 15:15:39.530820 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:15:39.530800    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 15:15:39.537404 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:15:39.537387    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 15:15:39.541822 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:15:39.541804    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 15:15:52.595505 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:15:52.595472    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:16:09.450574 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:09.450535    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:16:26.595584 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:26.595550    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:16:29.651678 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:29.651643    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"]
Jul 15 15:16:30.506963 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:30.506927    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"]
Jul 15 15:16:42.889145 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:42.889114    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:16:44.009568 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.009533    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"]
Jul 15 15:16:44.012025 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.012008    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.017078 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.017052    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e7a94a\"/\"sub-test-model-e7a94a-kserve-self-signed-certs\""
Jul 15 15:16:44.022495 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.022463    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"]
Jul 15 15:16:44.105556 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.105519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-tmp-dir\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.105763 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.105573    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb81f41e-83d0-495c-9387-16c94a18dc50-tls-certs\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.105763 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.105649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-model-cache\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.105903 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.105761    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr5j6\" (UniqueName: \"kubernetes.io/projected/bb81f41e-83d0-495c-9387-16c94a18dc50-kube-api-access-vr5j6\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.105903 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.105813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-home\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.105903 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.105844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-dshm\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.207107 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.207076    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-tmp-dir\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.207253 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.207114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb81f41e-83d0-495c-9387-16c94a18dc50-tls-certs\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.207253 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.207132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-model-cache\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.207368 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.207256    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr5j6\" (UniqueName: \"kubernetes.io/projected/bb81f41e-83d0-495c-9387-16c94a18dc50-kube-api-access-vr5j6\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.207368 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.207312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-home\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.207368 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.207345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-dshm\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.207546 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.207500    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-model-cache\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.207623 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.207596    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-home\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.207678 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.207620    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-tmp-dir\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.209501 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.209477    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-dshm\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.209570 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.209549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb81f41e-83d0-495c-9387-16c94a18dc50-tls-certs\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.216336 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.216318    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr5j6\" (UniqueName: \"kubernetes.io/projected/bb81f41e-83d0-495c-9387-16c94a18dc50-kube-api-access-vr5j6\") pod \"sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") " pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.321620 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.321563    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:44.452634 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.452606    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"]
Jul 15 15:16:44.454284 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:16:44.454258    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb81f41e_83d0_495c_9387_16c94a18dc50.slice/crio-5ff990519641ce14572820c30505872d62b4c641349087a44fc1c0639c271244 WatchSource:0}: Error finding container 5ff990519641ce14572820c30505872d62b4c641349087a44fc1c0639c271244: Status 404 returned error can't find the container with id 5ff990519641ce14572820c30505872d62b4c641349087a44fc1c0639c271244
Jul 15 15:16:44.672382 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.672348    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4" podUID="0768f5e8-598d-4de6-8c68-43a3bbf69a44" containerName="main" containerID="cri-o://56f1d7367528b597b959159c2a3c50fc3e3b0198906f0b1d4770899698736129" gracePeriod=45
Jul 15 15:16:44.733761 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.733704    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9" event={"ID":"bb81f41e-83d0-495c-9387-16c94a18dc50","Type":"ContainerStarted","Data":"1105399ce8ed0a925cb569353544135740061361c109f8043c4f575fc4192cfa"}
Jul 15 15:16:44.733886 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.733775    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9" event={"ID":"bb81f41e-83d0-495c-9387-16c94a18dc50","Type":"ContainerStarted","Data":"5ff990519641ce14572820c30505872d62b4c641349087a44fc1c0639c271244"}
Jul 15 15:16:44.751638 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.751596    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9" podStartSLOduration=1.751581266 podStartE2EDuration="1.751581266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:16:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:16:44.750932651 +0000 UTC m=+2765.897613406" watchObservedRunningTime="2026-07-15 15:16:44.751581266 +0000 UTC m=+2765.898262019"
Jul 15 15:16:44.914048 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:44.914016    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:16:45.014352 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.014266    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-home\") pod \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") "
Jul 15 15:16:45.014352 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.014313    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0768f5e8-598d-4de6-8c68-43a3bbf69a44-tls-certs\") pod \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") "
Jul 15 15:16:45.014868 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.014367    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-dshm\") pod \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") "
Jul 15 15:16:45.014868 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.014398    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjtqn\" (UniqueName: \"kubernetes.io/projected/0768f5e8-598d-4de6-8c68-43a3bbf69a44-kube-api-access-hjtqn\") pod \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") "
Jul 15 15:16:45.014868 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.014418    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-tmp-dir\") pod \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") "
Jul 15 15:16:45.014868 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.014436    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-model-cache\") pod \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\" (UID: \"0768f5e8-598d-4de6-8c68-43a3bbf69a44\") "
Jul 15 15:16:45.014868 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.014565    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-home" (OuterVolumeSpecName: "home") pod "0768f5e8-598d-4de6-8c68-43a3bbf69a44" (UID: "0768f5e8-598d-4de6-8c68-43a3bbf69a44"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:16:45.014868 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.014654    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0768f5e8-598d-4de6-8c68-43a3bbf69a44" (UID: "0768f5e8-598d-4de6-8c68-43a3bbf69a44"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:16:45.014868 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.014778    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-model-cache" (OuterVolumeSpecName: "model-cache") pod "0768f5e8-598d-4de6-8c68-43a3bbf69a44" (UID: "0768f5e8-598d-4de6-8c68-43a3bbf69a44"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:16:45.014868 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.014792    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-tmp-dir\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:16:45.014868 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.014820    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-home\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:16:45.016656 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.016634    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0768f5e8-598d-4de6-8c68-43a3bbf69a44-kube-api-access-hjtqn" (OuterVolumeSpecName: "kube-api-access-hjtqn") pod "0768f5e8-598d-4de6-8c68-43a3bbf69a44" (UID: "0768f5e8-598d-4de6-8c68-43a3bbf69a44"). InnerVolumeSpecName "kube-api-access-hjtqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:16:45.016656 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.016647    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0768f5e8-598d-4de6-8c68-43a3bbf69a44-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0768f5e8-598d-4de6-8c68-43a3bbf69a44" (UID: "0768f5e8-598d-4de6-8c68-43a3bbf69a44"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:16:45.016784 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.016675    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-dshm" (OuterVolumeSpecName: "dshm") pod "0768f5e8-598d-4de6-8c68-43a3bbf69a44" (UID: "0768f5e8-598d-4de6-8c68-43a3bbf69a44"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:16:45.115988 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.115955    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-dshm\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:16:45.115988 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.115981    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjtqn\" (UniqueName: \"kubernetes.io/projected/0768f5e8-598d-4de6-8c68-43a3bbf69a44-kube-api-access-hjtqn\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:16:45.115988 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.115990    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0768f5e8-598d-4de6-8c68-43a3bbf69a44-model-cache\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:16:45.116213 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.115998    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0768f5e8-598d-4de6-8c68-43a3bbf69a44-tls-certs\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:16:45.526596 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.526560    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m" podUID="6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3" containerName="main" containerID="cri-o://52a53d81dcf1a20299f5d7c67387c1ca74535974d14f74e489553fe048b1ab6e" gracePeriod=45
Jul 15 15:16:45.743529 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.743502    2581 generic.go:356] "Generic (PLEG): container finished" podID="0768f5e8-598d-4de6-8c68-43a3bbf69a44" containerID="56f1d7367528b597b959159c2a3c50fc3e3b0198906f0b1d4770899698736129" exitCode=0
Jul 15 15:16:45.743675 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.743607    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4" event={"ID":"0768f5e8-598d-4de6-8c68-43a3bbf69a44","Type":"ContainerDied","Data":"56f1d7367528b597b959159c2a3c50fc3e3b0198906f0b1d4770899698736129"}
Jul 15 15:16:45.743675 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.743619    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"
Jul 15 15:16:45.743675 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.743648    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4" event={"ID":"0768f5e8-598d-4de6-8c68-43a3bbf69a44","Type":"ContainerDied","Data":"c8ee64c21d5c22dbca89b7c1d97c611dd479d8606f0c03f65bcc419210e3ccdc"}
Jul 15 15:16:45.743675 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.743671    2581 scope.go:117] "RemoveContainer" containerID="56f1d7367528b597b959159c2a3c50fc3e3b0198906f0b1d4770899698736129"
Jul 15 15:16:45.745463 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.745437    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3" containerID="52a53d81dcf1a20299f5d7c67387c1ca74535974d14f74e489553fe048b1ab6e" exitCode=0
Jul 15 15:16:45.745571 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.745476    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m" event={"ID":"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3","Type":"ContainerDied","Data":"52a53d81dcf1a20299f5d7c67387c1ca74535974d14f74e489553fe048b1ab6e"}
Jul 15 15:16:45.753098 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.753079    2581 scope.go:117] "RemoveContainer" containerID="56f1d7367528b597b959159c2a3c50fc3e3b0198906f0b1d4770899698736129"
Jul 15 15:16:45.753399 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:16:45.753375    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56f1d7367528b597b959159c2a3c50fc3e3b0198906f0b1d4770899698736129\": container with ID starting with 56f1d7367528b597b959159c2a3c50fc3e3b0198906f0b1d4770899698736129 not found: ID does not exist" containerID="56f1d7367528b597b959159c2a3c50fc3e3b0198906f0b1d4770899698736129"
Jul 15 15:16:45.753483 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.753409    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56f1d7367528b597b959159c2a3c50fc3e3b0198906f0b1d4770899698736129"} err="failed to get container status \"56f1d7367528b597b959159c2a3c50fc3e3b0198906f0b1d4770899698736129\": rpc error: code = NotFound desc = could not find container \"56f1d7367528b597b959159c2a3c50fc3e3b0198906f0b1d4770899698736129\": container with ID starting with 56f1d7367528b597b959159c2a3c50fc3e3b0198906f0b1d4770899698736129 not found: ID does not exist"
Jul 15 15:16:45.783459 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.783434    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"]
Jul 15 15:16:45.791228 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.791208    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:16:45.791875 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.791858    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/auth-test-model-e7a94a-kserve-8f9879bdc-h6vq4"]
Jul 15 15:16:45.923696 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.923671    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-tmp-dir\") pod \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") "
Jul 15 15:16:45.923848 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.923722    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-dshm\") pod \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") "
Jul 15 15:16:45.923848 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.923766    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-model-cache\") pod \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") "
Jul 15 15:16:45.923848 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.923787    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-tls-certs\") pod \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") "
Jul 15 15:16:45.923848 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.923808    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk49b\" (UniqueName: \"kubernetes.io/projected/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-kube-api-access-pk49b\") pod \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") "
Jul 15 15:16:45.923848 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.923842    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-home\") pod \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\" (UID: \"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3\") "
Jul 15 15:16:45.924122 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.923943    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3" (UID: "6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:16:45.924122 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.924021    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-model-cache" (OuterVolumeSpecName: "model-cache") pod "6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3" (UID: "6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:16:45.924122 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.924093    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-tmp-dir\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:16:45.924122 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.924113    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-model-cache\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:16:45.924255 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.924130    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-home" (OuterVolumeSpecName: "home") pod "6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3" (UID: "6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:16:45.926045 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.926019    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-dshm" (OuterVolumeSpecName: "dshm") pod "6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3" (UID: "6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:16:45.926147 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.926096    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-kube-api-access-pk49b" (OuterVolumeSpecName: "kube-api-access-pk49b") pod "6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3" (UID: "6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3"). InnerVolumeSpecName "kube-api-access-pk49b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:16:45.926147 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:45.926110    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3" (UID: "6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:16:46.025440 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:46.025415    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-dshm\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:16:46.025440 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:46.025437    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-tls-certs\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:16:46.025821 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:46.025448    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk49b\" (UniqueName: \"kubernetes.io/projected/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-kube-api-access-pk49b\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:16:46.025821 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:46.025457    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3-home\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:16:46.753446 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:46.753419    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"
Jul 15 15:16:46.753446 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:46.753423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m" event={"ID":"6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3","Type":"ContainerDied","Data":"a2fc9c52e1b62166a81dcd610ea385552145370cc3914785fe6c54aa885cc444"}
Jul 15 15:16:46.753677 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:46.753466    2581 scope.go:117] "RemoveContainer" containerID="52a53d81dcf1a20299f5d7c67387c1ca74535974d14f74e489553fe048b1ab6e"
Jul 15 15:16:46.775484 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:46.775457    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"]
Jul 15 15:16:46.780525 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:46.780502    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/auth-test-model-9f9f5c-kserve-58c74f9f59-hgq6m"]
Jul 15 15:16:47.380594 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:47.380561    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0768f5e8-598d-4de6-8c68-43a3bbf69a44" path="/var/lib/kubelet/pods/0768f5e8-598d-4de6-8c68-43a3bbf69a44/volumes"
Jul 15 15:16:47.380980 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:47.380965    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3" path="/var/lib/kubelet/pods/6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3/volumes"
Jul 15 15:16:54.322197 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:54.322164    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:54.322653 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:54.322214    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:54.334577 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:54.334531    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:54.817205 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:54.817173    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:16:55.197811 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:16:55.197774    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:17:12.595649 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.595616    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"]
Jul 15 15:17:12.602831 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.602804    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3" containerName="main"
Jul 15 15:17:12.602831 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.602830    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3" containerName="main"
Jul 15 15:17:12.603031 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.602863    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0768f5e8-598d-4de6-8c68-43a3bbf69a44" containerName="main"
Jul 15 15:17:12.603031 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.602872    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0768f5e8-598d-4de6-8c68-43a3bbf69a44" containerName="main"
Jul 15 15:17:12.603135 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.603098    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0768f5e8-598d-4de6-8c68-43a3bbf69a44" containerName="main"
Jul 15 15:17:12.603135 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.603118    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a83f16b-a8a1-48a9-bfc5-4e31c7c24dc3" containerName="main"
Jul 15 15:17:12.608222 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.608195    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"]
Jul 15 15:17:12.608348 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.608273    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.612487 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.612451    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9f9f5c\"/\"kube-root-ca.crt\""
Jul 15 15:17:12.612625 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.612528    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9f9f5c\"/\"openshift-service-ca.crt\""
Jul 15 15:17:12.612625 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.612468    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9f9f5c\"/\"sub-test-model-9f9f5c-kserve-self-signed-certs\""
Jul 15 15:17:12.612867 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.612840    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9f9f5c\"/\"default-dockercfg-cgcxp\""
Jul 15 15:17:12.769327 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.769298    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-tmp-dir\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.769327 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.769328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhs9j\" (UniqueName: \"kubernetes.io/projected/e22539a9-5a72-40eb-8094-092bb18f4612-kube-api-access-lhs9j\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.769513 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.769372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-dshm\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.769513 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.769441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-model-cache\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.769513 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.769466    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-home\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.769513 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.769485    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e22539a9-5a72-40eb-8094-092bb18f4612-tls-certs\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.870126 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.870052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-model-cache\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.870126 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.870087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-home\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.870126 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.870105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e22539a9-5a72-40eb-8094-092bb18f4612-tls-certs\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.870349 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.870130    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-tmp-dir\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.870349 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.870307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhs9j\" (UniqueName: \"kubernetes.io/projected/e22539a9-5a72-40eb-8094-092bb18f4612-kube-api-access-lhs9j\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.870465 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.870394    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-dshm\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.870465 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.870442    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-model-cache\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.870567 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.870484    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-tmp-dir\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.870567 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.870537    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-home\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.872386 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.872369    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-dshm\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.872642 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.872627    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e22539a9-5a72-40eb-8094-092bb18f4612-tls-certs\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.878355 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.878331    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhs9j\" (UniqueName: \"kubernetes.io/projected/e22539a9-5a72-40eb-8094-092bb18f4612-kube-api-access-lhs9j\") pod \"sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") " pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:12.919459 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:12.919430    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:13.058162 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:13.058138    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"]
Jul 15 15:17:13.059371 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:17:13.059345    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode22539a9_5a72_40eb_8094_092bb18f4612.slice/crio-7199b66e358a25142f90ed791a3dac2348a0da79cd006d8bb4082e1fe4ada951 WatchSource:0}: Error finding container 7199b66e358a25142f90ed791a3dac2348a0da79cd006d8bb4082e1fe4ada951: Status 404 returned error can't find the container with id 7199b66e358a25142f90ed791a3dac2348a0da79cd006d8bb4082e1fe4ada951
Jul 15 15:17:13.914066 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:13.914023    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk" event={"ID":"e22539a9-5a72-40eb-8094-092bb18f4612","Type":"ContainerStarted","Data":"4dc93963ed28ec8123f5150148986a8a87b4e5614c1f088d49fa5d25a1eab29a"}
Jul 15 15:17:13.914481 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:13.914075    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk" event={"ID":"e22539a9-5a72-40eb-8094-092bb18f4612","Type":"ContainerStarted","Data":"7199b66e358a25142f90ed791a3dac2348a0da79cd006d8bb4082e1fe4ada951"}
Jul 15 15:17:13.932869 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:13.932826    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk" podStartSLOduration=1.932811565 podStartE2EDuration="1.932811565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:17:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:17:13.931530186 +0000 UTC m=+2795.078210942" watchObservedRunningTime="2026-07-15 15:17:13.932811565 +0000 UTC m=+2795.079492367"
Jul 15 15:17:17.589925 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:17.589892    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:17:22.920541 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:22.920504    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:22.920997 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:22.920558    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:22.933258 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:22.933214    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:22.975823 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:22.975800    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:17:46.788540 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:17:46.788508    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:18:01.702434 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:01.702395    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:18:07.437626 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:07.437588    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"]
Jul 15 15:18:08.377089 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:08.377053    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"]
Jul 15 15:18:21.089641 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:21.089605    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:18:22.458426 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.458395    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9" podUID="bb81f41e-83d0-495c-9387-16c94a18dc50" containerName="main" containerID="cri-o://1105399ce8ed0a925cb569353544135740061361c109f8043c4f575fc4192cfa" gracePeriod=45
Jul 15 15:18:22.701848 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.701823    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:18:22.750592 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.750531    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-home\") pod \"bb81f41e-83d0-495c-9387-16c94a18dc50\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") "
Jul 15 15:18:22.750727 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.750606    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-tmp-dir\") pod \"bb81f41e-83d0-495c-9387-16c94a18dc50\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") "
Jul 15 15:18:22.750727 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.750638    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-dshm\") pod \"bb81f41e-83d0-495c-9387-16c94a18dc50\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") "
Jul 15 15:18:22.750727 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.750705    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr5j6\" (UniqueName: \"kubernetes.io/projected/bb81f41e-83d0-495c-9387-16c94a18dc50-kube-api-access-vr5j6\") pod \"bb81f41e-83d0-495c-9387-16c94a18dc50\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") "
Jul 15 15:18:22.750918 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.750746    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-model-cache\") pod \"bb81f41e-83d0-495c-9387-16c94a18dc50\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") "
Jul 15 15:18:22.750918 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.750773    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb81f41e-83d0-495c-9387-16c94a18dc50-tls-certs\") pod \"bb81f41e-83d0-495c-9387-16c94a18dc50\" (UID: \"bb81f41e-83d0-495c-9387-16c94a18dc50\") "
Jul 15 15:18:22.750918 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.750832    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-home" (OuterVolumeSpecName: "home") pod "bb81f41e-83d0-495c-9387-16c94a18dc50" (UID: "bb81f41e-83d0-495c-9387-16c94a18dc50"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:18:22.750918 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.750894    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb81f41e-83d0-495c-9387-16c94a18dc50" (UID: "bb81f41e-83d0-495c-9387-16c94a18dc50"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:18:22.751114 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.750966    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb81f41e-83d0-495c-9387-16c94a18dc50" (UID: "bb81f41e-83d0-495c-9387-16c94a18dc50"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:18:22.751114 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.751108    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-model-cache\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:18:22.751204 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.751122    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-home\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:18:22.751204 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.751131    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-tmp-dir\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:18:22.752835 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.752813    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-dshm" (OuterVolumeSpecName: "dshm") pod "bb81f41e-83d0-495c-9387-16c94a18dc50" (UID: "bb81f41e-83d0-495c-9387-16c94a18dc50"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:18:22.752919 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.752859    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb81f41e-83d0-495c-9387-16c94a18dc50-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb81f41e-83d0-495c-9387-16c94a18dc50" (UID: "bb81f41e-83d0-495c-9387-16c94a18dc50"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:18:22.752919 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.752900    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb81f41e-83d0-495c-9387-16c94a18dc50-kube-api-access-vr5j6" (OuterVolumeSpecName: "kube-api-access-vr5j6") pod "bb81f41e-83d0-495c-9387-16c94a18dc50" (UID: "bb81f41e-83d0-495c-9387-16c94a18dc50"). InnerVolumeSpecName "kube-api-access-vr5j6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:18:22.851871 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.851840    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr5j6\" (UniqueName: \"kubernetes.io/projected/bb81f41e-83d0-495c-9387-16c94a18dc50-kube-api-access-vr5j6\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:18:22.851871 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.851870    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb81f41e-83d0-495c-9387-16c94a18dc50-tls-certs\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:18:22.851871 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:22.851880    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb81f41e-83d0-495c-9387-16c94a18dc50-dshm\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:18:23.301465 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.301427    2581 generic.go:356] "Generic (PLEG): container finished" podID="bb81f41e-83d0-495c-9387-16c94a18dc50" containerID="1105399ce8ed0a925cb569353544135740061361c109f8043c4f575fc4192cfa" exitCode=0
Jul 15 15:18:23.301625 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.301472    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"
Jul 15 15:18:23.301625 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.301467    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9" event={"ID":"bb81f41e-83d0-495c-9387-16c94a18dc50","Type":"ContainerDied","Data":"1105399ce8ed0a925cb569353544135740061361c109f8043c4f575fc4192cfa"}
Jul 15 15:18:23.301625 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.301575    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9" event={"ID":"bb81f41e-83d0-495c-9387-16c94a18dc50","Type":"ContainerDied","Data":"5ff990519641ce14572820c30505872d62b4c641349087a44fc1c0639c271244"}
Jul 15 15:18:23.301625 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.301600    2581 scope.go:117] "RemoveContainer" containerID="1105399ce8ed0a925cb569353544135740061361c109f8043c4f575fc4192cfa"
Jul 15 15:18:23.311325 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.311305    2581 scope.go:117] "RemoveContainer" containerID="1105399ce8ed0a925cb569353544135740061361c109f8043c4f575fc4192cfa"
Jul 15 15:18:23.311566 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:18:23.311546    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1105399ce8ed0a925cb569353544135740061361c109f8043c4f575fc4192cfa\": container with ID starting with 1105399ce8ed0a925cb569353544135740061361c109f8043c4f575fc4192cfa not found: ID does not exist" containerID="1105399ce8ed0a925cb569353544135740061361c109f8043c4f575fc4192cfa"
Jul 15 15:18:23.311671 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.311578    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1105399ce8ed0a925cb569353544135740061361c109f8043c4f575fc4192cfa"} err="failed to get container status \"1105399ce8ed0a925cb569353544135740061361c109f8043c4f575fc4192cfa\": rpc error: code = NotFound desc = could not find container \"1105399ce8ed0a925cb569353544135740061361c109f8043c4f575fc4192cfa\": container with ID starting with 1105399ce8ed0a925cb569353544135740061361c109f8043c4f575fc4192cfa not found: ID does not exist"
Jul 15 15:18:23.328310 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.328287    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"]
Jul 15 15:18:23.334041 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.334021    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/sub-test-model-e7a94a-kserve-5c8cdd8989-2xnm9"]
Jul 15 15:18:23.381270 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.381219    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb81f41e-83d0-495c-9387-16c94a18dc50" path="/var/lib/kubelet/pods/bb81f41e-83d0-495c-9387-16c94a18dc50/volumes"
Jul 15 15:18:23.396606 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.396575    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk" podUID="e22539a9-5a72-40eb-8094-092bb18f4612" containerName="main" containerID="cri-o://4dc93963ed28ec8123f5150148986a8a87b4e5614c1f088d49fa5d25a1eab29a" gracePeriod=45
Jul 15 15:18:23.643370 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.643349    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:18:23.657424 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.657403    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-tmp-dir\") pod \"e22539a9-5a72-40eb-8094-092bb18f4612\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") "
Jul 15 15:18:23.657527 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.657462    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhs9j\" (UniqueName: \"kubernetes.io/projected/e22539a9-5a72-40eb-8094-092bb18f4612-kube-api-access-lhs9j\") pod \"e22539a9-5a72-40eb-8094-092bb18f4612\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") "
Jul 15 15:18:23.657527 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.657482    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-model-cache\") pod \"e22539a9-5a72-40eb-8094-092bb18f4612\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") "
Jul 15 15:18:23.657527 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.657514    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e22539a9-5a72-40eb-8094-092bb18f4612-tls-certs\") pod \"e22539a9-5a72-40eb-8094-092bb18f4612\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") "
Jul 15 15:18:23.657650 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.657548    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-home\") pod \"e22539a9-5a72-40eb-8094-092bb18f4612\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") "
Jul 15 15:18:23.657650 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.657574    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-dshm\") pod \"e22539a9-5a72-40eb-8094-092bb18f4612\" (UID: \"e22539a9-5a72-40eb-8094-092bb18f4612\") "
Jul 15 15:18:23.657773 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.657651    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e22539a9-5a72-40eb-8094-092bb18f4612" (UID: "e22539a9-5a72-40eb-8094-092bb18f4612"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:18:23.657843 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.657813    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-home" (OuterVolumeSpecName: "home") pod "e22539a9-5a72-40eb-8094-092bb18f4612" (UID: "e22539a9-5a72-40eb-8094-092bb18f4612"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:18:23.657843 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.657829    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-model-cache" (OuterVolumeSpecName: "model-cache") pod "e22539a9-5a72-40eb-8094-092bb18f4612" (UID: "e22539a9-5a72-40eb-8094-092bb18f4612"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:18:23.657951 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.657852    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-tmp-dir\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:18:23.659584 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.659564    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e22539a9-5a72-40eb-8094-092bb18f4612-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e22539a9-5a72-40eb-8094-092bb18f4612" (UID: "e22539a9-5a72-40eb-8094-092bb18f4612"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:18:23.659670 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.659589    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-dshm" (OuterVolumeSpecName: "dshm") pod "e22539a9-5a72-40eb-8094-092bb18f4612" (UID: "e22539a9-5a72-40eb-8094-092bb18f4612"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:18:23.659670 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.659646    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e22539a9-5a72-40eb-8094-092bb18f4612-kube-api-access-lhs9j" (OuterVolumeSpecName: "kube-api-access-lhs9j") pod "e22539a9-5a72-40eb-8094-092bb18f4612" (UID: "e22539a9-5a72-40eb-8094-092bb18f4612"). InnerVolumeSpecName "kube-api-access-lhs9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:18:23.758215 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.758186    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhs9j\" (UniqueName: \"kubernetes.io/projected/e22539a9-5a72-40eb-8094-092bb18f4612-kube-api-access-lhs9j\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:18:23.758215 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.758212    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-model-cache\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:18:23.758377 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.758223    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e22539a9-5a72-40eb-8094-092bb18f4612-tls-certs\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:18:23.758377 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.758231    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-home\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:18:23.758377 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:23.758238    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e22539a9-5a72-40eb-8094-092bb18f4612-dshm\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:18:24.309310 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:24.309275    2581 generic.go:356] "Generic (PLEG): container finished" podID="e22539a9-5a72-40eb-8094-092bb18f4612" containerID="4dc93963ed28ec8123f5150148986a8a87b4e5614c1f088d49fa5d25a1eab29a" exitCode=0
Jul 15 15:18:24.309491 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:24.309316    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"
Jul 15 15:18:24.309491 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:24.309361    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk" event={"ID":"e22539a9-5a72-40eb-8094-092bb18f4612","Type":"ContainerDied","Data":"4dc93963ed28ec8123f5150148986a8a87b4e5614c1f088d49fa5d25a1eab29a"}
Jul 15 15:18:24.309491 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:24.309403    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk" event={"ID":"e22539a9-5a72-40eb-8094-092bb18f4612","Type":"ContainerDied","Data":"7199b66e358a25142f90ed791a3dac2348a0da79cd006d8bb4082e1fe4ada951"}
Jul 15 15:18:24.309491 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:24.309421    2581 scope.go:117] "RemoveContainer" containerID="4dc93963ed28ec8123f5150148986a8a87b4e5614c1f088d49fa5d25a1eab29a"
Jul 15 15:18:24.319054 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:24.319037    2581 scope.go:117] "RemoveContainer" containerID="4dc93963ed28ec8123f5150148986a8a87b4e5614c1f088d49fa5d25a1eab29a"
Jul 15 15:18:24.319280 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:18:24.319262    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dc93963ed28ec8123f5150148986a8a87b4e5614c1f088d49fa5d25a1eab29a\": container with ID starting with 4dc93963ed28ec8123f5150148986a8a87b4e5614c1f088d49fa5d25a1eab29a not found: ID does not exist" containerID="4dc93963ed28ec8123f5150148986a8a87b4e5614c1f088d49fa5d25a1eab29a"
Jul 15 15:18:24.319339 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:24.319293    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dc93963ed28ec8123f5150148986a8a87b4e5614c1f088d49fa5d25a1eab29a"} err="failed to get container status \"4dc93963ed28ec8123f5150148986a8a87b4e5614c1f088d49fa5d25a1eab29a\": rpc error: code = NotFound desc = could not find container \"4dc93963ed28ec8123f5150148986a8a87b4e5614c1f088d49fa5d25a1eab29a\": container with ID starting with 4dc93963ed28ec8123f5150148986a8a87b4e5614c1f088d49fa5d25a1eab29a not found: ID does not exist"
Jul 15 15:18:24.336094 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:24.336075    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"]
Jul 15 15:18:24.340036 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:24.340015    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/sub-test-model-9f9f5c-kserve-6c85b458dc-kxmdk"]
Jul 15 15:18:25.380608 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:25.380573    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e22539a9-5a72-40eb-8094-092bb18f4612" path="/var/lib/kubelet/pods/e22539a9-5a72-40eb-8094-092bb18f4612/volumes"
Jul 15 15:18:26.000418 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.000383    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"]
Jul 15 15:18:26.000828 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.000811    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb81f41e-83d0-495c-9387-16c94a18dc50" containerName="main"
Jul 15 15:18:26.000930 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.000830    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb81f41e-83d0-495c-9387-16c94a18dc50" containerName="main"
Jul 15 15:18:26.000930 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.000843    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e22539a9-5a72-40eb-8094-092bb18f4612" containerName="main"
Jul 15 15:18:26.000930 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.000850    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e22539a9-5a72-40eb-8094-092bb18f4612" containerName="main"
Jul 15 15:18:26.001081 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.000967    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb81f41e-83d0-495c-9387-16c94a18dc50" containerName="main"
Jul 15 15:18:26.001081 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.000981    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e22539a9-5a72-40eb-8094-092bb18f4612" containerName="main"
Jul 15 15:18:26.005394 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.005371    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.010402 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.010218    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e7a94a\"/\"rate-test-model-e7a94a-kserve-self-signed-certs\""
Jul 15 15:18:26.010402 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.010293    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e7a94a\"/\"openshift-service-ca.crt\""
Jul 15 15:18:26.010402 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.010325    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e7a94a\"/\"default-dockercfg-4bfkl\""
Jul 15 15:18:26.010402 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.010386    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e7a94a\"/\"kube-root-ca.crt\""
Jul 15 15:18:26.013770 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.013747    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"]
Jul 15 15:18:26.079265 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.079238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-home\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.079378 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.079270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-model-cache\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.079378 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.079295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11600393-69e1-41fa-811e-dc7484773aa1-tls-certs\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.079450 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.079377    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-dshm\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.079450 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.079395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48qqz\" (UniqueName: \"kubernetes.io/projected/11600393-69e1-41fa-811e-dc7484773aa1-kube-api-access-48qqz\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.079515 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.079464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-tmp-dir\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.180569 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.180546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-tmp-dir\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.180676 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.180583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-home\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.180676 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.180604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-model-cache\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.180676 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.180635    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11600393-69e1-41fa-811e-dc7484773aa1-tls-certs\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.180829 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.180682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-dshm\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.180829 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.180703    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48qqz\" (UniqueName: \"kubernetes.io/projected/11600393-69e1-41fa-811e-dc7484773aa1-kube-api-access-48qqz\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.181006 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.180983    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-tmp-dir\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.181045 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.181012    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-model-cache\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.181082 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.181059    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-home\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.182984 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.182957    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-dshm\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.183115 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.183098    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11600393-69e1-41fa-811e-dc7484773aa1-tls-certs\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.188367 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.188344    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48qqz\" (UniqueName: \"kubernetes.io/projected/11600393-69e1-41fa-811e-dc7484773aa1-kube-api-access-48qqz\") pod \"rate-test-model-e7a94a-kserve-7bb9c57675-2jx84\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") " pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.316347 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.316284    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:26.450263 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:26.450228    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"]
Jul 15 15:18:26.451632 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:18:26.451607    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11600393_69e1_41fa_811e_dc7484773aa1.slice/crio-d2d64d2daa70f0189e89b7fb6f004b0af8ce748f27a5ae2801a98ea476c04c05 WatchSource:0}: Error finding container d2d64d2daa70f0189e89b7fb6f004b0af8ce748f27a5ae2801a98ea476c04c05: Status 404 returned error can't find the container with id d2d64d2daa70f0189e89b7fb6f004b0af8ce748f27a5ae2801a98ea476c04c05
Jul 15 15:18:27.330019 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:27.329981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84" event={"ID":"11600393-69e1-41fa-811e-dc7484773aa1","Type":"ContainerStarted","Data":"15944797291b6d43d1a3f6a50c218905d9b0fb1b1108e75863493b5dc2214f97"}
Jul 15 15:18:27.330019 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:27.330022    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84" event={"ID":"11600393-69e1-41fa-811e-dc7484773aa1","Type":"ContainerStarted","Data":"d2d64d2daa70f0189e89b7fb6f004b0af8ce748f27a5ae2801a98ea476c04c05"}
Jul 15 15:18:27.350671 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:27.350622    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84" podStartSLOduration=2.350606667 podStartE2EDuration="2.350606667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:18:27.347178039 +0000 UTC m=+2868.493858796" watchObservedRunningTime="2026-07-15 15:18:27.350606667 +0000 UTC m=+2868.497287451"
Jul 15 15:18:33.002645 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:33.002564    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:18:36.316409 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:36.316371    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:36.316809 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:36.316432    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:36.329540 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:36.329508    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:36.398045 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:36.398017    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:18:53.204504 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.204473    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"]
Jul 15 15:18:53.207906 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.207888    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.212191 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.212170    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9f9f5c\"/\"rate-test-model-9f9f5c-kserve-self-signed-certs\""
Jul 15 15:18:53.212305 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.212170    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9f9f5c\"/\"kube-root-ca.crt\""
Jul 15 15:18:53.212482 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.212465    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9f9f5c\"/\"openshift-service-ca.crt\""
Jul 15 15:18:53.212567 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.212492    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9f9f5c\"/\"default-dockercfg-cgcxp\""
Jul 15 15:18:53.219827 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.219807    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"]
Jul 15 15:18:53.298478 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.298448    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n56zw\" (UniqueName: \"kubernetes.io/projected/363f5e85-0e8c-4fc7-8427-83606f2d743b-kube-api-access-n56zw\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.298603 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.298496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-model-cache\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.298603 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.298553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-tmp-dir\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.298603 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.298587    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-home\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.298703 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.298605    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-dshm\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.298703 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.298623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/363f5e85-0e8c-4fc7-8427-83606f2d743b-tls-certs\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.399201 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.399177    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-tmp-dir\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.399327 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.399206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-home\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.399327 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.399221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-dshm\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.399327 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.399237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/363f5e85-0e8c-4fc7-8427-83606f2d743b-tls-certs\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.399327 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.399277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n56zw\" (UniqueName: \"kubernetes.io/projected/363f5e85-0e8c-4fc7-8427-83606f2d743b-kube-api-access-n56zw\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.399327 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.399312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-model-cache\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.399637 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.399613    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-tmp-dir\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.399727 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.399663    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-home\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.399727 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.399714    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-model-cache\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.401585 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.401560    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-dshm\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.401815 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.401797    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/363f5e85-0e8c-4fc7-8427-83606f2d743b-tls-certs\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.408770 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.408726    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n56zw\" (UniqueName: \"kubernetes.io/projected/363f5e85-0e8c-4fc7-8427-83606f2d743b-kube-api-access-n56zw\") pod \"rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") " pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.517667 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.517600    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:18:53.651021 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:53.650993    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"]
Jul 15 15:18:53.653076 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:18:53.653050    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod363f5e85_0e8c_4fc7_8427_83606f2d743b.slice/crio-49fa6bffea6972884200e6072b910cc5f594ba8d4e5e48045145e4f52697ce03 WatchSource:0}: Error finding container 49fa6bffea6972884200e6072b910cc5f594ba8d4e5e48045145e4f52697ce03: Status 404 returned error can't find the container with id 49fa6bffea6972884200e6072b910cc5f594ba8d4e5e48045145e4f52697ce03
Jul 15 15:18:54.489341 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:54.489302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws" event={"ID":"363f5e85-0e8c-4fc7-8427-83606f2d743b","Type":"ContainerStarted","Data":"dab40ebae6264fad2c3d1f0bfe2facbefccddab65e107a3060a4549ea06c8a3e"}
Jul 15 15:18:54.489716 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:54.489351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws" event={"ID":"363f5e85-0e8c-4fc7-8427-83606f2d743b","Type":"ContainerStarted","Data":"49fa6bffea6972884200e6072b910cc5f594ba8d4e5e48045145e4f52697ce03"}
Jul 15 15:18:54.509449 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:54.509398    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws" podStartSLOduration=1.509383454 podStartE2EDuration="1.509383454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:18:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:18:54.507928214 +0000 UTC m=+2895.654608980" watchObservedRunningTime="2026-07-15 15:18:54.509383454 +0000 UTC m=+2895.656064259"
Jul 15 15:18:58.239933 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:18:58.239895    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:19:03.518438 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:03.518389    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:19:03.518438 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:03.518441    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:19:03.530672 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:03.530650    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:19:03.550027 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:03.549999    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:19:21.392762 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:21.392715    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:19:36.799331 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:36.799294    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:19:43.776800 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:43.776764    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"]
Jul 15 15:19:44.787775 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:44.787724    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"]
Jul 15 15:19:45.719567 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:45.719533    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7363-140105960940080"]
Jul 15 15:19:45.723207 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:45.723190    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960940080"
Jul 15 15:19:45.726540 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:45.726521    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xbz6z\""
Jul 15 15:19:45.728603 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:45.728578    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140105960940080"]
Jul 15 15:19:45.844612 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:45.844582    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66zrl\" (UniqueName: \"kubernetes.io/projected/f0ddc900-c5bc-4c86-a2a5-3e058076af15-kube-api-access-66zrl\") pod \"test-curl-7363-140105960940080\" (UID: \"f0ddc900-c5bc-4c86-a2a5-3e058076af15\") " pod="opendatahub/test-curl-7363-140105960940080"
Jul 15 15:19:45.945621 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:45.945596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66zrl\" (UniqueName: \"kubernetes.io/projected/f0ddc900-c5bc-4c86-a2a5-3e058076af15-kube-api-access-66zrl\") pod \"test-curl-7363-140105960940080\" (UID: \"f0ddc900-c5bc-4c86-a2a5-3e058076af15\") " pod="opendatahub/test-curl-7363-140105960940080"
Jul 15 15:19:45.955532 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:45.955513    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66zrl\" (UniqueName: \"kubernetes.io/projected/f0ddc900-c5bc-4c86-a2a5-3e058076af15-kube-api-access-66zrl\") pod \"test-curl-7363-140105960940080\" (UID: \"f0ddc900-c5bc-4c86-a2a5-3e058076af15\") " pod="opendatahub/test-curl-7363-140105960940080"
Jul 15 15:19:46.033090 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:46.033008    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960940080"
Jul 15 15:19:46.162507 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:46.162479    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140105960940080"]
Jul 15 15:19:46.163993 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:19:46.163964    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0ddc900_c5bc_4c86_a2a5_3e058076af15.slice/crio-4e5930109e988bec44ffce215d1aa966632c141c7262aba0c5231671c8aa0c6f WatchSource:0}: Error finding container 4e5930109e988bec44ffce215d1aa966632c141c7262aba0c5231671c8aa0c6f: Status 404 returned error can't find the container with id 4e5930109e988bec44ffce215d1aa966632c141c7262aba0c5231671c8aa0c6f
Jul 15 15:19:46.165371 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:46.165353    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:19:46.786548 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:46.786508    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140105960940080" event={"ID":"f0ddc900-c5bc-4c86-a2a5-3e058076af15","Type":"ContainerStarted","Data":"4e5930109e988bec44ffce215d1aa966632c141c7262aba0c5231671c8aa0c6f"}
Jul 15 15:19:47.800552 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:47.800517    2581 generic.go:356] "Generic (PLEG): container finished" podID="f0ddc900-c5bc-4c86-a2a5-3e058076af15" containerID="c7898e7d0b2ad8bb6804a2d36b531becbecd7d00e527a96ed57b6b375cc0c40c" exitCode=0
Jul 15 15:19:47.800967 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:47.800597    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140105960940080" event={"ID":"f0ddc900-c5bc-4c86-a2a5-3e058076af15","Type":"ContainerDied","Data":"c7898e7d0b2ad8bb6804a2d36b531becbecd7d00e527a96ed57b6b375cc0c40c"}
Jul 15 15:19:48.935574 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:48.935551    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960940080"
Jul 15 15:19:48.972169 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:48.972143    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7363-140105960940080_f0ddc900-c5bc-4c86-a2a5-3e058076af15/test-curl-7363-140105960940080/0.log"
Jul 15 15:19:48.996137 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:48.996110    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7363-140105960940080"]
Jul 15 15:19:48.998487 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:48.998469    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7363-140105960940080"]
Jul 15 15:19:49.075748 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:49.075673    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66zrl\" (UniqueName: \"kubernetes.io/projected/f0ddc900-c5bc-4c86-a2a5-3e058076af15-kube-api-access-66zrl\") pod \"f0ddc900-c5bc-4c86-a2a5-3e058076af15\" (UID: \"f0ddc900-c5bc-4c86-a2a5-3e058076af15\") "
Jul 15 15:19:49.077771 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:49.077745    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ddc900-c5bc-4c86-a2a5-3e058076af15-kube-api-access-66zrl" (OuterVolumeSpecName: "kube-api-access-66zrl") pod "f0ddc900-c5bc-4c86-a2a5-3e058076af15" (UID: "f0ddc900-c5bc-4c86-a2a5-3e058076af15"). InnerVolumeSpecName "kube-api-access-66zrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:19:49.176750 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:49.176709    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66zrl\" (UniqueName: \"kubernetes.io/projected/f0ddc900-c5bc-4c86-a2a5-3e058076af15-kube-api-access-66zrl\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:19:49.381322 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:49.381240    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ddc900-c5bc-4c86-a2a5-3e058076af15" path="/var/lib/kubelet/pods/f0ddc900-c5bc-4c86-a2a5-3e058076af15/volumes"
Jul 15 15:19:49.813091 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:49.813064    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960940080"
Jul 15 15:19:49.813286 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:49.813132    2581 scope.go:117] "RemoveContainer" containerID="c7898e7d0b2ad8bb6804a2d36b531becbecd7d00e527a96ed57b6b375cc0c40c"
Jul 15 15:19:51.391695 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:51.391662    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:19:51.914459 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:51.914427    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7363-140105960748784"]
Jul 15 15:19:51.914865 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:51.914840    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ddc900-c5bc-4c86-a2a5-3e058076af15" containerName="test-curl-7363-140105960940080"
Jul 15 15:19:51.914865 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:51.914864    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ddc900-c5bc-4c86-a2a5-3e058076af15" containerName="test-curl-7363-140105960940080"
Jul 15 15:19:51.914982 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:51.914952    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ddc900-c5bc-4c86-a2a5-3e058076af15" containerName="test-curl-7363-140105960940080"
Jul 15 15:19:51.917532 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:51.917516    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960748784"
Jul 15 15:19:51.920591 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:51.920542    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xbz6z\""
Jul 15 15:19:51.924138 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:51.924117    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140105960748784"]
Jul 15 15:19:52.000497 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:52.000468    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrjrf\" (UniqueName: \"kubernetes.io/projected/d738461c-a3e5-4692-a0ce-25060f72456d-kube-api-access-wrjrf\") pod \"test-curl-7363-140105960748784\" (UID: \"d738461c-a3e5-4692-a0ce-25060f72456d\") " pod="opendatahub/test-curl-7363-140105960748784"
Jul 15 15:19:52.101833 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:52.101799    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrjrf\" (UniqueName: \"kubernetes.io/projected/d738461c-a3e5-4692-a0ce-25060f72456d-kube-api-access-wrjrf\") pod \"test-curl-7363-140105960748784\" (UID: \"d738461c-a3e5-4692-a0ce-25060f72456d\") " pod="opendatahub/test-curl-7363-140105960748784"
Jul 15 15:19:52.110949 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:52.110920    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrjrf\" (UniqueName: \"kubernetes.io/projected/d738461c-a3e5-4692-a0ce-25060f72456d-kube-api-access-wrjrf\") pod \"test-curl-7363-140105960748784\" (UID: \"d738461c-a3e5-4692-a0ce-25060f72456d\") " pod="opendatahub/test-curl-7363-140105960748784"
Jul 15 15:19:52.230221 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:52.230198    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960748784"
Jul 15 15:19:52.361420 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:52.361394    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140105960748784"]
Jul 15 15:19:52.363216 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:19:52.363189    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd738461c_a3e5_4692_a0ce_25060f72456d.slice/crio-ffb94301e35d516ccc618d4d55812df9bd86ac0356c2423873b6427c01676582 WatchSource:0}: Error finding container ffb94301e35d516ccc618d4d55812df9bd86ac0356c2423873b6427c01676582: Status 404 returned error can't find the container with id ffb94301e35d516ccc618d4d55812df9bd86ac0356c2423873b6427c01676582
Jul 15 15:19:52.832856 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:52.832826    2581 generic.go:356] "Generic (PLEG): container finished" podID="d738461c-a3e5-4692-a0ce-25060f72456d" containerID="9b0a489a6ebc8df1ea7bed19dcf1526c2f66e8cddaf374cc3d8080e1d4d16cc3" exitCode=0
Jul 15 15:19:52.833168 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:52.832908    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140105960748784" event={"ID":"d738461c-a3e5-4692-a0ce-25060f72456d","Type":"ContainerDied","Data":"9b0a489a6ebc8df1ea7bed19dcf1526c2f66e8cddaf374cc3d8080e1d4d16cc3"}
Jul 15 15:19:52.833168 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:52.832948    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140105960748784" event={"ID":"d738461c-a3e5-4692-a0ce-25060f72456d","Type":"ContainerStarted","Data":"ffb94301e35d516ccc618d4d55812df9bd86ac0356c2423873b6427c01676582"}
Jul 15 15:19:53.974621 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:53.974599    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960748784"
Jul 15 15:19:53.996608 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:53.996583    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7363-140105960748784_d738461c-a3e5-4692-a0ce-25060f72456d/test-curl-7363-140105960748784/0.log"
Jul 15 15:19:54.021459 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.021435    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7363-140105960748784"]
Jul 15 15:19:54.023897 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.023878    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7363-140105960748784"]
Jul 15 15:19:54.119895 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.119836    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrjrf\" (UniqueName: \"kubernetes.io/projected/d738461c-a3e5-4692-a0ce-25060f72456d-kube-api-access-wrjrf\") pod \"d738461c-a3e5-4692-a0ce-25060f72456d\" (UID: \"d738461c-a3e5-4692-a0ce-25060f72456d\") "
Jul 15 15:19:54.121884 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.121864    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d738461c-a3e5-4692-a0ce-25060f72456d-kube-api-access-wrjrf" (OuterVolumeSpecName: "kube-api-access-wrjrf") pod "d738461c-a3e5-4692-a0ce-25060f72456d" (UID: "d738461c-a3e5-4692-a0ce-25060f72456d"). InnerVolumeSpecName "kube-api-access-wrjrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:19:54.137125 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.137091    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7363-140105960748784"]
Jul 15 15:19:54.137577 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.137559    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d738461c-a3e5-4692-a0ce-25060f72456d" containerName="test-curl-7363-140105960748784"
Jul 15 15:19:54.137674 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.137578    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d738461c-a3e5-4692-a0ce-25060f72456d" containerName="test-curl-7363-140105960748784"
Jul 15 15:19:54.137759 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.137681    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d738461c-a3e5-4692-a0ce-25060f72456d" containerName="test-curl-7363-140105960748784"
Jul 15 15:19:54.140631 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.140614    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960748784"
Jul 15 15:19:54.146950 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.146930    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140105960748784"]
Jul 15 15:19:54.220362 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.220338    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n7r9\" (UniqueName: \"kubernetes.io/projected/b6e38805-b472-449d-b908-2e024a574502-kube-api-access-8n7r9\") pod \"test-curl-7363-140105960748784\" (UID: \"b6e38805-b472-449d-b908-2e024a574502\") " pod="opendatahub/test-curl-7363-140105960748784"
Jul 15 15:19:54.220482 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.220440    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrjrf\" (UniqueName: \"kubernetes.io/projected/d738461c-a3e5-4692-a0ce-25060f72456d-kube-api-access-wrjrf\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:19:54.320944 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.320917    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n7r9\" (UniqueName: \"kubernetes.io/projected/b6e38805-b472-449d-b908-2e024a574502-kube-api-access-8n7r9\") pod \"test-curl-7363-140105960748784\" (UID: \"b6e38805-b472-449d-b908-2e024a574502\") " pod="opendatahub/test-curl-7363-140105960748784"
Jul 15 15:19:54.330659 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.330628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n7r9\" (UniqueName: \"kubernetes.io/projected/b6e38805-b472-449d-b908-2e024a574502-kube-api-access-8n7r9\") pod \"test-curl-7363-140105960748784\" (UID: \"b6e38805-b472-449d-b908-2e024a574502\") " pod="opendatahub/test-curl-7363-140105960748784"
Jul 15 15:19:54.450636 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.450601    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960748784"
Jul 15 15:19:54.587509 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.587476    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140105960748784"]
Jul 15 15:19:54.588616 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:19:54.588583    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6e38805_b472_449d_b908_2e024a574502.slice/crio-74b63cf4bda8a914857b651bb37b6f4ad2dcbab5880c444dc0b90eb42db03a85 WatchSource:0}: Error finding container 74b63cf4bda8a914857b651bb37b6f4ad2dcbab5880c444dc0b90eb42db03a85: Status 404 returned error can't find the container with id 74b63cf4bda8a914857b651bb37b6f4ad2dcbab5880c444dc0b90eb42db03a85
Jul 15 15:19:54.846641 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.846573    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140105960748784" event={"ID":"b6e38805-b472-449d-b908-2e024a574502","Type":"ContainerStarted","Data":"74b63cf4bda8a914857b651bb37b6f4ad2dcbab5880c444dc0b90eb42db03a85"}
Jul 15 15:19:54.847824 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.847804    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960748784"
Jul 15 15:19:54.847908 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.847851    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffb94301e35d516ccc618d4d55812df9bd86ac0356c2423873b6427c01676582"
Jul 15 15:19:54.859840 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:54.859806    2581 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7363-140105960748784" oldPodUID="d738461c-a3e5-4692-a0ce-25060f72456d" podUID="b6e38805-b472-449d-b908-2e024a574502"
Jul 15 15:19:55.381133 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:55.381094    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d738461c-a3e5-4692-a0ce-25060f72456d" path="/var/lib/kubelet/pods/d738461c-a3e5-4692-a0ce-25060f72456d/volumes"
Jul 15 15:19:55.855221 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:55.855188    2581 generic.go:356] "Generic (PLEG): container finished" podID="b6e38805-b472-449d-b908-2e024a574502" containerID="55231d1c0373ff4db0fa462afca9fb1ba6051e5248847aae9598e6d298633d63" exitCode=0
Jul 15 15:19:55.855410 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:55.855244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140105960748784" event={"ID":"b6e38805-b472-449d-b908-2e024a574502","Type":"ContainerDied","Data":"55231d1c0373ff4db0fa462afca9fb1ba6051e5248847aae9598e6d298633d63"}
Jul 15 15:19:56.997616 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:56.997596    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960748784"
Jul 15 15:19:57.022320 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.022297    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7363-140105960748784_b6e38805-b472-449d-b908-2e024a574502/test-curl-7363-140105960748784/0.log"
Jul 15 15:19:57.048333 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.048313    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7363-140105960748784"]
Jul 15 15:19:57.050769 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.050746    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7363-140105960748784"]
Jul 15 15:19:57.145611 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.145549    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n7r9\" (UniqueName: \"kubernetes.io/projected/b6e38805-b472-449d-b908-2e024a574502-kube-api-access-8n7r9\") pod \"b6e38805-b472-449d-b908-2e024a574502\" (UID: \"b6e38805-b472-449d-b908-2e024a574502\") "
Jul 15 15:19:57.147561 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.147538    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6e38805-b472-449d-b908-2e024a574502-kube-api-access-8n7r9" (OuterVolumeSpecName: "kube-api-access-8n7r9") pod "b6e38805-b472-449d-b908-2e024a574502" (UID: "b6e38805-b472-449d-b908-2e024a574502"). InnerVolumeSpecName "kube-api-access-8n7r9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:19:57.175038 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.175015    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7363-140105961878848"]
Jul 15 15:19:57.175400 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.175386    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e38805-b472-449d-b908-2e024a574502" containerName="test-curl-7363-140105960748784"
Jul 15 15:19:57.175448 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.175402    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e38805-b472-449d-b908-2e024a574502" containerName="test-curl-7363-140105960748784"
Jul 15 15:19:57.175480 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.175471    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6e38805-b472-449d-b908-2e024a574502" containerName="test-curl-7363-140105960748784"
Jul 15 15:19:57.178234 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.178218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105961878848"
Jul 15 15:19:57.187320 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.187298    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140105961878848"]
Jul 15 15:19:57.246179 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.246143    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n7r9\" (UniqueName: \"kubernetes.io/projected/b6e38805-b472-449d-b908-2e024a574502-kube-api-access-8n7r9\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:19:57.347574 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.347539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6fsg\" (UniqueName: \"kubernetes.io/projected/43daded0-1d05-4cc8-a5c1-e3fc1f66be88-kube-api-access-m6fsg\") pod \"test-curl-7363-140105961878848\" (UID: \"43daded0-1d05-4cc8-a5c1-e3fc1f66be88\") " pod="opendatahub/test-curl-7363-140105961878848"
Jul 15 15:19:57.386625 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.386595    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6e38805-b472-449d-b908-2e024a574502" path="/var/lib/kubelet/pods/b6e38805-b472-449d-b908-2e024a574502/volumes"
Jul 15 15:19:57.448402 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.448373    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6fsg\" (UniqueName: \"kubernetes.io/projected/43daded0-1d05-4cc8-a5c1-e3fc1f66be88-kube-api-access-m6fsg\") pod \"test-curl-7363-140105961878848\" (UID: \"43daded0-1d05-4cc8-a5c1-e3fc1f66be88\") " pod="opendatahub/test-curl-7363-140105961878848"
Jul 15 15:19:57.458325 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.458297    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6fsg\" (UniqueName: \"kubernetes.io/projected/43daded0-1d05-4cc8-a5c1-e3fc1f66be88-kube-api-access-m6fsg\") pod \"test-curl-7363-140105961878848\" (UID: \"43daded0-1d05-4cc8-a5c1-e3fc1f66be88\") " pod="opendatahub/test-curl-7363-140105961878848"
Jul 15 15:19:57.488288 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.488265    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105961878848"
Jul 15 15:19:57.619376 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.619349    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140105961878848"]
Jul 15 15:19:57.620396 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:19:57.620366    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43daded0_1d05_4cc8_a5c1_e3fc1f66be88.slice/crio-73cbea555791204ad41de9e9a89a11f1d2288fb7c681a2da07610fbad34224e4 WatchSource:0}: Error finding container 73cbea555791204ad41de9e9a89a11f1d2288fb7c681a2da07610fbad34224e4: Status 404 returned error can't find the container with id 73cbea555791204ad41de9e9a89a11f1d2288fb7c681a2da07610fbad34224e4
Jul 15 15:19:57.868108 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.868036    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960748784"
Jul 15 15:19:57.868108 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.868042    2581 scope.go:117] "RemoveContainer" containerID="55231d1c0373ff4db0fa462afca9fb1ba6051e5248847aae9598e6d298633d63"
Jul 15 15:19:57.869495 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:57.869299    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140105961878848" event={"ID":"43daded0-1d05-4cc8-a5c1-e3fc1f66be88","Type":"ContainerStarted","Data":"73cbea555791204ad41de9e9a89a11f1d2288fb7c681a2da07610fbad34224e4"}
Jul 15 15:19:58.003172 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:19:58.003147    2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43daded0_1d05_4cc8_a5c1_e3fc1f66be88.slice/crio-2018c62dba22d7008c21e9a191b5fe9e5862f08e9581aedf73b260c9bfa02063.scope\": RecentStats: unable to find data in memory cache]"
Jul 15 15:19:58.796570 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:58.796528    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84" podUID="11600393-69e1-41fa-811e-dc7484773aa1" containerName="main" containerID="cri-o://15944797291b6d43d1a3f6a50c218905d9b0fb1b1108e75863493b5dc2214f97" gracePeriod=45
Jul 15 15:19:58.878446 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:58.878415    2581 generic.go:356] "Generic (PLEG): container finished" podID="43daded0-1d05-4cc8-a5c1-e3fc1f66be88" containerID="2018c62dba22d7008c21e9a191b5fe9e5862f08e9581aedf73b260c9bfa02063" exitCode=0
Jul 15 15:19:58.878576 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:58.878498    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140105961878848" event={"ID":"43daded0-1d05-4cc8-a5c1-e3fc1f66be88","Type":"ContainerDied","Data":"2018c62dba22d7008c21e9a191b5fe9e5862f08e9581aedf73b260c9bfa02063"}
Jul 15 15:19:59.058090 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.058033    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:19:59.163606 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.163565    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48qqz\" (UniqueName: \"kubernetes.io/projected/11600393-69e1-41fa-811e-dc7484773aa1-kube-api-access-48qqz\") pod \"11600393-69e1-41fa-811e-dc7484773aa1\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") "
Jul 15 15:19:59.163606 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.163608    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-tmp-dir\") pod \"11600393-69e1-41fa-811e-dc7484773aa1\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") "
Jul 15 15:19:59.163857 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.163666    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-home\") pod \"11600393-69e1-41fa-811e-dc7484773aa1\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") "
Jul 15 15:19:59.163857 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.163682    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-dshm\") pod \"11600393-69e1-41fa-811e-dc7484773aa1\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") "
Jul 15 15:19:59.163857 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.163708    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-model-cache\") pod \"11600393-69e1-41fa-811e-dc7484773aa1\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") "
Jul 15 15:19:59.163857 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.163769    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11600393-69e1-41fa-811e-dc7484773aa1-tls-certs\") pod \"11600393-69e1-41fa-811e-dc7484773aa1\" (UID: \"11600393-69e1-41fa-811e-dc7484773aa1\") "
Jul 15 15:19:59.164061 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.163976    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "11600393-69e1-41fa-811e-dc7484773aa1" (UID: "11600393-69e1-41fa-811e-dc7484773aa1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:19:59.164061 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.163986    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-home" (OuterVolumeSpecName: "home") pod "11600393-69e1-41fa-811e-dc7484773aa1" (UID: "11600393-69e1-41fa-811e-dc7484773aa1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:19:59.164061 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.164025    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-model-cache" (OuterVolumeSpecName: "model-cache") pod "11600393-69e1-41fa-811e-dc7484773aa1" (UID: "11600393-69e1-41fa-811e-dc7484773aa1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:19:59.165709 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.165687    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-dshm" (OuterVolumeSpecName: "dshm") pod "11600393-69e1-41fa-811e-dc7484773aa1" (UID: "11600393-69e1-41fa-811e-dc7484773aa1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:19:59.165823 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.165722    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11600393-69e1-41fa-811e-dc7484773aa1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "11600393-69e1-41fa-811e-dc7484773aa1" (UID: "11600393-69e1-41fa-811e-dc7484773aa1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:19:59.165823 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.165727    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11600393-69e1-41fa-811e-dc7484773aa1-kube-api-access-48qqz" (OuterVolumeSpecName: "kube-api-access-48qqz") pod "11600393-69e1-41fa-811e-dc7484773aa1" (UID: "11600393-69e1-41fa-811e-dc7484773aa1"). InnerVolumeSpecName "kube-api-access-48qqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:19:59.265113 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.265093    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48qqz\" (UniqueName: \"kubernetes.io/projected/11600393-69e1-41fa-811e-dc7484773aa1-kube-api-access-48qqz\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:19:59.265113 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.265112    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-tmp-dir\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:19:59.265245 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.265122    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-home\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:19:59.265245 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.265131    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-dshm\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:19:59.265245 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.265138    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11600393-69e1-41fa-811e-dc7484773aa1-model-cache\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:19:59.265245 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.265146    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11600393-69e1-41fa-811e-dc7484773aa1-tls-certs\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:19:59.808305 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.808271    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws" podUID="363f5e85-0e8c-4fc7-8427-83606f2d743b" containerName="main" containerID="cri-o://dab40ebae6264fad2c3d1f0bfe2facbefccddab65e107a3060a4549ea06c8a3e" gracePeriod=45
Jul 15 15:19:59.885441 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.885408    2581 generic.go:356] "Generic (PLEG): container finished" podID="11600393-69e1-41fa-811e-dc7484773aa1" containerID="15944797291b6d43d1a3f6a50c218905d9b0fb1b1108e75863493b5dc2214f97" exitCode=0
Jul 15 15:19:59.885567 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.885448    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"
Jul 15 15:19:59.885567 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.885489    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84" event={"ID":"11600393-69e1-41fa-811e-dc7484773aa1","Type":"ContainerDied","Data":"15944797291b6d43d1a3f6a50c218905d9b0fb1b1108e75863493b5dc2214f97"}
Jul 15 15:19:59.885567 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.885527    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84" event={"ID":"11600393-69e1-41fa-811e-dc7484773aa1","Type":"ContainerDied","Data":"d2d64d2daa70f0189e89b7fb6f004b0af8ce748f27a5ae2801a98ea476c04c05"}
Jul 15 15:19:59.885567 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.885549    2581 scope.go:117] "RemoveContainer" containerID="15944797291b6d43d1a3f6a50c218905d9b0fb1b1108e75863493b5dc2214f97"
Jul 15 15:19:59.903905 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.903872    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"]
Jul 15 15:19:59.909103 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.909075    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e7a94a/rate-test-model-e7a94a-kserve-7bb9c57675-2jx84"]
Jul 15 15:19:59.920341 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.920228    2581 scope.go:117] "RemoveContainer" containerID="15944797291b6d43d1a3f6a50c218905d9b0fb1b1108e75863493b5dc2214f97"
Jul 15 15:19:59.920587 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:19:59.920558    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15944797291b6d43d1a3f6a50c218905d9b0fb1b1108e75863493b5dc2214f97\": container with ID starting with 15944797291b6d43d1a3f6a50c218905d9b0fb1b1108e75863493b5dc2214f97 not found: ID does not exist" containerID="15944797291b6d43d1a3f6a50c218905d9b0fb1b1108e75863493b5dc2214f97"
Jul 15 15:19:59.920642 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:19:59.920597    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15944797291b6d43d1a3f6a50c218905d9b0fb1b1108e75863493b5dc2214f97"} err="failed to get container status \"15944797291b6d43d1a3f6a50c218905d9b0fb1b1108e75863493b5dc2214f97\": rpc error: code = NotFound desc = could not find container \"15944797291b6d43d1a3f6a50c218905d9b0fb1b1108e75863493b5dc2214f97\": container with ID starting with 15944797291b6d43d1a3f6a50c218905d9b0fb1b1108e75863493b5dc2214f97 not found: ID does not exist"
Jul 15 15:20:00.020597 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.020561    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105961878848"
Jul 15 15:20:00.042417 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.042387    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7363-140105961878848_43daded0-1d05-4cc8-a5c1-e3fc1f66be88/test-curl-7363-140105961878848/0.log"
Jul 15 15:20:00.068713 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.068684    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7363-140105961878848"]
Jul 15 15:20:00.071079 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.071059    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7363-140105961878848"]
Jul 15 15:20:00.086176 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.086155    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:20:00.172988 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.172942    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-dshm\") pod \"363f5e85-0e8c-4fc7-8427-83606f2d743b\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") "
Jul 15 15:20:00.173183 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.173026    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n56zw\" (UniqueName: \"kubernetes.io/projected/363f5e85-0e8c-4fc7-8427-83606f2d743b-kube-api-access-n56zw\") pod \"363f5e85-0e8c-4fc7-8427-83606f2d743b\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") "
Jul 15 15:20:00.173183 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.173047    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-tmp-dir\") pod \"363f5e85-0e8c-4fc7-8427-83606f2d743b\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") "
Jul 15 15:20:00.173183 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.173096    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6fsg\" (UniqueName: \"kubernetes.io/projected/43daded0-1d05-4cc8-a5c1-e3fc1f66be88-kube-api-access-m6fsg\") pod \"43daded0-1d05-4cc8-a5c1-e3fc1f66be88\" (UID: \"43daded0-1d05-4cc8-a5c1-e3fc1f66be88\") "
Jul 15 15:20:00.173183 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.173124    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/363f5e85-0e8c-4fc7-8427-83606f2d743b-tls-certs\") pod \"363f5e85-0e8c-4fc7-8427-83606f2d743b\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") "
Jul 15 15:20:00.173426 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.173187    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-model-cache\") pod \"363f5e85-0e8c-4fc7-8427-83606f2d743b\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") "
Jul 15 15:20:00.173426 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.173209    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-home\") pod \"363f5e85-0e8c-4fc7-8427-83606f2d743b\" (UID: \"363f5e85-0e8c-4fc7-8427-83606f2d743b\") "
Jul 15 15:20:00.173426 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.173413    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "363f5e85-0e8c-4fc7-8427-83606f2d743b" (UID: "363f5e85-0e8c-4fc7-8427-83606f2d743b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:20:00.173585 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.173536    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-model-cache" (OuterVolumeSpecName: "model-cache") pod "363f5e85-0e8c-4fc7-8427-83606f2d743b" (UID: "363f5e85-0e8c-4fc7-8427-83606f2d743b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:20:00.173634 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.173547    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-tmp-dir\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:00.173634 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.173619    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-home" (OuterVolumeSpecName: "home") pod "363f5e85-0e8c-4fc7-8427-83606f2d743b" (UID: "363f5e85-0e8c-4fc7-8427-83606f2d743b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:20:00.175344 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.175322    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-dshm" (OuterVolumeSpecName: "dshm") pod "363f5e85-0e8c-4fc7-8427-83606f2d743b" (UID: "363f5e85-0e8c-4fc7-8427-83606f2d743b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:20:00.175463 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.175348    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43daded0-1d05-4cc8-a5c1-e3fc1f66be88-kube-api-access-m6fsg" (OuterVolumeSpecName: "kube-api-access-m6fsg") pod "43daded0-1d05-4cc8-a5c1-e3fc1f66be88" (UID: "43daded0-1d05-4cc8-a5c1-e3fc1f66be88"). InnerVolumeSpecName "kube-api-access-m6fsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:20:00.175582 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.175564    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/363f5e85-0e8c-4fc7-8427-83606f2d743b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "363f5e85-0e8c-4fc7-8427-83606f2d743b" (UID: "363f5e85-0e8c-4fc7-8427-83606f2d743b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:20:00.175650 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.175576    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/363f5e85-0e8c-4fc7-8427-83606f2d743b-kube-api-access-n56zw" (OuterVolumeSpecName: "kube-api-access-n56zw") pod "363f5e85-0e8c-4fc7-8427-83606f2d743b" (UID: "363f5e85-0e8c-4fc7-8427-83606f2d743b"). InnerVolumeSpecName "kube-api-access-n56zw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:20:00.231453 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.231414    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7363-140105961878848"]
Jul 15 15:20:00.231829 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.231815    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11600393-69e1-41fa-811e-dc7484773aa1" containerName="main"
Jul 15 15:20:00.231888 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.231833    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="11600393-69e1-41fa-811e-dc7484773aa1" containerName="main"
Jul 15 15:20:00.231888 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.231845    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43daded0-1d05-4cc8-a5c1-e3fc1f66be88" containerName="test-curl-7363-140105961878848"
Jul 15 15:20:00.231888 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.231851    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="43daded0-1d05-4cc8-a5c1-e3fc1f66be88" containerName="test-curl-7363-140105961878848"
Jul 15 15:20:00.231888 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.231858    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="363f5e85-0e8c-4fc7-8427-83606f2d743b" containerName="main"
Jul 15 15:20:00.231888 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.231866    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="363f5e85-0e8c-4fc7-8427-83606f2d743b" containerName="main"
Jul 15 15:20:00.232036 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.231957    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="43daded0-1d05-4cc8-a5c1-e3fc1f66be88" containerName="test-curl-7363-140105961878848"
Jul 15 15:20:00.232036 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.231970    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="363f5e85-0e8c-4fc7-8427-83606f2d743b" containerName="main"
Jul 15 15:20:00.232036 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.231977    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="11600393-69e1-41fa-811e-dc7484773aa1" containerName="main"
Jul 15 15:20:00.235081 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.235066    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105961878848"
Jul 15 15:20:00.250522 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.250497    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140105961878848"]
Jul 15 15:20:00.275130 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.275097    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n56zw\" (UniqueName: \"kubernetes.io/projected/363f5e85-0e8c-4fc7-8427-83606f2d743b-kube-api-access-n56zw\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:00.275130 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.275125    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6fsg\" (UniqueName: \"kubernetes.io/projected/43daded0-1d05-4cc8-a5c1-e3fc1f66be88-kube-api-access-m6fsg\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:00.275314 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.275138    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/363f5e85-0e8c-4fc7-8427-83606f2d743b-tls-certs\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:00.275314 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.275151    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-model-cache\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:00.275314 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.275161    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-home\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:00.275314 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.275173    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/363f5e85-0e8c-4fc7-8427-83606f2d743b-dshm\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:00.376038 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.375936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghn6f\" (UniqueName: \"kubernetes.io/projected/dd4c41fb-42c4-4629-89db-7ac8ae61495c-kube-api-access-ghn6f\") pod \"test-curl-7363-140105961878848\" (UID: \"dd4c41fb-42c4-4629-89db-7ac8ae61495c\") " pod="opendatahub/test-curl-7363-140105961878848"
Jul 15 15:20:00.477142 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.477097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghn6f\" (UniqueName: \"kubernetes.io/projected/dd4c41fb-42c4-4629-89db-7ac8ae61495c-kube-api-access-ghn6f\") pod \"test-curl-7363-140105961878848\" (UID: \"dd4c41fb-42c4-4629-89db-7ac8ae61495c\") " pod="opendatahub/test-curl-7363-140105961878848"
Jul 15 15:20:00.485993 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.485966    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghn6f\" (UniqueName: \"kubernetes.io/projected/dd4c41fb-42c4-4629-89db-7ac8ae61495c-kube-api-access-ghn6f\") pod \"test-curl-7363-140105961878848\" (UID: \"dd4c41fb-42c4-4629-89db-7ac8ae61495c\") " pod="opendatahub/test-curl-7363-140105961878848"
Jul 15 15:20:00.544571 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.544536    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105961878848"
Jul 15 15:20:00.675074 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.675047    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140105961878848"]
Jul 15 15:20:00.676501 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:20:00.676474    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd4c41fb_42c4_4629_89db_7ac8ae61495c.slice/crio-aa0090ddaffc01d29e27c6d7a6ef02887b5b0d96a7d1ed3ca8113e1b46d9f7db WatchSource:0}: Error finding container aa0090ddaffc01d29e27c6d7a6ef02887b5b0d96a7d1ed3ca8113e1b46d9f7db: Status 404 returned error can't find the container with id aa0090ddaffc01d29e27c6d7a6ef02887b5b0d96a7d1ed3ca8113e1b46d9f7db
Jul 15 15:20:00.899057 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.898973    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105961878848"
Jul 15 15:20:00.899057 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.898982    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73cbea555791204ad41de9e9a89a11f1d2288fb7c681a2da07610fbad34224e4"
Jul 15 15:20:00.901151 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.901122    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140105961878848" event={"ID":"dd4c41fb-42c4-4629-89db-7ac8ae61495c","Type":"ContainerStarted","Data":"aa0090ddaffc01d29e27c6d7a6ef02887b5b0d96a7d1ed3ca8113e1b46d9f7db"}
Jul 15 15:20:00.902348 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.902328    2581 generic.go:356] "Generic (PLEG): container finished" podID="363f5e85-0e8c-4fc7-8427-83606f2d743b" containerID="dab40ebae6264fad2c3d1f0bfe2facbefccddab65e107a3060a4549ea06c8a3e" exitCode=0
Jul 15 15:20:00.902454 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.902369    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws" event={"ID":"363f5e85-0e8c-4fc7-8427-83606f2d743b","Type":"ContainerDied","Data":"dab40ebae6264fad2c3d1f0bfe2facbefccddab65e107a3060a4549ea06c8a3e"}
Jul 15 15:20:00.902454 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.902372    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"
Jul 15 15:20:00.902454 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.902400    2581 scope.go:117] "RemoveContainer" containerID="dab40ebae6264fad2c3d1f0bfe2facbefccddab65e107a3060a4549ea06c8a3e"
Jul 15 15:20:00.902652 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.902390    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws" event={"ID":"363f5e85-0e8c-4fc7-8427-83606f2d743b","Type":"ContainerDied","Data":"49fa6bffea6972884200e6072b910cc5f594ba8d4e5e48045145e4f52697ce03"}
Jul 15 15:20:00.913276 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.913254    2581 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7363-140105961878848" oldPodUID="43daded0-1d05-4cc8-a5c1-e3fc1f66be88" podUID="dd4c41fb-42c4-4629-89db-7ac8ae61495c"
Jul 15 15:20:00.913425 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.913414    2581 scope.go:117] "RemoveContainer" containerID="dab40ebae6264fad2c3d1f0bfe2facbefccddab65e107a3060a4549ea06c8a3e"
Jul 15 15:20:00.913663 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:20:00.913648    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dab40ebae6264fad2c3d1f0bfe2facbefccddab65e107a3060a4549ea06c8a3e\": container with ID starting with dab40ebae6264fad2c3d1f0bfe2facbefccddab65e107a3060a4549ea06c8a3e not found: ID does not exist" containerID="dab40ebae6264fad2c3d1f0bfe2facbefccddab65e107a3060a4549ea06c8a3e"
Jul 15 15:20:00.913702 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.913670    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dab40ebae6264fad2c3d1f0bfe2facbefccddab65e107a3060a4549ea06c8a3e"} err="failed to get container status \"dab40ebae6264fad2c3d1f0bfe2facbefccddab65e107a3060a4549ea06c8a3e\": rpc error: code = NotFound desc = could not find container \"dab40ebae6264fad2c3d1f0bfe2facbefccddab65e107a3060a4549ea06c8a3e\": container with ID starting with dab40ebae6264fad2c3d1f0bfe2facbefccddab65e107a3060a4549ea06c8a3e not found: ID does not exist"
Jul 15 15:20:00.927973 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.927953    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"]
Jul 15 15:20:00.934591 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:00.934572    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-9f9f5c/rate-test-model-9f9f5c-kserve-58c786bb4c-dxgws"]
Jul 15 15:20:01.380252 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:01.380221    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11600393-69e1-41fa-811e-dc7484773aa1" path="/var/lib/kubelet/pods/11600393-69e1-41fa-811e-dc7484773aa1/volumes"
Jul 15 15:20:01.380661 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:01.380609    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="363f5e85-0e8c-4fc7-8427-83606f2d743b" path="/var/lib/kubelet/pods/363f5e85-0e8c-4fc7-8427-83606f2d743b/volumes"
Jul 15 15:20:01.380920 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:01.380907    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43daded0-1d05-4cc8-a5c1-e3fc1f66be88" path="/var/lib/kubelet/pods/43daded0-1d05-4cc8-a5c1-e3fc1f66be88/volumes"
Jul 15 15:20:01.910296 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:01.910260    2581 generic.go:356] "Generic (PLEG): container finished" podID="dd4c41fb-42c4-4629-89db-7ac8ae61495c" containerID="1dc0babfd63088eff5c14cfb2c3f0339fe14f2bfae7b3efa3f113454c39b3aa4" exitCode=0
Jul 15 15:20:01.910481 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:01.910339    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140105961878848" event={"ID":"dd4c41fb-42c4-4629-89db-7ac8ae61495c","Type":"ContainerDied","Data":"1dc0babfd63088eff5c14cfb2c3f0339fe14f2bfae7b3efa3f113454c39b3aa4"}
Jul 15 15:20:03.058940 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.058911    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105961878848"
Jul 15 15:20:03.080881 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.080859    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7363-140105961878848_dd4c41fb-42c4-4629-89db-7ac8ae61495c/test-curl-7363-140105961878848/0.log"
Jul 15 15:20:03.106387 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.106358    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7363-140105961878848"]
Jul 15 15:20:03.112594 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.112568    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7363-140105961878848"]
Jul 15 15:20:03.200450 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.200421    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghn6f\" (UniqueName: \"kubernetes.io/projected/dd4c41fb-42c4-4629-89db-7ac8ae61495c-kube-api-access-ghn6f\") pod \"dd4c41fb-42c4-4629-89db-7ac8ae61495c\" (UID: \"dd4c41fb-42c4-4629-89db-7ac8ae61495c\") "
Jul 15 15:20:03.202491 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.202461    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd4c41fb-42c4-4629-89db-7ac8ae61495c-kube-api-access-ghn6f" (OuterVolumeSpecName: "kube-api-access-ghn6f") pod "dd4c41fb-42c4-4629-89db-7ac8ae61495c" (UID: "dd4c41fb-42c4-4629-89db-7ac8ae61495c"). InnerVolumeSpecName "kube-api-access-ghn6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:20:03.301465 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.301431    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghn6f\" (UniqueName: \"kubernetes.io/projected/dd4c41fb-42c4-4629-89db-7ac8ae61495c-kube-api-access-ghn6f\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:03.307791 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.307764    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45"]
Jul 15 15:20:03.308163 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.308149    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd4c41fb-42c4-4629-89db-7ac8ae61495c" containerName="test-curl-7363-140105961878848"
Jul 15 15:20:03.308227 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.308165    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd4c41fb-42c4-4629-89db-7ac8ae61495c" containerName="test-curl-7363-140105961878848"
Jul 15 15:20:03.308227 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.308223    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd4c41fb-42c4-4629-89db-7ac8ae61495c" containerName="test-curl-7363-140105961878848"
Jul 15 15:20:03.311235 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.311219    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45"
Jul 15 15:20:03.314094 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.314076    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:20:03.320514 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.320490    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45"]
Jul 15 15:20:03.380970 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.380933    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd4c41fb-42c4-4629-89db-7ac8ae61495c" path="/var/lib/kubelet/pods/dd4c41fb-42c4-4629-89db-7ac8ae61495c/volumes"
Jul 15 15:20:03.402101 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.402067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/289f7d24-fcf0-49e6-b4fe-d5764e2b4d15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45\" (UID: \"289f7d24-fcf0-49e6-b4fe-d5764e2b4d15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45"
Jul 15 15:20:03.503599 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.503524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/289f7d24-fcf0-49e6-b4fe-d5764e2b4d15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45\" (UID: \"289f7d24-fcf0-49e6-b4fe-d5764e2b4d15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45"
Jul 15 15:20:03.504143 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.504125    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/289f7d24-fcf0-49e6-b4fe-d5764e2b4d15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45\" (UID: \"289f7d24-fcf0-49e6-b4fe-d5764e2b4d15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45"
Jul 15 15:20:03.622539 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.622495    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45"
Jul 15 15:20:03.756603 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.756572    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45"]
Jul 15 15:20:03.758263 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:20:03.758233    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289f7d24_fcf0_49e6_b4fe_d5764e2b4d15.slice/crio-a188bf1faf066f71e6ccd58350d6e447a987b81ecda6897f423321ef4f21d808 WatchSource:0}: Error finding container a188bf1faf066f71e6ccd58350d6e447a987b81ecda6897f423321ef4f21d808: Status 404 returned error can't find the container with id a188bf1faf066f71e6ccd58350d6e447a987b81ecda6897f423321ef4f21d808
Jul 15 15:20:03.925621 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.925581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45" event={"ID":"289f7d24-fcf0-49e6-b4fe-d5764e2b4d15","Type":"ContainerStarted","Data":"a188bf1faf066f71e6ccd58350d6e447a987b81ecda6897f423321ef4f21d808"}
Jul 15 15:20:03.926828 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.926811    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105961878848"
Jul 15 15:20:03.926947 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:03.926867    2581 scope.go:117] "RemoveContainer" containerID="1dc0babfd63088eff5c14cfb2c3f0339fe14f2bfae7b3efa3f113454c39b3aa4"
Jul 15 15:20:04.935273 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:04.935238    2581 generic.go:356] "Generic (PLEG): container finished" podID="289f7d24-fcf0-49e6-b4fe-d5764e2b4d15" containerID="24a56c0f0792181532d41e9f4e5238b3a74db0256ad79155f99f135127fce9ef" exitCode=0
Jul 15 15:20:04.935725 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:04.935286    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45" event={"ID":"289f7d24-fcf0-49e6-b4fe-d5764e2b4d15","Type":"ContainerDied","Data":"24a56c0f0792181532d41e9f4e5238b3a74db0256ad79155f99f135127fce9ef"}
Jul 15 15:20:06.058571 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:06.058543    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45"
Jul 15 15:20:06.225153 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:06.225072    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/289f7d24-fcf0-49e6-b4fe-d5764e2b4d15-maas-api-service-ca\") pod \"289f7d24-fcf0-49e6-b4fe-d5764e2b4d15\" (UID: \"289f7d24-fcf0-49e6-b4fe-d5764e2b4d15\") "
Jul 15 15:20:06.225461 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:06.225434    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/289f7d24-fcf0-49e6-b4fe-d5764e2b4d15-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "289f7d24-fcf0-49e6-b4fe-d5764e2b4d15" (UID: "289f7d24-fcf0-49e6-b4fe-d5764e2b4d15"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:20:06.326059 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:06.326021    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/289f7d24-fcf0-49e6-b4fe-d5764e2b4d15-maas-api-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:06.954505 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:06.954468    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45"
Jul 15 15:20:06.954699 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:06.954499    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45" event={"ID":"289f7d24-fcf0-49e6-b4fe-d5764e2b4d15","Type":"ContainerDied","Data":"a188bf1faf066f71e6ccd58350d6e447a987b81ecda6897f423321ef4f21d808"}
Jul 15 15:20:06.954699 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:06.954578    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a188bf1faf066f71e6ccd58350d6e447a987b81ecda6897f423321ef4f21d808"
Jul 15 15:20:13.725922 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:13.725887    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"]
Jul 15 15:20:13.726382 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:13.726112    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p" podUID="0a405b87-d8f7-4904-864d-86dac25fcadd" containerName="maas-api" containerID="cri-o://b88269854237f86888afaf8b006f0211aa2187d72e14757755ef886c3021c49d" gracePeriod=30
Jul 15 15:20:13.974947 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:13.974923    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:20:13.987716 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:13.987664    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a405b87-d8f7-4904-864d-86dac25fcadd-openshift-service-ca\") pod \"0a405b87-d8f7-4904-864d-86dac25fcadd\" (UID: \"0a405b87-d8f7-4904-864d-86dac25fcadd\") "
Jul 15 15:20:13.987716 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:13.987703    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a405b87-d8f7-4904-864d-86dac25fcadd-maas-api-tls\") pod \"0a405b87-d8f7-4904-864d-86dac25fcadd\" (UID: \"0a405b87-d8f7-4904-864d-86dac25fcadd\") "
Jul 15 15:20:13.987847 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:13.987761    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxfh7\" (UniqueName: \"kubernetes.io/projected/0a405b87-d8f7-4904-864d-86dac25fcadd-kube-api-access-xxfh7\") pod \"0a405b87-d8f7-4904-864d-86dac25fcadd\" (UID: \"0a405b87-d8f7-4904-864d-86dac25fcadd\") "
Jul 15 15:20:13.988019 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:13.987998    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a405b87-d8f7-4904-864d-86dac25fcadd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0a405b87-d8f7-4904-864d-86dac25fcadd" (UID: "0a405b87-d8f7-4904-864d-86dac25fcadd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:20:13.989726 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:13.989691    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a405b87-d8f7-4904-864d-86dac25fcadd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0a405b87-d8f7-4904-864d-86dac25fcadd" (UID: "0a405b87-d8f7-4904-864d-86dac25fcadd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:20:13.989871 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:13.989811    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a405b87-d8f7-4904-864d-86dac25fcadd-kube-api-access-xxfh7" (OuterVolumeSpecName: "kube-api-access-xxfh7") pod "0a405b87-d8f7-4904-864d-86dac25fcadd" (UID: "0a405b87-d8f7-4904-864d-86dac25fcadd"). InnerVolumeSpecName "kube-api-access-xxfh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:20:13.998836 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:13.998803    2581 generic.go:356] "Generic (PLEG): container finished" podID="0a405b87-d8f7-4904-864d-86dac25fcadd" containerID="b88269854237f86888afaf8b006f0211aa2187d72e14757755ef886c3021c49d" exitCode=0
Jul 15 15:20:13.998948 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:13.998870    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"
Jul 15 15:20:13.998948 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:13.998927    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p" event={"ID":"0a405b87-d8f7-4904-864d-86dac25fcadd","Type":"ContainerDied","Data":"b88269854237f86888afaf8b006f0211aa2187d72e14757755ef886c3021c49d"}
Jul 15 15:20:13.999052 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:13.998961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p" event={"ID":"0a405b87-d8f7-4904-864d-86dac25fcadd","Type":"ContainerDied","Data":"6afc7866ab5f80cb50b0edd7e03823fa2b01b4b4df77dae287b45df9fecd41ed"}
Jul 15 15:20:13.999052 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:13.998982    2581 scope.go:117] "RemoveContainer" containerID="b88269854237f86888afaf8b006f0211aa2187d72e14757755ef886c3021c49d"
Jul 15 15:20:14.012914 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:14.012895    2581 scope.go:117] "RemoveContainer" containerID="b88269854237f86888afaf8b006f0211aa2187d72e14757755ef886c3021c49d"
Jul 15 15:20:14.013178 ip-10-0-131-157 kubenswrapper[2581]: E0715 15:20:14.013158    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b88269854237f86888afaf8b006f0211aa2187d72e14757755ef886c3021c49d\": container with ID starting with b88269854237f86888afaf8b006f0211aa2187d72e14757755ef886c3021c49d not found: ID does not exist" containerID="b88269854237f86888afaf8b006f0211aa2187d72e14757755ef886c3021c49d"
Jul 15 15:20:14.013260 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:14.013184    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b88269854237f86888afaf8b006f0211aa2187d72e14757755ef886c3021c49d"} err="failed to get container status \"b88269854237f86888afaf8b006f0211aa2187d72e14757755ef886c3021c49d\": rpc error: code = NotFound desc = could not find container \"b88269854237f86888afaf8b006f0211aa2187d72e14757755ef886c3021c49d\": container with ID starting with b88269854237f86888afaf8b006f0211aa2187d72e14757755ef886c3021c49d not found: ID does not exist"
Jul 15 15:20:14.027684 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:14.027664    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"]
Jul 15 15:20:14.031763 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:14.031725    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e7a94a-974fdbfff-jr64p"]
Jul 15 15:20:14.089128 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:14.089098    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a405b87-d8f7-4904-864d-86dac25fcadd-openshift-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:14.089128 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:14.089123    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a405b87-d8f7-4904-864d-86dac25fcadd-maas-api-tls\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:14.089128 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:14.089132    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxfh7\" (UniqueName: \"kubernetes.io/projected/0a405b87-d8f7-4904-864d-86dac25fcadd-kube-api-access-xxfh7\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:15.380580 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:15.380549    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a405b87-d8f7-4904-864d-86dac25fcadd" path="/var/lib/kubelet/pods/0a405b87-d8f7-4904-864d-86dac25fcadd/volumes"
Jul 15 15:20:17.110169 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:17.110138    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:20:39.567074 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:39.567045    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 15:20:39.571542 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:39.571523    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 15:20:39.578070 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:39.578053    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 15:20:39.582615 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:39.582599    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dj6k9_648659d5-4cd0-42a2-a674-a46a7479565f/ovn-acl-logging/0.log"
Jul 15 15:20:39.825099 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:39.825028    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"]
Jul 15 15:20:39.825299 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:39.825249    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4" podUID="19881a50-c5ec-40e2-8a8f-7e73e4040acf" containerName="maas-api" containerID="cri-o://86c870e0cf442ebe6f9a7f4a4245dc9005e98d446622d1e366e11a4018de2caa" gracePeriod=30
Jul 15 15:20:40.151190 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:40.151157    2581 generic.go:356] "Generic (PLEG): container finished" podID="19881a50-c5ec-40e2-8a8f-7e73e4040acf" containerID="86c870e0cf442ebe6f9a7f4a4245dc9005e98d446622d1e366e11a4018de2caa" exitCode=0
Jul 15 15:20:40.151343 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:40.151193    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4" event={"ID":"19881a50-c5ec-40e2-8a8f-7e73e4040acf","Type":"ContainerDied","Data":"86c870e0cf442ebe6f9a7f4a4245dc9005e98d446622d1e366e11a4018de2caa"}
Jul 15 15:20:40.289369 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:40.289342    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:20:40.398869 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:40.398777    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19881a50-c5ec-40e2-8a8f-7e73e4040acf-maas-api-tls\") pod \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\" (UID: \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\") "
Jul 15 15:20:40.398869 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:40.398833    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdf5n\" (UniqueName: \"kubernetes.io/projected/19881a50-c5ec-40e2-8a8f-7e73e4040acf-kube-api-access-rdf5n\") pod \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\" (UID: \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\") "
Jul 15 15:20:40.399110 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:40.398907    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19881a50-c5ec-40e2-8a8f-7e73e4040acf-openshift-service-ca\") pod \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\" (UID: \"19881a50-c5ec-40e2-8a8f-7e73e4040acf\") "
Jul 15 15:20:40.399272 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:40.399248    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19881a50-c5ec-40e2-8a8f-7e73e4040acf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "19881a50-c5ec-40e2-8a8f-7e73e4040acf" (UID: "19881a50-c5ec-40e2-8a8f-7e73e4040acf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:20:40.400976 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:40.400954    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19881a50-c5ec-40e2-8a8f-7e73e4040acf-kube-api-access-rdf5n" (OuterVolumeSpecName: "kube-api-access-rdf5n") pod "19881a50-c5ec-40e2-8a8f-7e73e4040acf" (UID: "19881a50-c5ec-40e2-8a8f-7e73e4040acf"). InnerVolumeSpecName "kube-api-access-rdf5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:20:40.401076 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:40.401056    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19881a50-c5ec-40e2-8a8f-7e73e4040acf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "19881a50-c5ec-40e2-8a8f-7e73e4040acf" (UID: "19881a50-c5ec-40e2-8a8f-7e73e4040acf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:20:40.499581 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:40.499549    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19881a50-c5ec-40e2-8a8f-7e73e4040acf-maas-api-tls\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:40.499581 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:40.499574    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdf5n\" (UniqueName: \"kubernetes.io/projected/19881a50-c5ec-40e2-8a8f-7e73e4040acf-kube-api-access-rdf5n\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:40.499581 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:40.499584    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19881a50-c5ec-40e2-8a8f-7e73e4040acf-openshift-service-ca\") on node \"ip-10-0-131-157.ec2.internal\" DevicePath \"\""
Jul 15 15:20:41.158547 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:41.158496    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"
Jul 15 15:20:41.159021 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:41.158547    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4" event={"ID":"19881a50-c5ec-40e2-8a8f-7e73e4040acf","Type":"ContainerDied","Data":"7bab1c21c06460f06e78365e69d95292244790f8ee17b9722501222d7d646a1e"}
Jul 15 15:20:41.159021 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:41.158616    2581 scope.go:117] "RemoveContainer" containerID="86c870e0cf442ebe6f9a7f4a4245dc9005e98d446622d1e366e11a4018de2caa"
Jul 15 15:20:41.180941 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:41.180910    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"]
Jul 15 15:20:41.185317 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:41.185288    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9f9f5c-6d884bb8b5-f62g4"]
Jul 15 15:20:41.380807 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:41.380776    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19881a50-c5ec-40e2-8a8f-7e73e4040acf" path="/var/lib/kubelet/pods/19881a50-c5ec-40e2-8a8f-7e73e4040acf/volumes"
Jul 15 15:20:43.197552 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:43.197517    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2ln65"]
Jul 15 15:20:55.760716 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:20:55.760685    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-548d4964b9-rj6qb_535b6f4a-ad0a-49c4-8be6-303750523bf3/authorino/0.log"
Jul 15 15:21:01.666492 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:01.666462    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846b6d9d56-dbq5c_3170f621-2ad1-4305-b81b-43ac94c9d18d/copy-manifests/0.log"
Jul 15 15:21:01.674593 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:01.674571    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846b6d9d56-dbq5c_3170f621-2ad1-4305-b81b-43ac94c9d18d/manager/0.log"
Jul 15 15:21:02.423121 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:02.423093    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735445-sjkmr_7a31f668-259c-4f76-a428-96473bed96a1/cleanup/0.log"
Jul 15 15:21:02.527043 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:02.527018    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735460-tstd9_4b3b78c8-d17b-4139-8580-0735d66fb605/cleanup/0.log"
Jul 15 15:21:02.744365 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:02.744291    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-2a4ba6ba-npzvz_2d101c08-abd1-4186-85ac-d053f5e17fa3/revoke-keys/0.log"
Jul 15 15:21:02.852309 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:02.852284    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-2eb856f0-92xfp_2c60ce0b-8d6b-4ece-84a2-8c71d6023732/revoke-keys/0.log"
Jul 15 15:21:03.178626 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:03.178598    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-52ab34eb-mqpbv_71dcd6be-1774-43a4-b73e-f26459c35185/revoke-keys/0.log"
Jul 15 15:21:03.425592 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:03.425564    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-6bbf18-l27rc_4105a553-2fc6-4074-9ba0-ad7e537684e9/revoke-keys/0.log"
Jul 15 15:21:03.531534 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:03.531459    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-bf27e0e8-pbqvr_3f1756c5-dcdb-4754-8563-26173161007e/revoke-keys/0.log"
Jul 15 15:21:03.638586 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:03.638561    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-c91d77b6-sfrtg_2d5d7da3-d067-44e8-8883-1e21d408a778/revoke-keys/0.log"
Jul 15 15:21:03.751968 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:03.751940    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-ef5b05d8-plvlx_b37e06f9-c2ac-47d4-b56d-48602798eff4/revoke-keys/0.log"
Jul 15 15:21:03.862724 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:03.862633    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-e7a94a-xpt45_289f7d24-fcf0-49e6-b4fe-d5764e2b4d15/revoke-keys/0.log"
Jul 15 15:21:04.854685 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:04.854656    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w_cf9fd8d3-0197-47e6-8769-6e8d524e48be/util/0.log"
Jul 15 15:21:04.860945 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:04.860923    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w_cf9fd8d3-0197-47e6-8769-6e8d524e48be/pull/0.log"
Jul 15 15:21:04.866808 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:04.866789    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w_cf9fd8d3-0197-47e6-8769-6e8d524e48be/extract/0.log"
Jul 15 15:21:04.975397 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:04.975374    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5_0340751b-d8bb-42a8-8f18-3933dfad9975/util/0.log"
Jul 15 15:21:04.981819 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:04.981798    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5_0340751b-d8bb-42a8-8f18-3933dfad9975/pull/0.log"
Jul 15 15:21:04.987708 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:04.987690    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5_0340751b-d8bb-42a8-8f18-3933dfad9975/extract/0.log"
Jul 15 15:21:05.102663 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:05.102642    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr_964e3a22-70c5-4086-93dd-437a069cdf2d/util/0.log"
Jul 15 15:21:05.108722 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:05.108667    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr_964e3a22-70c5-4086-93dd-437a069cdf2d/pull/0.log"
Jul 15 15:21:05.114551 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:05.114533    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr_964e3a22-70c5-4086-93dd-437a069cdf2d/extract/0.log"
Jul 15 15:21:05.234071 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:05.234051    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj_24e5449f-588b-48be-8e1d-c46a444d4a0b/util/0.log"
Jul 15 15:21:05.241566 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:05.241545    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj_24e5449f-588b-48be-8e1d-c46a444d4a0b/pull/0.log"
Jul 15 15:21:05.247634 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:05.247615    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj_24e5449f-588b-48be-8e1d-c46a444d4a0b/extract/0.log"
Jul 15 15:21:05.368963 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:05.368898    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-548d4964b9-rj6qb_535b6f4a-ad0a-49c4-8be6-303750523bf3/authorino/0.log"
Jul 15 15:21:06.094072 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:06.094040    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2ln65_4348bbf5-9721-47eb-bd68-568b6b77746b/limitador/0.log"
Jul 15 15:21:06.786283 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:06.786232    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86c7c45d84-kvn8d_0f448e44-83bf-4c66-9825-7087afcc7565/kube-auth-proxy/0.log"
Jul 15 15:21:07.387396 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:07.387363    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-566bf9cd7d-9z9sz_f171a29b-11e8-4979-b29b-5ee79409c676/router/0.log"
Jul 15 15:21:08.326682 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:08.326656    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-8sl4q_51f13559-2d02-43ff-af2e-dce8f5960414/main/0.log"
Jul 15 15:21:14.265688 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.265654    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-96lvs/must-gather-q4fcd"]
Jul 15 15:21:14.266284 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.266200    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a405b87-d8f7-4904-864d-86dac25fcadd" containerName="maas-api"
Jul 15 15:21:14.266284 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.266221    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a405b87-d8f7-4904-864d-86dac25fcadd" containerName="maas-api"
Jul 15 15:21:14.266284 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.266243    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19881a50-c5ec-40e2-8a8f-7e73e4040acf" containerName="maas-api"
Jul 15 15:21:14.266284 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.266251    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="19881a50-c5ec-40e2-8a8f-7e73e4040acf" containerName="maas-api"
Jul 15 15:21:14.266284 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.266262    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="289f7d24-fcf0-49e6-b4fe-d5764e2b4d15" containerName="revoke-keys"
Jul 15 15:21:14.266284 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.266273    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="289f7d24-fcf0-49e6-b4fe-d5764e2b4d15" containerName="revoke-keys"
Jul 15 15:21:14.266618 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.266354    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="289f7d24-fcf0-49e6-b4fe-d5764e2b4d15" containerName="revoke-keys"
Jul 15 15:21:14.266618 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.266370    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a405b87-d8f7-4904-864d-86dac25fcadd" containerName="maas-api"
Jul 15 15:21:14.266618 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.266381    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="19881a50-c5ec-40e2-8a8f-7e73e4040acf" containerName="maas-api"
Jul 15 15:21:14.269916 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.269895    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-96lvs/must-gather-q4fcd"
Jul 15 15:21:14.273076 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.273049    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-96lvs\"/\"openshift-service-ca.crt\""
Jul 15 15:21:14.274353 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.274336    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-96lvs\"/\"default-dockercfg-vpnlm\""
Jul 15 15:21:14.274437 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.274337    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-96lvs\"/\"kube-root-ca.crt\""
Jul 15 15:21:14.280382 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.280360    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-96lvs/must-gather-q4fcd"]
Jul 15 15:21:14.369170 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.369139    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f741ae69-b6e5-416e-9ada-b0c2f05abcde-must-gather-output\") pod \"must-gather-q4fcd\" (UID: \"f741ae69-b6e5-416e-9ada-b0c2f05abcde\") " pod="openshift-must-gather-96lvs/must-gather-q4fcd"
Jul 15 15:21:14.369297 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.369214    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77cfd\" (UniqueName: \"kubernetes.io/projected/f741ae69-b6e5-416e-9ada-b0c2f05abcde-kube-api-access-77cfd\") pod \"must-gather-q4fcd\" (UID: \"f741ae69-b6e5-416e-9ada-b0c2f05abcde\") " pod="openshift-must-gather-96lvs/must-gather-q4fcd"
Jul 15 15:21:14.469884 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.469856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77cfd\" (UniqueName: \"kubernetes.io/projected/f741ae69-b6e5-416e-9ada-b0c2f05abcde-kube-api-access-77cfd\") pod \"must-gather-q4fcd\" (UID: \"f741ae69-b6e5-416e-9ada-b0c2f05abcde\") " pod="openshift-must-gather-96lvs/must-gather-q4fcd"
Jul 15 15:21:14.470027 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.469907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f741ae69-b6e5-416e-9ada-b0c2f05abcde-must-gather-output\") pod \"must-gather-q4fcd\" (UID: \"f741ae69-b6e5-416e-9ada-b0c2f05abcde\") " pod="openshift-must-gather-96lvs/must-gather-q4fcd"
Jul 15 15:21:14.470188 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.470171    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f741ae69-b6e5-416e-9ada-b0c2f05abcde-must-gather-output\") pod \"must-gather-q4fcd\" (UID: \"f741ae69-b6e5-416e-9ada-b0c2f05abcde\") " pod="openshift-must-gather-96lvs/must-gather-q4fcd"
Jul 15 15:21:14.479823 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.479805    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77cfd\" (UniqueName: \"kubernetes.io/projected/f741ae69-b6e5-416e-9ada-b0c2f05abcde-kube-api-access-77cfd\") pod \"must-gather-q4fcd\" (UID: \"f741ae69-b6e5-416e-9ada-b0c2f05abcde\") " pod="openshift-must-gather-96lvs/must-gather-q4fcd"
Jul 15 15:21:14.580669 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.580607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-96lvs/must-gather-q4fcd"
Jul 15 15:21:14.709461 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:14.709433    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-96lvs/must-gather-q4fcd"]
Jul 15 15:21:14.710786 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:21:14.710757    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf741ae69_b6e5_416e_9ada_b0c2f05abcde.slice/crio-70e68dd2a784dc37f1fde865a3630c29738833158eaa08f078fe968a232be9ec WatchSource:0}: Error finding container 70e68dd2a784dc37f1fde865a3630c29738833158eaa08f078fe968a232be9ec: Status 404 returned error can't find the container with id 70e68dd2a784dc37f1fde865a3630c29738833158eaa08f078fe968a232be9ec
Jul 15 15:21:15.354211 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:15.354174    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-96lvs/must-gather-q4fcd" event={"ID":"f741ae69-b6e5-416e-9ada-b0c2f05abcde","Type":"ContainerStarted","Data":"70e68dd2a784dc37f1fde865a3630c29738833158eaa08f078fe968a232be9ec"}
Jul 15 15:21:16.365162 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:16.365123    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-96lvs/must-gather-q4fcd" event={"ID":"f741ae69-b6e5-416e-9ada-b0c2f05abcde","Type":"ContainerStarted","Data":"973dd7ab0234aa631eee622327e84a17b63a9558922968dcbd3bf11c2f82d2dc"}
Jul 15 15:21:16.365703 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:16.365681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-96lvs/must-gather-q4fcd" event={"ID":"f741ae69-b6e5-416e-9ada-b0c2f05abcde","Type":"ContainerStarted","Data":"17691dadb1b68875c7fe0152cff1b02f8ffd2575df030c4ac7fe2855ae359248"}
Jul 15 15:21:16.384578 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:16.384522    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-96lvs/must-gather-q4fcd" podStartSLOduration=1.418605242 podStartE2EDuration="2.384502358s" totalImagesPullingTime="965.897116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:21:16.383659668 +0000 UTC m=+3037.530340430" watchObservedRunningTime="2026-07-15 15:21:16.384502358 +0000 UTC m=+3037.531183115"
Jul 15 15:21:17.199396 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:17.199346    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2kgfr_f5384830-56ce-4427-a090-d8cd1ba933f0/global-pull-secret-syncer/0.log"
Jul 15 15:21:17.398357 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:17.398325    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nd4r9_0cc8465e-77b7-48a5-9c9f-03264ec77526/konnectivity-agent/0.log"
Jul 15 15:21:17.464749 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:17.464663    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-157.ec2.internal_8f8f53af122be6d892057d1be7162858/haproxy/0.log"
Jul 15 15:21:21.535606 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:21.535545    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w_cf9fd8d3-0197-47e6-8769-6e8d524e48be/extract/0.log"
Jul 15 15:21:21.561036 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:21.561010    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w_cf9fd8d3-0197-47e6-8769-6e8d524e48be/util/0.log"
Jul 15 15:21:21.595226 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:21.595194    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592c67w_cf9fd8d3-0197-47e6-8769-6e8d524e48be/pull/0.log"
Jul 15 15:21:21.630344 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:21.630308    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5_0340751b-d8bb-42a8-8f18-3933dfad9975/extract/0.log"
Jul 15 15:21:21.663208 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:21.663161    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5_0340751b-d8bb-42a8-8f18-3933dfad9975/util/0.log"
Jul 15 15:21:21.686907 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:21.686873    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jx8n5_0340751b-d8bb-42a8-8f18-3933dfad9975/pull/0.log"
Jul 15 15:21:21.720458 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:21.720410    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr_964e3a22-70c5-4086-93dd-437a069cdf2d/extract/0.log"
Jul 15 15:21:21.751600 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:21.751557    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr_964e3a22-70c5-4086-93dd-437a069cdf2d/util/0.log"
Jul 15 15:21:21.783629 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:21.783581    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7347gnr_964e3a22-70c5-4086-93dd-437a069cdf2d/pull/0.log"
Jul 15 15:21:21.819895 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:21.819805    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj_24e5449f-588b-48be-8e1d-c46a444d4a0b/extract/0.log"
Jul 15 15:21:21.868752 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:21.868709    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj_24e5449f-588b-48be-8e1d-c46a444d4a0b/util/0.log"
Jul 15 15:21:21.898855 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:21.898830    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xchj_24e5449f-588b-48be-8e1d-c46a444d4a0b/pull/0.log"
Jul 15 15:21:22.315756 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:22.315160    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-548d4964b9-rj6qb_535b6f4a-ad0a-49c4-8be6-303750523bf3/authorino/0.log"
Jul 15 15:21:22.701028 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:22.700997    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2ln65_4348bbf5-9721-47eb-bd68-568b6b77746b/limitador/0.log"
Jul 15 15:21:24.473937 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:24.473899    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-vjbl2_61c5ca60-f543-4ebe-82bd-9050c50647af/cluster-monitoring-operator/0.log"
Jul 15 15:21:24.523076 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:24.523039    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xrwcp_ab494f96-2cd6-4a9e-b373-978498f0b604/kube-state-metrics/0.log"
Jul 15 15:21:24.542123 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:24.542094    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xrwcp_ab494f96-2cd6-4a9e-b373-978498f0b604/kube-rbac-proxy-main/0.log"
Jul 15 15:21:24.564344 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:24.564308    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xrwcp_ab494f96-2cd6-4a9e-b373-978498f0b604/kube-rbac-proxy-self/0.log"
Jul 15 15:21:24.619839 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:24.619805    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-v8f5w_1713875d-53b3-402d-ac1b-27b70031a603/monitoring-plugin/0.log"
Jul 15 15:21:24.655488 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:24.655453    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5cm49_40700db9-a43e-43ec-abcb-56ddc2b032ca/node-exporter/0.log"
Jul 15 15:21:24.683011 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:24.682984    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5cm49_40700db9-a43e-43ec-abcb-56ddc2b032ca/kube-rbac-proxy/0.log"
Jul 15 15:21:24.718893 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:24.718538    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5cm49_40700db9-a43e-43ec-abcb-56ddc2b032ca/init-textfile/0.log"
Jul 15 15:21:24.958796 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:24.958765    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-tfzpm_56bb1669-e472-4a3f-a859-5c36fc7c212e/kube-rbac-proxy-main/0.log"
Jul 15 15:21:24.981426 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:24.981381    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-tfzpm_56bb1669-e472-4a3f-a859-5c36fc7c212e/kube-rbac-proxy-self/0.log"
Jul 15 15:21:25.006823 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:25.006789    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-tfzpm_56bb1669-e472-4a3f-a859-5c36fc7c212e/openshift-state-metrics/0.log"
Jul 15 15:21:25.293214 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:25.293116    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-96xgb_6e0ec8bb-842b-4635-a0c1-6cf4498f5c7c/prometheus-operator-admission-webhook/0.log"
Jul 15 15:21:25.421986 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:25.421954    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584f777759-g256v_ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8/thanos-query/0.log"
Jul 15 15:21:25.447590 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:25.447552    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584f777759-g256v_ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8/kube-rbac-proxy-web/0.log"
Jul 15 15:21:25.478396 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:25.478364    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584f777759-g256v_ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8/kube-rbac-proxy/0.log"
Jul 15 15:21:25.504129 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:25.504102    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584f777759-g256v_ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8/prom-label-proxy/0.log"
Jul 15 15:21:25.535618 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:25.535584    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584f777759-g256v_ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8/kube-rbac-proxy-rules/0.log"
Jul 15 15:21:25.558393 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:25.558312    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584f777759-g256v_ce5cafe3-7eb9-4967-8ddf-1073f4ae51f8/kube-rbac-proxy-metrics/0.log"
Jul 15 15:21:27.274367 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.274325    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"]
Jul 15 15:21:27.282618 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.282592    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.288087 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.288058    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"]
Jul 15 15:21:27.310927 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.310591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa96b41e-ca52-4f55-92bb-b7958539b45d-sys\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.310927 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.310659    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa96b41e-ca52-4f55-92bb-b7958539b45d-podres\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.310927 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.310694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa96b41e-ca52-4f55-92bb-b7958539b45d-proc\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.310927 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.310773    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlpwm\" (UniqueName: \"kubernetes.io/projected/fa96b41e-ca52-4f55-92bb-b7958539b45d-kube-api-access-rlpwm\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.310927 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.310801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa96b41e-ca52-4f55-92bb-b7958539b45d-lib-modules\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.414096 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.413767    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa96b41e-ca52-4f55-92bb-b7958539b45d-podres\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.414096 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.413823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa96b41e-ca52-4f55-92bb-b7958539b45d-proc\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.414096 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.413922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlpwm\" (UniqueName: \"kubernetes.io/projected/fa96b41e-ca52-4f55-92bb-b7958539b45d-kube-api-access-rlpwm\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.414096 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.413951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa96b41e-ca52-4f55-92bb-b7958539b45d-lib-modules\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.414096 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.413980    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa96b41e-ca52-4f55-92bb-b7958539b45d-proc\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.414096 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.414093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa96b41e-ca52-4f55-92bb-b7958539b45d-sys\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.414533 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.414236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa96b41e-ca52-4f55-92bb-b7958539b45d-sys\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.414533 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.414320    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa96b41e-ca52-4f55-92bb-b7958539b45d-podres\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.414533 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.414478    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa96b41e-ca52-4f55-92bb-b7958539b45d-lib-modules\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.422288 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.422258    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlpwm\" (UniqueName: \"kubernetes.io/projected/fa96b41e-ca52-4f55-92bb-b7958539b45d-kube-api-access-rlpwm\") pod \"perf-node-gather-daemonset-fkx8t\" (UID: \"fa96b41e-ca52-4f55-92bb-b7958539b45d\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.433926 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.433900    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/1.log"
Jul 15 15:21:27.439214 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.439192    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vpbs6_b3513a3d-3146-46f0-99b1-20a0dc6c0298/console-operator/2.log"
Jul 15 15:21:27.595569 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.595493    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:27.763064 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.762933    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"]
Jul 15 15:21:27.771512 ip-10-0-131-157 kubenswrapper[2581]: W0715 15:21:27.771456    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfa96b41e_ca52_4f55_92bb_b7958539b45d.slice/crio-94e4473b096875a7b4a3b185cd501a0cb23bd2a18b23bd657c222b84e0f8e1d3 WatchSource:0}: Error finding container 94e4473b096875a7b4a3b185cd501a0cb23bd2a18b23bd657c222b84e0f8e1d3: Status 404 returned error can't find the container with id 94e4473b096875a7b4a3b185cd501a0cb23bd2a18b23bd657c222b84e0f8e1d3
Jul 15 15:21:27.972444 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:27.972421    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6df44595c9-glhl7_4d8d1cd5-87f6-4544-ab7c-0628adce8137/console/0.log"
Jul 15 15:21:28.470809 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:28.470770    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t" event={"ID":"fa96b41e-ca52-4f55-92bb-b7958539b45d","Type":"ContainerStarted","Data":"6c6a1c1fb5e7e2567896b9b939e6990227b377013f04b621596e39ddf6d89253"}
Jul 15 15:21:28.471299 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:28.470841    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:28.471299 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:28.470869    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t" event={"ID":"fa96b41e-ca52-4f55-92bb-b7958539b45d","Type":"ContainerStarted","Data":"94e4473b096875a7b4a3b185cd501a0cb23bd2a18b23bd657c222b84e0f8e1d3"}
Jul 15 15:21:28.488764 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:28.488697    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t" podStartSLOduration=1.4886808089999999 podStartE2EDuration="1.488680809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:21:28.487819371 +0000 UTC m=+3049.634500127" watchObservedRunningTime="2026-07-15 15:21:28.488680809 +0000 UTC m=+3049.635361563"
Jul 15 15:21:28.598803 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:28.598754    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-h4rhk_359f2b4a-a07b-435d-8298-a9261eec0627/volume-data-source-validator/0.log"
Jul 15 15:21:29.611093 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:29.611057    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fmzrb_a954500d-c43e-4ffd-865c-1a9cb4a93394/dns/0.log"
Jul 15 15:21:29.634496 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:29.634470    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fmzrb_a954500d-c43e-4ffd-865c-1a9cb4a93394/kube-rbac-proxy/0.log"
Jul 15 15:21:29.757594 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:29.757560    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5hmbj_2c7030e2-bf92-4317-98ef-a5caa8ecaaa7/dns-node-resolver/0.log"
Jul 15 15:21:30.341123 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:30.341092    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-857pm_3d073343-d7d8-4355-b336-8aa922f542da/node-ca/0.log"
Jul 15 15:21:31.468531 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:31.468462    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86c7c45d84-kvn8d_0f448e44-83bf-4c66-9825-7087afcc7565/kube-auth-proxy/0.log"
Jul 15 15:21:31.674499 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:31.674456    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-566bf9cd7d-9z9sz_f171a29b-11e8-4979-b29b-5ee79409c676/router/0.log"
Jul 15 15:21:32.364929 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:32.364900    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dgwmt_22491f96-5047-4517-b73e-6982e1367d49/serve-healthcheck-canary/0.log"
Jul 15 15:21:32.900298 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:32.900259    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-dj7t5_f33ca220-779c-4d54-8c25-51ee1dacd4b8/insights-operator/0.log"
Jul 15 15:21:32.901126 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:32.901106    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-dj7t5_f33ca220-779c-4d54-8c25-51ee1dacd4b8/insights-operator/1.log"
Jul 15 15:21:32.926551 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:32.926526    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctx8q_1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a/kube-rbac-proxy/0.log"
Jul 15 15:21:32.950162 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:32.950141    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctx8q_1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a/exporter/0.log"
Jul 15 15:21:32.975088 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:32.975057    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctx8q_1afaeaa3-9f74-4993-9cc2-e0c1888b7b9a/extractor/0.log"
Jul 15 15:21:34.488992 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:34.488958    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-fkx8t"
Jul 15 15:21:35.771610 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:35.771583    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846b6d9d56-dbq5c_3170f621-2ad1-4305-b81b-43ac94c9d18d/manager/0.log"
Jul 15 15:21:35.797283 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:35.797259    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846b6d9d56-dbq5c_3170f621-2ad1-4305-b81b-43ac94c9d18d/copy-manifests/0.log"
Jul 15 15:21:37.482970 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:37.482934    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bbc4984f8-t9jxz_cde232c2-3a55-4db8-ae84-0a0454d48f8f/manager/0.log"
Jul 15 15:21:37.648469 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:37.648439    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86c7c45d84-kvn8d_0f448e44-83bf-4c66-9825-7087afcc7565/kube-auth-proxy/0.log"
Jul 15 15:21:37.783475 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:37.783403    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-566bf9cd7d-9z9sz_f171a29b-11e8-4979-b29b-5ee79409c676/router/0.log"
Jul 15 15:21:39.121757 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:39.121667    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86c7c45d84-kvn8d_0f448e44-83bf-4c66-9825-7087afcc7565/kube-auth-proxy/0.log"
Jul 15 15:21:39.261177 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:39.261152    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-566bf9cd7d-9z9sz_f171a29b-11e8-4979-b29b-5ee79409c676/router/0.log"
Jul 15 15:21:42.863059 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:42.862997    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-8pkvl_c804fc5f-df87-47b4-85a8-28d2c5823350/kube-storage-version-migrator-operator/1.log"
Jul 15 15:21:42.864293 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:42.864267    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-8pkvl_c804fc5f-df87-47b4-85a8-28d2c5823350/kube-storage-version-migrator-operator/0.log"
Jul 15 15:21:44.288601 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:44.288571    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-njjqk_735ad593-2f87-4697-97d1-ffececf10a85/kube-multus-additional-cni-plugins/0.log"
Jul 15 15:21:44.310007 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:44.309982    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-njjqk_735ad593-2f87-4697-97d1-ffececf10a85/egress-router-binary-copy/0.log"
Jul 15 15:21:44.332420 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:44.332388    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-njjqk_735ad593-2f87-4697-97d1-ffececf10a85/cni-plugins/0.log"
Jul 15 15:21:44.360665 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:44.360644    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-njjqk_735ad593-2f87-4697-97d1-ffececf10a85/bond-cni-plugin/0.log"
Jul 15 15:21:44.385835 ip-10-0-131-157 kubenswrapper[2581]: I0715 15:21:44.385813    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-njjqk_735ad593-2f87-4697-97d1-ffececf10a85/routeoverride-cni/0.log"