Jul 30 02:24:01.850372 ip-10-0-136-75 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 30 02:24:01.850386 ip-10-0-136-75 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 30 02:24:01.850395 ip-10-0-136-75 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 30 02:24:01.850708 ip-10-0-136-75 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 30 02:24:13.072321 ip-10-0-136-75 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 30 02:24:13.072340 ip-10-0-136-75 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c4a70bc5f96945738b08b9b45d7fd00b --
Jul 30 02:26:04.040807 ip-10-0-136-75 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 02:26:04.406908 ip-10-0-136-75 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 02:26:04.406908 ip-10-0-136-75 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 02:26:04.406908 ip-10-0-136-75 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 02:26:04.406908 ip-10-0-136-75 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 02:26:04.406908 ip-10-0-136-75 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 02:26:04.407964 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.407885    2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 02:26:04.413154 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413139    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 02:26:04.413154 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413153    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413157    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413161    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413164    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413167    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413171    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413174    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413179    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413182    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413185    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413188    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413190    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413193    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413195    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413198    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413201    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413203    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413206    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413208    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413211    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 02:26:04.413223 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413226    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413229    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413232    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413235    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413240    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413244    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413247    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413250    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413253    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413255    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413258    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413260    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413263    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413265    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413270    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413274    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413277    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413280    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413283    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 02:26:04.413704 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413285    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413288    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413291    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413293    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413296    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413298    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413301    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413303    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413306    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413309    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413311    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413314    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413316    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413319    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413323    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413326    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413328    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413331    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413333    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413336    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 02:26:04.414164 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413339    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413341    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413344    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413346    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413349    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413352    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413354    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413357    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413359    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413362    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413364    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413367    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413369    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413372    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413374    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413377    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413380    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413384    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413387    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 02:26:04.414686 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413389    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413392    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413394    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413397    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413400    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413402    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413405    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413407    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413412    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413415    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413417    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413420    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413422    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413425    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413428    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413430    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413432    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413435    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413437    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.413440    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 02:26:04.415399 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414150    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414156    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414159    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414162    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414165    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414167    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414170    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414173    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414176    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414178    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414181    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414183    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414186    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414189    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414191    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414194    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414197    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414199    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414202    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414205    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 02:26:04.415913 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414208    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414213    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414217    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414220    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414222    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414225    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414228    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414230    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414233    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414235    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414238    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414240    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414242    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414245    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414247    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414250    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414252    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414255    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414257    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414260    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 02:26:04.416420 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414262    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414264    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414267    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414269    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414272    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414274    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414276    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414279    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414281    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414284    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414286    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414290    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414293    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414295    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414298    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414303    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414307    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414310    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414313    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 02:26:04.416924 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414316    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414318    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414321    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414324    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414327    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414329    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414332    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414334    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414337    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414339    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414341    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414344    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414346    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414349    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414351    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414354    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414356    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414358    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414362    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 02:26:04.417408 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414365    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414368    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414371    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414373    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414376    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414379    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414382    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414384    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414387    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414389    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414392    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414394    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414397    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414399    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414402    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414404    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414407    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414409    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414412    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414414    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 02:26:04.417876 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.414417    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417272    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417281    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417285    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417288    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417291    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417294    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417297    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417300    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417303    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417306    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417308    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417311    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417313    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417316    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417318    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417321    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417324    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417327    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417330    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 02:26:04.418367 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417332    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417336    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417338    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417341    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417344    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417346    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417349    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417352    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417354    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417357    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417359    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417362    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417365    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417368    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417370    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417374    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417376    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417379    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417381    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 02:26:04.418899 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417384    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417387    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417390    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417392    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417395    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417397    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417400    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417402    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417405    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417407    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417410    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417413    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417416    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417419    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417423    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417427    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417430    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417432    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417435    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417438    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 02:26:04.419358 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417441    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417443    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417446    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417448    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417451    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417454    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417456    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417458    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417462    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417466    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417469    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417472    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417474    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417477    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417479    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417481    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417484    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417487    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417489    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 02:26:04.419846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417492    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417495    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417498    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417501    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417503    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417506    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417509    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417512    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417514    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417516    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417520    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417524    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417527    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417529    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417532    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417535    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417538    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417541    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417543    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 02:26:04.420362 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417557    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417560    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.417563    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417629    2554 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417636    2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417643    2554 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417647    2554 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417651    2554 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417654    2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417657    2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417661    2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417664    2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417667    2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417671    2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417674    2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417677    2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417680    2554 flags.go:64] FLAG: --cgroup-root=""
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417683    2554 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417686    2554 flags.go:64] FLAG: --client-ca-file=""
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417689    2554 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417692    2554 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417697    2554 flags.go:64] FLAG: --cluster-domain=""
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417700    2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417703    2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 02:26:04.420885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417706    2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417709    2554 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417712    2554 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417715    2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417719    2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417722    2554 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417725    2554 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417728    2554 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417730    2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417733    2554 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417736    2554 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417740    2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417743    2554 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417746    2554 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417749    2554 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417751    2554 flags.go:64] FLAG: --enable-server="true"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417754    2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417759    2554 flags.go:64] FLAG: --event-burst="100"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417762    2554 flags.go:64] FLAG: --event-qps="50"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417765    2554 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417768    2554 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417771    2554 flags.go:64] FLAG: --eviction-hard=""
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417775    2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417778    2554 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417782    2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 02:26:04.421559 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417785    2554 flags.go:64] FLAG: --eviction-soft=""
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417787    2554 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417790    2554 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417793    2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417796    2554 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417799    2554 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417802    2554 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417804    2554 flags.go:64] FLAG: --feature-gates=""
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417808    2554 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417811    2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417814    2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417817    2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417819    2554 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417822    2554 flags.go:64] FLAG: --help="false"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417825    2554 flags.go:64] FLAG: --hostname-override="ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417828    2554 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417831    2554 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417834    2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417837    2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417841    2554 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417843    2554 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417846    2554 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417849    2554 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 02:26:04.422324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417852    2554 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417855    2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417858    2554 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417861    2554 flags.go:64] FLAG: --kube-reserved=""
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417864    2554 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417867    2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417870    2554 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417872    2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417875    2554 flags.go:64] FLAG: --lock-file=""
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417878    2554 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417881    2554 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417884    2554 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417889    2554 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417892    2554 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417895    2554 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417898    2554 flags.go:64] FLAG: --logging-format="text"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417901    2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417904    2554 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417907    2554 flags.go:64] FLAG: --manifest-url=""
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417910    2554 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417914    2554 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417917    2554 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417921    2554 flags.go:64] FLAG: --max-pods="110"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417923    2554 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417926    2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 02:26:04.423029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417929    2554 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417932    2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417935    2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417938    2554 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417940    2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417946    2554 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417953    2554 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417956    2554 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417959    2554 flags.go:64] FLAG: --pod-cidr=""
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417962    2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417967    2554 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417970    2554 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417973    2554 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417976    2554 flags.go:64] FLAG: --port="10250"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417979    2554 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417982    2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02bf7670cbc82ee5a"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417985    2554 flags.go:64] FLAG: --qos-reserved=""
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417988    2554 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417991    2554 flags.go:64] FLAG: --register-node="true"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417993    2554 flags.go:64] FLAG: --register-with-taints=""
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417997    2554 flags.go:64] FLAG: --registry-burst="10"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.417999    2554 flags.go:64] FLAG: --registry-qps="5"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418002    2554 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418005    2554 flags.go:64] FLAG: --reserved-memory=""
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418009    2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 02:26:04.423745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418012    2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418014    2554 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418019    2554 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418022    2554 flags.go:64] FLAG: --runonce="false"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418025    2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418028    2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418031    2554 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418034    2554 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418037    2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418040    2554 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418042    2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418045    2554 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418048    2554 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418051    2554 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418056    2554 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418059    2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418062    2554 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418065    2554 flags.go:64] FLAG: --system-cgroups=""
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418068    2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418073    2554 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418076    2554 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418078    2554 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418082    2554 flags.go:64] FLAG: --tls-min-version=""
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418084    2554 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418088    2554 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 02:26:04.424412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418090    2554 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418093    2554 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418096    2554 flags.go:64] FLAG: --v="2"
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418100    2554 flags.go:64] FLAG: --version="false"
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418104    2554 flags.go:64] FLAG: --vmodule=""
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418107    2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.418110    2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418217    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418221    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418225    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418228    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418230    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418233    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418236    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418239    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418242    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418244    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418247    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418249    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418251    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418254    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418258    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 02:26:04.425029 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418261    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418263    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418266    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418268    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418271    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418274    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418277    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418281    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418284    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418287    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418290    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418292    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418295    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418297    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418300    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418302    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418305    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418308    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418311    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 02:26:04.425588 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418314    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418317    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418319    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418322    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418324    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418327    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418330    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418332    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418335    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418337    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418340    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418343    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418347    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418349    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418352    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418354    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418357    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418359    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418362    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418365    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 02:26:04.426048 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418367    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418370    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418372    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418375    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418377    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418380    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418383    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418385    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418388    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418390    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418394    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418396    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418400    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418403    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418405    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418408    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418411    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418413    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418416    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418418    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 02:26:04.426530 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418421    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418423    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418426    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418430    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418434    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418437    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418440    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418444    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418447    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418450    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418453    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418456    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418458    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418461    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418466    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418469    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418471    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418474    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418476    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 02:26:04.427058 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418479    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 02:26:04.427523 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418481    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 02:26:04.427523 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418483    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 02:26:04.427523 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418486    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 02:26:04.427523 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418489    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 02:26:04.427523 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.418493    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 02:26:04.427523 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.419184    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 02:26:04.427523 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.425727    2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 02:26:04.427523 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.425741    2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 02:26:04.427523 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.425758    2554 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 02:26:04.427523 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.425768    2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 02:26:04.427523 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425826    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 02:26:04.427523 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425832    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 02:26:04.427523 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425835    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 02:26:04.427523 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425838    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425841    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425844    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425847    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425851    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425855    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425858    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425861    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425864    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425867    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425870    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425873    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425876    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425878    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425881    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425883    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425886    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425889    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425891    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 02:26:04.427974 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425894    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425896    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425899    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425902    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425904    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425907    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425909    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425916    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425919    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425922    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425925    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425928    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425930    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425933    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425935    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425938    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425941    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425943    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425946    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425949    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425951    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 02:26:04.428443 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425954    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425956    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425959    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425962    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425965    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425967    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425969    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425972    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425974    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425977    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425979    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425982    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425984    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425987    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425990    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425992    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425994    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.425997    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426000    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426003    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 02:26:04.429030 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426006    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426008    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426011    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426013    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426016    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426018    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426021    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426023    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426025    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426028    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426030    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426034    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426037    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426040    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426043    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426045    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426048    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426050    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426053    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 02:26:04.429524 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426056    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426060    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426064    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426067    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426070    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426072    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426075    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426077    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426080    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426083    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426085    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426087    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426090    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426093    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426096    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426099    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 02:26:04.430024 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426101    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 02:26:04.430448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.426106    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 02:26:04.430448 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426213    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 02:26:04.430448 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426218    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 02:26:04.430448 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426222    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 02:26:04.430448 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426226    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 02:26:04.430448 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426229    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 02:26:04.430448 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426232    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 02:26:04.430448 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426235    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 02:26:04.430448 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426238    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 02:26:04.430448 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426241    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 02:26:04.430448 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426244    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 02:26:04.430448 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426247    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 02:26:04.430448 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426250    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 02:26:04.430448 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426252    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426256    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426258    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426261    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426263    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426266    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426269    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426272    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426274    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426277    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426280    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426282    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426285    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426287    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426289    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426292    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426295    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426297    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426300    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426302    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426304    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 02:26:04.430869 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426307    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426310    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426312    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426314    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426317    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426319    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426322    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426324    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426327    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426329    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426332    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426334    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426337    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426339    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426343    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426346    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426349    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426351    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426354    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 02:26:04.431365 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426357    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426359    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426362    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426364    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426367    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426370    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426372    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426375    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426378    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426381    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426383    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426386    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426388    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426390    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426393    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426395    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426398    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426400    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426403    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426405    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 02:26:04.431847 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426408    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426411    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426413    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426416    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426418    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426421    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426423    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426426    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426428    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426430    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426433    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426436    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426438    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426441    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426443    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426446    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426448    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426451    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426453    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 02:26:04.432326 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426456    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 02:26:04.432793 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426459    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 02:26:04.432793 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426462    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 02:26:04.432793 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426465    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 02:26:04.432793 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426468    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 02:26:04.432793 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426470    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 02:26:04.432793 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426473    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 02:26:04.432793 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:04.426475    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 02:26:04.432793 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.426480    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 02:26:04.432793 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.426598    2554 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 02:26:04.432793 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.428506    2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 02:26:04.432793 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.429788    2554 server.go:1019] "Starting client certificate rotation"
Jul 30 02:26:04.432793 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.429891    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 02:26:04.432793 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.429925    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 02:26:04.433124 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.432040    2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 02:26:04.433157 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.433117    2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 02:26:04.445521 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.445490    2554 log.go:25] "Validated CRI v1 runtime API"
Jul 30 02:26:04.448161 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.448146    2554 log.go:25] "Validated CRI v1 image API"
Jul 30 02:26:04.448974 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.448959    2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 02:26:04.451147 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.451130    2554 fs.go:135] Filesystem UUIDs: map[14d3838e-cb6c-48f9-a44d-fb8997472707:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 92e1047a-bd79-4035-8375-793e16caf1e7:/dev/nvme0n1p4]
Jul 30 02:26:04.451199 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.451148    2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 02:26:04.455977 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.455861    2554 manager.go:216] Machine: {Timestamp:2026-07-30 02:26:04.454686297 +0000 UTC m=+0.304999018 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100684 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29d8e7f4a0674c573a4c0aea8abf48 SystemUUID:ec29d8e7-f4a0-674c-573a-4c0aea8abf48 BootID:c4a70bc5-f969-4573-8b08-b9b45d7fd00b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2d:e2:76:41:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2d:e2:76:41:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:74:a9:82:28:1e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 02:26:04.455977 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.455967    2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 02:26:04.456106 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.456041    2554 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 02:26:04.457360 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.457336    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 02:26:04.458679 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.458651    2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 02:26:04.458833 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.458686    2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-75.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 02:26:04.459364 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.459352    2554 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 02:26:04.459425 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.459369    2554 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 02:26:04.459425 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.459380    2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 02:26:04.459952 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.459939    2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 02:26:04.461082 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.461071    2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 02:26:04.463915 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.463901    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 02:26:04.464060 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.464049    2554 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 02:26:04.464118 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.464085    2554 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 02:26:04.464118 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.464107    2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 02:26:04.464204 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.464127    2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 02:26:04.464204 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.464157    2554 kubelet.go:398] "Adding apiserver pod source"
Jul 30 02:26:04.464204 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.464182    2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 02:26:04.464524 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.464510    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 02:26:04.464616 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.464535    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 02:26:04.466599 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.466584    2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 02:26:04.467788 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.467776    2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 02:26:04.467833 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.467805    2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 02:26:04.468860 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.468849    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 02:26:04.468900 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.468865    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 02:26:04.468900 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.468872    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 02:26:04.468900 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.468877    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 02:26:04.468900 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.468886    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 02:26:04.468900 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.468893    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 02:26:04.469024 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.468903    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 02:26:04.469024 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.468909    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 02:26:04.469024 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.468915    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 02:26:04.469024 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.468922    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 02:26:04.469024 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.468935    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 02:26:04.469024 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.468941    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 02:26:04.469668 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.469659    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 02:26:04.469668 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.469667    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 02:26:04.472736 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.472722    2554 server.go:1268] "Started kubelet"
Jul 30 02:26:04.472853 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.472806    2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 02:26:04.472957 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.472832    2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 02:26:04.472957 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.472869    2554 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 02:26:04.473491 ip-10-0-136-75 systemd[1]: Started Kubernetes Kubelet.
Jul 30 02:26:04.474941 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.474922    2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 02:26:04.475036 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.474933    2554 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 02:26:04.476202 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.476182    2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-75.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 02:26:04.476202 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.476198    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 02:26:04.476352 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.476280    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-75.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 02:26:04.478427 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.478411    2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 02:26:04.478522 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.477562    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-75.ec2.internal.18c6f029c41027dc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-75.ec2.internal,UID:ip-10-0-136-75.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-75.ec2.internal,},FirstTimestamp:2026-07-30 02:26:04.472698844 +0000 UTC m=+0.323011567,LastTimestamp:2026-07-30 02:26:04.472698844 +0000 UTC m=+0.323011567,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-75.ec2.internal,}"
Jul 30 02:26:04.481433 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.481418    2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 02:26:04.481433 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.481432    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 02:26:04.481594 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.481578    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-75.ec2.internal\" not found"
Jul 30 02:26:04.482258 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.482141    2554 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 02:26:04.482322 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.482261    2554 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 02:26:04.482523 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.482506    2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 02:26:04.483259 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.483232    2554 factory.go:55] Registering systemd factory
Jul 30 02:26:04.483360 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.483349    2554 factory.go:223] Registration of the systemd container factory successfully
Jul 30 02:26:04.483502 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.483241    2554 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 02:26:04.483738 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.483710    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 02:26:04.483831 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.483751    2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-75.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 02:26:04.483881 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.483835    2554 factory.go:153] Registering CRI-O factory
Jul 30 02:26:04.483881 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.483873    2554 factory.go:223] Registration of the crio container factory successfully
Jul 30 02:26:04.484074 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.483586    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sqqx7"
Jul 30 02:26:04.484074 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.483946    2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 02:26:04.484074 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.483971    2554 factory.go:103] Registering Raw factory
Jul 30 02:26:04.484074 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.483986    2554 manager.go:1196] Started watching for new ooms in manager
Jul 30 02:26:04.484447 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.483611    2554 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 02:26:04.484447 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.484345    2554 manager.go:349] Starting recovery of all containers
Jul 30 02:26:04.488074 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.488051    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sqqx7"
Jul 30 02:26:04.495101 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.495086    2554 manager.go:354] Recovery completed
Jul 30 02:26:04.499273 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.499262    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 02:26:04.501155 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.501139    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 02:26:04.501250 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.501165    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 02:26:04.501250 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.501174    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasSufficientPID"
Jul 30 02:26:04.501699 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.501681    2554 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 02:26:04.501699 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.501695    2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 02:26:04.501779 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.501703    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 02:26:04.501779 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.501712    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 02:26:04.502352 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.502339    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 02:26:04.502400 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.502361    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 02:26:04.502400 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.502371    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasSufficientPID"
Jul 30 02:26:04.502866 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.502855    2554 policy_none.go:49] "None policy: Start"
Jul 30 02:26:04.502898 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.502870    2554 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 02:26:04.502898 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.502882    2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 02:26:04.503346 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.503291    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-75.ec2.internal.18c6f029c5c25277  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-75.ec2.internal,UID:ip-10-0-136-75.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-75.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-75.ec2.internal,},FirstTimestamp:2026-07-30 02:26:04.501152375 +0000 UTC m=+0.351465097,LastTimestamp:2026-07-30 02:26:04.501152375 +0000 UTC m=+0.351465097,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-75.ec2.internal,}"
Jul 30 02:26:04.503981 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.503970    2554 policy_none.go:47] "Start"
Jul 30 02:26:04.536844 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.536735    2554 manager.go:337] "Starting Device Plugin manager"
Jul 30 02:26:04.536953 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.536865    2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 02:26:04.536953 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.536878    2554 server.go:87] "Starting device plugin registration server"
Jul 30 02:26:04.537113 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.537101    2554 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 02:26:04.537172 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.537115    2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 02:26:04.537221 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.537202    2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 02:26:04.537288 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.537275    2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 02:26:04.537288 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.537288    2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 02:26:04.537913 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.537894    2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 02:26:04.537984 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.537949    2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-75.ec2.internal\" not found"
Jul 30 02:26:04.633376 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.633350    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 02:26:04.634536 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.634519    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 02:26:04.634607 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.634582    2554 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 02:26:04.634642 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.634614    2554 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 02:26:04.634676 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.634654    2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 02:26:04.636762 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.636742    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 02:26:04.637213 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.637198    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 02:26:04.637947 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.637931    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 02:26:04.638033 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.637960    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 02:26:04.638033 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.637970    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasSufficientPID"
Jul 30 02:26:04.638033 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.637996    2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.645507 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.645494    2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.645574 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.645514    2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-75.ec2.internal\": node \"ip-10-0-136-75.ec2.internal\" not found"
Jul 30 02:26:04.659316 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.659275    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-75.ec2.internal\" not found"
Jul 30 02:26:04.734730 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.734703    2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-75.ec2.internal"]
Jul 30 02:26:04.734818 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.734774    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 02:26:04.736055 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.736040    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 02:26:04.736118 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.736069    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 02:26:04.736118 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.736080    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasSufficientPID"
Jul 30 02:26:04.737204 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.737193    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 02:26:04.737330 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.737317    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.737363 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.737346    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 02:26:04.737881 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.737866    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 02:26:04.737942 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.737893    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 02:26:04.737942 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.737902    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasSufficientPID"
Jul 30 02:26:04.738005 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.737868    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 02:26:04.738005 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.737965    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 02:26:04.738005 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.737975    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasSufficientPID"
Jul 30 02:26:04.738973 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.738959    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.739029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.738983    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 02:26:04.739623 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.739603    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 02:26:04.739702 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.739631    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 02:26:04.739702 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.739648    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeHasSufficientPID"
Jul 30 02:26:04.760468 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.760443    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-75.ec2.internal\" not found"
Jul 30 02:26:04.767254 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.767240    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-75.ec2.internal\" not found" node="ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.771501 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.771486    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-75.ec2.internal\" not found" node="ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.785789 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.785769    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2425b5be2fe9a31718cb99e90a08b50f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal\" (UID: \"2425b5be2fe9a31718cb99e90a08b50f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.785847 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.785795    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2425b5be2fe9a31718cb99e90a08b50f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal\" (UID: \"2425b5be2fe9a31718cb99e90a08b50f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.785847 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.785810    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4856b1a7fc480724b4b36024a45631a3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-75.ec2.internal\" (UID: \"4856b1a7fc480724b4b36024a45631a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.861255 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.861237    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-75.ec2.internal\" not found"
Jul 30 02:26:04.886212 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.886191    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2425b5be2fe9a31718cb99e90a08b50f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal\" (UID: \"2425b5be2fe9a31718cb99e90a08b50f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.886282 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.886252    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2425b5be2fe9a31718cb99e90a08b50f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal\" (UID: \"2425b5be2fe9a31718cb99e90a08b50f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.886329 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.886288    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2425b5be2fe9a31718cb99e90a08b50f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal\" (UID: \"2425b5be2fe9a31718cb99e90a08b50f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.886329 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.886303    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2425b5be2fe9a31718cb99e90a08b50f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal\" (UID: \"2425b5be2fe9a31718cb99e90a08b50f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.886329 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.886326    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4856b1a7fc480724b4b36024a45631a3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-75.ec2.internal\" (UID: \"4856b1a7fc480724b4b36024a45631a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.886436 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:04.886358    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4856b1a7fc480724b4b36024a45631a3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-75.ec2.internal\" (UID: \"4856b1a7fc480724b4b36024a45631a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:04.963680 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:04.963623    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-75.ec2.internal\" not found"
Jul 30 02:26:05.069267 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:05.069218    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-75.ec2.internal\" not found"
Jul 30 02:26:05.069267 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.069276    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:05.074974 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.074956    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:05.174017 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:05.173970    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-75.ec2.internal\" not found"
Jul 30 02:26:05.277841 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:05.277766    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-75.ec2.internal\" not found"
Jul 30 02:26:05.287328 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.287311    2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 02:26:05.382472 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.382442    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:05.392320 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.392300    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 02:26:05.394638 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.394601    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 02:26:05.396456 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.396441    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-75.ec2.internal"
Jul 30 02:26:05.405897 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.405880    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 02:26:05.417699 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.417680    2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 02:26:05.429024 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.429003    2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 02:26:05.429136 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.429114    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 02:26:05.429199 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.429149    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 02:26:05.429199 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.429173    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 02:26:05.429284 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.429180    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 02:26:05.465844 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.465819    2554 apiserver.go:52] "Watching apiserver"
Jul 30 02:26:05.482000 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.481979    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 02:26:05.486110 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.486092    2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 02:26:05.486454 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.486435    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-sv8rz","openshift-image-registry/node-ca-2qsc5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal","openshift-multus/multus-additional-cni-plugins-7j8cv","openshift-network-diagnostics/network-check-target-7jsxw","kube-system/global-pull-secret-syncer-8bthc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv","openshift-multus/multus-8nlws","openshift-multus/network-metrics-daemon-5jft6","openshift-network-operator/iptables-alerter-vw57k","openshift-ovn-kubernetes/ovnkube-node-z7f7z","kube-system/konnectivity-agent-jtxnn","kube-system/kube-apiserver-proxy-ip-10-0-136-75.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9h6rh"]
Jul 30 02:26:05.488926 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.488907    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.491289 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.491269    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 02:26:05.491397 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.491291    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 02:26:05.491397 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.491341    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.491520 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.491435    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 02:26:05.491520 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.491342    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q28cn\""
Jul 30 02:26:05.491648 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.491566    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 02:21:04 +0000 UTC" deadline="2028-04-13 11:01:25.359233458 +0000 UTC"
Jul 30 02:26:05.491648 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.491627    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14960h35m19.867610658s"
Jul 30 02:26:05.492504 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.492481    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 02:26:05.492944 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.492927    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.493493 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.493476    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 02:26:05.493740 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.493724    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fp77g\""
Jul 30 02:26:05.493804 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.493764    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 02:26:05.494285 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.494271    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sv8rz"
Jul 30 02:26:05.495047 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.495028    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 02:26:05.495114 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.495102    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 02:26:05.495191 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.495174    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8cwr6\""
Jul 30 02:26:05.495376 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.495361    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 02:26:05.495424 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.495411    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 02:26:05.495478 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.495412    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 02:26:05.495849 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.495834    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:05.495914 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:05.495891    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:05.496553 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.496539    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 02:26:05.498356 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.497000    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 02:26:05.498356 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.497473    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wp249\""
Jul 30 02:26:05.498356 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.497807    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:05.498356 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:05.497880    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:05.499781 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.499761    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.501880 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.501864    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 02:26:05.501959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.501881    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qnnvm\""
Jul 30 02:26:05.502211 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.502198    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:05.502293 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:05.502274    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:05.503664 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.503649    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vw57k"
Jul 30 02:26:05.505469 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.505451    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.506260 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.506176    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 02:26:05.506331 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.506281    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n4mnt\""
Jul 30 02:26:05.506385 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.506326    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 02:26:05.506385 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.506374    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 02:26:05.507317 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.507297    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jtxnn"
Jul 30 02:26:05.508176 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.508160    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 02:26:05.508274 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.508214    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 02:26:05.508274 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.508259    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 02:26:05.508570 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.508552    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9knf7\""
Jul 30 02:26:05.508673 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.508622    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 02:26:05.508673 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.508640    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 02:26:05.508789 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.508642    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 02:26:05.508990 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.508973    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2qsc5"
Jul 30 02:26:05.509714 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.509694    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 02:26:05.509714 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.509712    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4gwwr\""
Jul 30 02:26:05.510138 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.510123    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 02:26:05.511305 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.511286    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 02:26:05.511430 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.511288    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 02:26:05.511430 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.511342    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tlvkt\""
Jul 30 02:26:05.511643 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.511625    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 02:26:05.518694 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.518672    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tfmxl"
Jul 30 02:26:05.527593 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.527553    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tfmxl"
Jul 30 02:26:05.583383 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.583364    2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 02:26:05.590910 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.590883    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4hcf\" (UniqueName: \"kubernetes.io/projected/751d0197-5c04-418f-a656-a9396612d072-kube-api-access-t4hcf\") pod \"node-resolver-sv8rz\" (UID: \"751d0197-5c04-418f-a656-a9396612d072\") " pod="openshift-dns/node-resolver-sv8rz"
Jul 30 02:26:05.590910 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.590916    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clh2j\" (UniqueName: \"kubernetes.io/projected/c75033ab-a299-4583-86d9-ea212ccb4598-kube-api-access-clh2j\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.590910 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.590935    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-modprobe-d\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.591200 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.590951    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-kubernetes\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.591200 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.590971    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-tuned\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.591200 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.590987    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-system-cni-dir\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.591200 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591005    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-node-log\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.591200 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591065    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-sys-fs\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.591200 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591131    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-run\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.591200 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591164    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-var-lib-kubelet\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.591561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591210    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-run-netns\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.591561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591234    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-ovnkube-config\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.591561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591256    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df95b109-705c-4fb3-9605-4d96ed3fa417-host\") pod \"node-ca-2qsc5\" (UID: \"df95b109-705c-4fb3-9605-4d96ed3fa417\") " pod="openshift-image-registry/node-ca-2qsc5"
Jul 30 02:26:05.591561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591280    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-systemd-units\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.591561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591306    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-var-lib-openvswitch\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.591561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591331    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-ovn-node-metrics-cert\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.591561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591379    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.591561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591425    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-cnibin\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.591561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591471    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-systemd\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.591561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591494    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-kubelet\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.591561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591536    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-multus-socket-dir-parent\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.591561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591564    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-run-netns\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.592034 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591609    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-hostroot\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.592034 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591636    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-etc-kubernetes\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.592034 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591684    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-lib-modules\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.592034 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591714    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.592034 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591732    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-dbus\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:05.592034 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591770    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-slash\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.592034 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591855    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.592034 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591888    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/834558a0-77d5-4868-b66e-27e265159b28-konnectivity-ca\") pod \"konnectivity-agent-jtxnn\" (UID: \"834558a0-77d5-4868-b66e-27e265159b28\") " pod="kube-system/konnectivity-agent-jtxnn"
Jul 30 02:26:05.592034 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591914    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-socket-dir\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.592034 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591940    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-multus-conf-dir\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.592034 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.591990    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.592034 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592020    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-cni-bin\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592058    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-cni-netd\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592083    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwnhm\" (UniqueName: \"kubernetes.io/projected/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-kube-api-access-qwnhm\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592096    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-device-dir\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592110    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt5p8\" (UniqueName: \"kubernetes.io/projected/7424401e-7fa0-4127-bfb2-f92b65f1078e-kube-api-access-nt5p8\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592174    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/751d0197-5c04-418f-a656-a9396612d072-tmp-dir\") pod \"node-resolver-sv8rz\" (UID: \"751d0197-5c04-418f-a656-a9396612d072\") " pod="openshift-dns/node-resolver-sv8rz"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592223    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df95b109-705c-4fb3-9605-4d96ed3fa417-serviceca\") pod \"node-ca-2qsc5\" (UID: \"df95b109-705c-4fb3-9605-4d96ed3fa417\") " pod="openshift-image-registry/node-ca-2qsc5"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592254    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-cni-binary-copy\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592279    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkbwm\" (UniqueName: \"kubernetes.io/projected/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-kube-api-access-gkbwm\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592296    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592313    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l57mf\" (UniqueName: \"kubernetes.io/projected/d63589b0-6bb2-49ac-ba89-77bf658ce7be-kube-api-access-l57mf\") pod \"iptables-alerter-vw57k\" (UID: \"d63589b0-6bb2-49ac-ba89-77bf658ce7be\") " pod="openshift-network-operator/iptables-alerter-vw57k"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592331    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c75033ab-a299-4583-86d9-ea212ccb4598-cni-binary-copy\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592358    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-run-multus-certs\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592373    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-sysconfig\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592394    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-host\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592443    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d63589b0-6bb2-49ac-ba89-77bf658ce7be-iptables-alerter-script\") pod \"iptables-alerter-vw57k\" (UID: \"d63589b0-6bb2-49ac-ba89-77bf658ce7be\") " pod="openshift-network-operator/iptables-alerter-vw57k"
Jul 30 02:26:05.592663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592480    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-etc-openvswitch\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.593339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.592509    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-run-ovn\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.593339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593017    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-env-overrides\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.593339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593055    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-ovnkube-script-lib\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.593339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593080    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-sys\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.593339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593105    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-os-release\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.593339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593132    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d63589b0-6bb2-49ac-ba89-77bf658ce7be-host-slash\") pod \"iptables-alerter-vw57k\" (UID: \"d63589b0-6bb2-49ac-ba89-77bf658ce7be\") " pod="openshift-network-operator/iptables-alerter-vw57k"
Jul 30 02:26:05.593339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593176    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-run-openvswitch\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.593339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593200    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/834558a0-77d5-4868-b66e-27e265159b28-agent-certs\") pod \"konnectivity-agent-jtxnn\" (UID: \"834558a0-77d5-4868-b66e-27e265159b28\") " pod="kube-system/konnectivity-agent-jtxnn"
Jul 30 02:26:05.593339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593231    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-run-k8s-cni-cncf-io\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.593339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593261    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c75033ab-a299-4583-86d9-ea212ccb4598-multus-daemon-config\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.593339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593284    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:05.593339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593299    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-sysctl-d\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.593339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593329    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-kubelet-config\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593365    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/751d0197-5c04-418f-a656-a9396612d072-hosts-file\") pod \"node-resolver-sv8rz\" (UID: \"751d0197-5c04-418f-a656-a9396612d072\") " pod="openshift-dns/node-resolver-sv8rz"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593383    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-system-cni-dir\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593405    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-var-lib-cni-bin\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593453    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhf2c\" (UniqueName: \"kubernetes.io/projected/e8d68db5-cc2c-417c-9027-b71ea9c67cee-kube-api-access-xhf2c\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593469    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-os-release\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593482    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-var-lib-cni-multus\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593504    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twfqk\" (UniqueName: \"kubernetes.io/projected/df95b109-705c-4fb3-9605-4d96ed3fa417-kube-api-access-twfqk\") pod \"node-ca-2qsc5\" (UID: \"df95b109-705c-4fb3-9605-4d96ed3fa417\") " pod="openshift-image-registry/node-ca-2qsc5"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593544    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eacab9b4-3983-46ea-9d40-b53ea3b953db-tmp\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593601    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-cnibin\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593645    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593677    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-log-socket\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593709    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-registration-dir\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593735    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-multus-cni-dir\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593761    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-var-lib-kubelet\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593803    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-sysctl-conf\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.593978 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593831    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.594830 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593876    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq5dz\" (UniqueName: \"kubernetes.io/projected/eacab9b4-3983-46ea-9d40-b53ea3b953db-kube-api-access-bq5dz\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.594830 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593911    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44w82\" (UniqueName: \"kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82\") pod \"network-check-target-7jsxw\" (UID: \"816208a4-330c-4b87-a3cd-913b22acc969\") " pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:05.594830 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593954    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-run-systemd\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.594830 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.593985    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-etc-selinux\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.619976 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:05.619946    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2425b5be2fe9a31718cb99e90a08b50f.slice/crio-e982ed8a7caf10576a132dcad8a772f0c910ae8818428167678cd77c828bc098 WatchSource:0}: Error finding container e982ed8a7caf10576a132dcad8a772f0c910ae8818428167678cd77c828bc098: Status 404 returned error can't find the container with id e982ed8a7caf10576a132dcad8a772f0c910ae8818428167678cd77c828bc098
Jul 30 02:26:05.620286 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:05.620268    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4856b1a7fc480724b4b36024a45631a3.slice/crio-0e992b1c282ea2ead2cd23e4cd450bbfdd86a8abf664ad2543046b9f0fe83473 WatchSource:0}: Error finding container 0e992b1c282ea2ead2cd23e4cd450bbfdd86a8abf664ad2543046b9f0fe83473: Status 404 returned error can't find the container with id 0e992b1c282ea2ead2cd23e4cd450bbfdd86a8abf664ad2543046b9f0fe83473
Jul 30 02:26:05.626949 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.626131    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 02:26:05.637909 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.637832    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal" event={"ID":"2425b5be2fe9a31718cb99e90a08b50f","Type":"ContainerStarted","Data":"e982ed8a7caf10576a132dcad8a772f0c910ae8818428167678cd77c828bc098"}
Jul 30 02:26:05.639135 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.639114    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-75.ec2.internal" event={"ID":"4856b1a7fc480724b4b36024a45631a3","Type":"ContainerStarted","Data":"0e992b1c282ea2ead2cd23e4cd450bbfdd86a8abf664ad2543046b9f0fe83473"}
Jul 30 02:26:05.695314 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695286    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-cnibin\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.695314 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695316    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.695481 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695333    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-log-socket\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.695481 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695350    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-registration-dir\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.695481 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695375    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-multus-cni-dir\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.695481 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695391    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-var-lib-kubelet\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.695481 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695393    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-cnibin\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.695481 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695413    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-sysctl-conf\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.695481 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695419    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-log-socket\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.695481 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695452    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-registration-dir\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.695481 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695455    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695488    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-var-lib-kubelet\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695502    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq5dz\" (UniqueName: \"kubernetes.io/projected/eacab9b4-3983-46ea-9d40-b53ea3b953db-kube-api-access-bq5dz\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695490    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695543    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44w82\" (UniqueName: \"kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82\") pod \"network-check-target-7jsxw\" (UID: \"816208a4-330c-4b87-a3cd-913b22acc969\") " pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695578    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-multus-cni-dir\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695546    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-sysctl-conf\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695602    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-run-systemd\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695576    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695630    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-etc-selinux\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695654    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-run-systemd\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695655    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4hcf\" (UniqueName: \"kubernetes.io/projected/751d0197-5c04-418f-a656-a9396612d072-kube-api-access-t4hcf\") pod \"node-resolver-sv8rz\" (UID: \"751d0197-5c04-418f-a656-a9396612d072\") " pod="openshift-dns/node-resolver-sv8rz"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695701    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clh2j\" (UniqueName: \"kubernetes.io/projected/c75033ab-a299-4583-86d9-ea212ccb4598-kube-api-access-clh2j\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695729    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-modprobe-d\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695730    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-etc-selinux\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695756    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-kubernetes\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695781    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-tuned\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.695959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695809    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-system-cni-dir\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695827    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-kubernetes\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695837    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-modprobe-d\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695853    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-system-cni-dir\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695908    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-node-log\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695929    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-sys-fs\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695946    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-run\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695964    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-var-lib-kubelet\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.695987    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-run-netns\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696006    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-ovnkube-config\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696027    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df95b109-705c-4fb3-9605-4d96ed3fa417-host\") pod \"node-ca-2qsc5\" (UID: \"df95b109-705c-4fb3-9605-4d96ed3fa417\") " pod="openshift-image-registry/node-ca-2qsc5"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696030    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-run\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696039    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-sys-fs\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696049    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-node-log\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696044    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-var-lib-kubelet\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696077    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df95b109-705c-4fb3-9605-4d96ed3fa417-host\") pod \"node-ca-2qsc5\" (UID: \"df95b109-705c-4fb3-9605-4d96ed3fa417\") " pod="openshift-image-registry/node-ca-2qsc5"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696065    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-systemd-units\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696095    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-systemd-units\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.696755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696103    2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696142    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-run-netns\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696144    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-var-lib-openvswitch\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696173    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-var-lib-openvswitch\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696175    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-ovn-node-metrics-cert\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696210    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696233    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-cnibin\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696266    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-systemd\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696278    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-cnibin\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696264    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696293    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-kubelet\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696311    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-systemd\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696321    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-multus-socket-dir-parent\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696360    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-kubelet\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696377    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-multus-socket-dir-parent\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696394    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-run-netns\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696423    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-run-netns\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696430    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-hostroot\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.697560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696455    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-etc-kubernetes\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696472    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-lib-modules\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696489    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696525    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-dbus\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696546    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-etc-kubernetes\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696576    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-slash\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696606    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-hostroot\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696615    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696642    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/834558a0-77d5-4868-b66e-27e265159b28-konnectivity-ca\") pod \"konnectivity-agent-jtxnn\" (UID: \"834558a0-77d5-4868-b66e-27e265159b28\") " pod="kube-system/konnectivity-agent-jtxnn"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696646    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-lib-modules\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696665    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-socket-dir\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696667    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-ovnkube-config\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696691    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-multus-conf-dir\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696704    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696719    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696771    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-dbus\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696767    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-cni-bin\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.698510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696816    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-multus-conf-dir\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696854    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-slash\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696882    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-cni-bin\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696926    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-cni-netd\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696955    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwnhm\" (UniqueName: \"kubernetes.io/projected/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-kube-api-access-qwnhm\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696970    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-host-cni-netd\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696927    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-socket-dir\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.696981    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-device-dir\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697020    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt5p8\" (UniqueName: \"kubernetes.io/projected/7424401e-7fa0-4127-bfb2-f92b65f1078e-kube-api-access-nt5p8\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697031    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7424401e-7fa0-4127-bfb2-f92b65f1078e-device-dir\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697067    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/751d0197-5c04-418f-a656-a9396612d072-tmp-dir\") pod \"node-resolver-sv8rz\" (UID: \"751d0197-5c04-418f-a656-a9396612d072\") " pod="openshift-dns/node-resolver-sv8rz"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697104    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df95b109-705c-4fb3-9605-4d96ed3fa417-serviceca\") pod \"node-ca-2qsc5\" (UID: \"df95b109-705c-4fb3-9605-4d96ed3fa417\") " pod="openshift-image-registry/node-ca-2qsc5"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697153    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-cni-binary-copy\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697172    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697181    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkbwm\" (UniqueName: \"kubernetes.io/projected/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-kube-api-access-gkbwm\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697215    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697261    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l57mf\" (UniqueName: \"kubernetes.io/projected/d63589b0-6bb2-49ac-ba89-77bf658ce7be-kube-api-access-l57mf\") pod \"iptables-alerter-vw57k\" (UID: \"d63589b0-6bb2-49ac-ba89-77bf658ce7be\") " pod="openshift-network-operator/iptables-alerter-vw57k"
Jul 30 02:26:05.699437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697288    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c75033ab-a299-4583-86d9-ea212ccb4598-cni-binary-copy\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697336    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-run-multus-certs\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697359    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/834558a0-77d5-4868-b66e-27e265159b28-konnectivity-ca\") pod \"konnectivity-agent-jtxnn\" (UID: \"834558a0-77d5-4868-b66e-27e265159b28\") " pod="kube-system/konnectivity-agent-jtxnn"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697380    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-sysconfig\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697452    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-host\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697477    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/751d0197-5c04-418f-a656-a9396612d072-tmp-dir\") pod \"node-resolver-sv8rz\" (UID: \"751d0197-5c04-418f-a656-a9396612d072\") " pod="openshift-dns/node-resolver-sv8rz"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697495    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d63589b0-6bb2-49ac-ba89-77bf658ce7be-iptables-alerter-script\") pod \"iptables-alerter-vw57k\" (UID: \"d63589b0-6bb2-49ac-ba89-77bf658ce7be\") " pod="openshift-network-operator/iptables-alerter-vw57k"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697560    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-etc-openvswitch\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697587    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-run-ovn\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697614    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-env-overrides\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697658    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-ovnkube-script-lib\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697687    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-sys\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697715    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-os-release\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697741    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d63589b0-6bb2-49ac-ba89-77bf658ce7be-host-slash\") pod \"iptables-alerter-vw57k\" (UID: \"d63589b0-6bb2-49ac-ba89-77bf658ce7be\") " pod="openshift-network-operator/iptables-alerter-vw57k"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697742    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df95b109-705c-4fb3-9605-4d96ed3fa417-serviceca\") pod \"node-ca-2qsc5\" (UID: \"df95b109-705c-4fb3-9605-4d96ed3fa417\") " pod="openshift-image-registry/node-ca-2qsc5"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697768    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-run-openvswitch\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697795    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/834558a0-77d5-4868-b66e-27e265159b28-agent-certs\") pod \"konnectivity-agent-jtxnn\" (UID: \"834558a0-77d5-4868-b66e-27e265159b28\") " pod="kube-system/konnectivity-agent-jtxnn"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697820    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-run-k8s-cni-cncf-io\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.700159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697845    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c75033ab-a299-4583-86d9-ea212ccb4598-multus-daemon-config\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697883    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:05.697922    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.697957    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-sys\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698003    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-etc-openvswitch\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:05.698018    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret podName:73225a1c-d6ba-4d8b-a7d7-65187d4b51b6 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:06.197979307 +0000 UTC m=+2.048292041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret") pod "global-pull-secret-syncer-8bthc" (UID: "73225a1c-d6ba-4d8b-a7d7-65187d4b51b6") : object "kube-system"/"original-pull-secret" not registered
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698048    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698062    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-run-ovn\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698080    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-sysctl-d\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698127    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-kubelet-config\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698158    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/751d0197-5c04-418f-a656-a9396612d072-hosts-file\") pod \"node-resolver-sv8rz\" (UID: \"751d0197-5c04-418f-a656-a9396612d072\") " pod="openshift-dns/node-resolver-sv8rz"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698182    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-system-cni-dir\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698221    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-var-lib-cni-bin\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698249    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhf2c\" (UniqueName: \"kubernetes.io/projected/e8d68db5-cc2c-417c-9027-b71ea9c67cee-kube-api-access-xhf2c\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698275    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-os-release\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698304    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-var-lib-cni-multus\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698310    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d63589b0-6bb2-49ac-ba89-77bf658ce7be-iptables-alerter-script\") pod \"iptables-alerter-vw57k\" (UID: \"d63589b0-6bb2-49ac-ba89-77bf658ce7be\") " pod="openshift-network-operator/iptables-alerter-vw57k"
Jul 30 02:26:05.700760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698332    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twfqk\" (UniqueName: \"kubernetes.io/projected/df95b109-705c-4fb3-9605-4d96ed3fa417-kube-api-access-twfqk\") pod \"node-ca-2qsc5\" (UID: \"df95b109-705c-4fb3-9605-4d96ed3fa417\") " pod="openshift-image-registry/node-ca-2qsc5"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698362    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c75033ab-a299-4583-86d9-ea212ccb4598-cni-binary-copy\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698405    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c75033ab-a299-4583-86d9-ea212ccb4598-multus-daemon-config\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698435    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-env-overrides\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698584    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-os-release\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698588    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eacab9b4-3983-46ea-9d40-b53ea3b953db-tmp\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698624    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d63589b0-6bb2-49ac-ba89-77bf658ce7be-host-slash\") pod \"iptables-alerter-vw57k\" (UID: \"d63589b0-6bb2-49ac-ba89-77bf658ce7be\") " pod="openshift-network-operator/iptables-alerter-vw57k"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698590    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-run-multus-certs\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698678    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-system-cni-dir\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698707    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-var-lib-cni-bin\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698721    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-sysconfig\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698743    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-var-lib-cni-multus\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:05.698795    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:05.698853    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs podName:e8d68db5-cc2c-417c-9027-b71ea9c67cee nodeName:}" failed. No retries permitted until 2026-07-30 02:26:06.198835676 +0000 UTC m=+2.049148421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs") pod "network-metrics-daemon-5jft6" (UID: "e8d68db5-cc2c-417c-9027-b71ea9c67cee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698879    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-cni-binary-copy\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698905    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-kubelet-config\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698945    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-os-release\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.698993    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-sysctl-d\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.701448 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.699107    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/751d0197-5c04-418f-a656-a9396612d072-hosts-file\") pod \"node-resolver-sv8rz\" (UID: \"751d0197-5c04-418f-a656-a9396612d072\") " pod="openshift-dns/node-resolver-sv8rz"
Jul 30 02:26:05.702006 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.699119    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-ovnkube-script-lib\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.702006 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.699107    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eacab9b4-3983-46ea-9d40-b53ea3b953db-host\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.702006 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.699111    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-run-openvswitch\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.702006 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.699171    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c75033ab-a299-4583-86d9-ea212ccb4598-host-run-k8s-cni-cncf-io\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.702006 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.700026    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eacab9b4-3983-46ea-9d40-b53ea3b953db-etc-tuned\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.702006 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.700168    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-ovn-node-metrics-cert\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.702006 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.700853    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eacab9b4-3983-46ea-9d40-b53ea3b953db-tmp\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.702006 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.701308    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/834558a0-77d5-4868-b66e-27e265159b28-agent-certs\") pod \"konnectivity-agent-jtxnn\" (UID: \"834558a0-77d5-4868-b66e-27e265159b28\") " pod="kube-system/konnectivity-agent-jtxnn"
Jul 30 02:26:05.715644 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:05.715621    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 02:26:05.715757 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:05.715650    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 02:26:05.715757 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:05.715664    2554 projected.go:196] Error preparing data for projected volume kube-api-access-44w82 for pod openshift-network-diagnostics/network-check-target-7jsxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 02:26:05.715757 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:05.715724    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82 podName:816208a4-330c-4b87-a3cd-913b22acc969 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:06.215708132 +0000 UTC m=+2.066020862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-44w82" (UniqueName: "kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82") pod "network-check-target-7jsxw" (UID: "816208a4-330c-4b87-a3cd-913b22acc969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 02:26:05.716525 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.716498    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq5dz\" (UniqueName: \"kubernetes.io/projected/eacab9b4-3983-46ea-9d40-b53ea3b953db-kube-api-access-bq5dz\") pod \"tuned-9h6rh\" (UID: \"eacab9b4-3983-46ea-9d40-b53ea3b953db\") " pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.717562 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.717531    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt5p8\" (UniqueName: \"kubernetes.io/projected/7424401e-7fa0-4127-bfb2-f92b65f1078e-kube-api-access-nt5p8\") pod \"aws-ebs-csi-driver-node-w2rtv\" (UID: \"7424401e-7fa0-4127-bfb2-f92b65f1078e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.717681 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.717578    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4hcf\" (UniqueName: \"kubernetes.io/projected/751d0197-5c04-418f-a656-a9396612d072-kube-api-access-t4hcf\") pod \"node-resolver-sv8rz\" (UID: \"751d0197-5c04-418f-a656-a9396612d072\") " pod="openshift-dns/node-resolver-sv8rz"
Jul 30 02:26:05.717902 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.717871    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkbwm\" (UniqueName: \"kubernetes.io/projected/c9c4aa7a-b3b2-46af-a41b-c4d68170377c-kube-api-access-gkbwm\") pod \"multus-additional-cni-plugins-7j8cv\" (UID: \"c9c4aa7a-b3b2-46af-a41b-c4d68170377c\") " pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.718714 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.718688    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l57mf\" (UniqueName: \"kubernetes.io/projected/d63589b0-6bb2-49ac-ba89-77bf658ce7be-kube-api-access-l57mf\") pod \"iptables-alerter-vw57k\" (UID: \"d63589b0-6bb2-49ac-ba89-77bf658ce7be\") " pod="openshift-network-operator/iptables-alerter-vw57k"
Jul 30 02:26:05.718811 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.718774    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twfqk\" (UniqueName: \"kubernetes.io/projected/df95b109-705c-4fb3-9605-4d96ed3fa417-kube-api-access-twfqk\") pod \"node-ca-2qsc5\" (UID: \"df95b109-705c-4fb3-9605-4d96ed3fa417\") " pod="openshift-image-registry/node-ca-2qsc5"
Jul 30 02:26:05.719186 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.719166    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhf2c\" (UniqueName: \"kubernetes.io/projected/e8d68db5-cc2c-417c-9027-b71ea9c67cee-kube-api-access-xhf2c\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:05.719345 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.719327    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwnhm\" (UniqueName: \"kubernetes.io/projected/887de7b2-9547-4b64-aa63-cb5e79cd1a5a-kube-api-access-qwnhm\") pod \"ovnkube-node-z7f7z\" (UID: \"887de7b2-9547-4b64-aa63-cb5e79cd1a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.719411 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.719394    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clh2j\" (UniqueName: \"kubernetes.io/projected/c75033ab-a299-4583-86d9-ea212ccb4598-kube-api-access-clh2j\") pod \"multus-8nlws\" (UID: \"c75033ab-a299-4583-86d9-ea212ccb4598\") " pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.810154 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.810076    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv"
Jul 30 02:26:05.818937 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:05.818913    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7424401e_7fa0_4127_bfb2_f92b65f1078e.slice/crio-657290f697b964bd3590e7701ad3815cae82ec2443e4df2887f20faa36b090ad WatchSource:0}: Error finding container 657290f697b964bd3590e7701ad3815cae82ec2443e4df2887f20faa36b090ad: Status 404 returned error can't find the container with id 657290f697b964bd3590e7701ad3815cae82ec2443e4df2887f20faa36b090ad
Jul 30 02:26:05.833509 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.833487    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9h6rh"
Jul 30 02:26:05.840454 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:05.840433    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeacab9b4_3983_46ea_9d40_b53ea3b953db.slice/crio-a80b57ec65988d27bb782366cc4ad43710ce118d3fbbb3bb41346f4b56a9d95d WatchSource:0}: Error finding container a80b57ec65988d27bb782366cc4ad43710ce118d3fbbb3bb41346f4b56a9d95d: Status 404 returned error can't find the container with id a80b57ec65988d27bb782366cc4ad43710ce118d3fbbb3bb41346f4b56a9d95d
Jul 30 02:26:05.844586 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.844567    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7j8cv"
Jul 30 02:26:05.852725 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:05.852705    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c4aa7a_b3b2_46af_a41b_c4d68170377c.slice/crio-c8c73763b597e92eb02380cf70772ce4356f12d467a74b45a3796c1772615a82 WatchSource:0}: Error finding container c8c73763b597e92eb02380cf70772ce4356f12d467a74b45a3796c1772615a82: Status 404 returned error can't find the container with id c8c73763b597e92eb02380cf70772ce4356f12d467a74b45a3796c1772615a82
Jul 30 02:26:05.860141 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.860123    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sv8rz"
Jul 30 02:26:05.867850 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:05.867826    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751d0197_5c04_418f_a656_a9396612d072.slice/crio-35616172e3ca2ad187ebaff058505900e41c75ada40c267b9833dc35a4cbadb6 WatchSource:0}: Error finding container 35616172e3ca2ad187ebaff058505900e41c75ada40c267b9833dc35a4cbadb6: Status 404 returned error can't find the container with id 35616172e3ca2ad187ebaff058505900e41c75ada40c267b9833dc35a4cbadb6
Jul 30 02:26:05.878943 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.878927    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8nlws"
Jul 30 02:26:05.885639 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:05.885605    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75033ab_a299_4583_86d9_ea212ccb4598.slice/crio-74885c3f34fc5c177e3d3e85419f3750a4c8a3d56cdc5d3d1c7e0aa0d4f8b5a9 WatchSource:0}: Error finding container 74885c3f34fc5c177e3d3e85419f3750a4c8a3d56cdc5d3d1c7e0aa0d4f8b5a9: Status 404 returned error can't find the container with id 74885c3f34fc5c177e3d3e85419f3750a4c8a3d56cdc5d3d1c7e0aa0d4f8b5a9
Jul 30 02:26:05.895052 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.895032    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vw57k"
Jul 30 02:26:05.920852 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.920828    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:05.927150 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.927123    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jtxnn"
Jul 30 02:26:05.927802 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:05.927776    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887de7b2_9547_4b64_aa63_cb5e79cd1a5a.slice/crio-0d3744baf5d243e9d291e88a64162693f9b612897740b513df4f70d6028b5244 WatchSource:0}: Error finding container 0d3744baf5d243e9d291e88a64162693f9b612897740b513df4f70d6028b5244: Status 404 returned error can't find the container with id 0d3744baf5d243e9d291e88a64162693f9b612897740b513df4f70d6028b5244
Jul 30 02:26:05.932534 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:05.932516    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2qsc5"
Jul 30 02:26:05.934859 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:05.934838    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834558a0_77d5_4868_b66e_27e265159b28.slice/crio-f773e465a64a68724aa62ce0d1c4ddcf74288f1c5924c38daea24681aaae6b25 WatchSource:0}: Error finding container f773e465a64a68724aa62ce0d1c4ddcf74288f1c5924c38daea24681aaae6b25: Status 404 returned error can't find the container with id f773e465a64a68724aa62ce0d1c4ddcf74288f1c5924c38daea24681aaae6b25
Jul 30 02:26:06.203941 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.203860    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:06.204160 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.204124    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:06.204276 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:06.204050    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 02:26:06.204276 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:06.204233    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret podName:73225a1c-d6ba-4d8b-a7d7-65187d4b51b6 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:07.204211245 +0000 UTC m=+3.054523971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret") pod "global-pull-secret-syncer-8bthc" (UID: "73225a1c-d6ba-4d8b-a7d7-65187d4b51b6") : object "kube-system"/"original-pull-secret" not registered
Jul 30 02:26:06.204276 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:06.204261    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 02:26:06.204430 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:06.204305    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs podName:e8d68db5-cc2c-417c-9027-b71ea9c67cee nodeName:}" failed. No retries permitted until 2026-07-30 02:26:07.204292091 +0000 UTC m=+3.054604820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs") pod "network-metrics-daemon-5jft6" (UID: "e8d68db5-cc2c-417c-9027-b71ea9c67cee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 02:26:06.278543 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.278516    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 02:26:06.305250 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.305218    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44w82\" (UniqueName: \"kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82\") pod \"network-check-target-7jsxw\" (UID: \"816208a4-330c-4b87-a3cd-913b22acc969\") " pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:06.305407 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:06.305388    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 02:26:06.305470 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:06.305417    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 02:26:06.305470 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:06.305431    2554 projected.go:196] Error preparing data for projected volume kube-api-access-44w82 for pod openshift-network-diagnostics/network-check-target-7jsxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 02:26:06.305598 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:06.305494    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82 podName:816208a4-330c-4b87-a3cd-913b22acc969 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:07.305475318 +0000 UTC m=+3.155788047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-44w82" (UniqueName: "kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82") pod "network-check-target-7jsxw" (UID: "816208a4-330c-4b87-a3cd-913b22acc969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 02:26:06.530353 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.530243    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 02:21:05 +0000 UTC" deadline="2028-04-23 04:49:10.992246356 +0000 UTC"
Jul 30 02:26:06.530353 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.530304    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15194h23m4.461947206s"
Jul 30 02:26:06.651017 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.649544    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jtxnn" event={"ID":"834558a0-77d5-4868-b66e-27e265159b28","Type":"ContainerStarted","Data":"f773e465a64a68724aa62ce0d1c4ddcf74288f1c5924c38daea24681aaae6b25"}
Jul 30 02:26:06.653725 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.653693    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z" event={"ID":"887de7b2-9547-4b64-aa63-cb5e79cd1a5a","Type":"ContainerStarted","Data":"0d3744baf5d243e9d291e88a64162693f9b612897740b513df4f70d6028b5244"}
Jul 30 02:26:06.672159 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.672128    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8nlws" event={"ID":"c75033ab-a299-4583-86d9-ea212ccb4598","Type":"ContainerStarted","Data":"74885c3f34fc5c177e3d3e85419f3750a4c8a3d56cdc5d3d1c7e0aa0d4f8b5a9"}
Jul 30 02:26:06.674736 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.674707    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sv8rz" event={"ID":"751d0197-5c04-418f-a656-a9396612d072","Type":"ContainerStarted","Data":"35616172e3ca2ad187ebaff058505900e41c75ada40c267b9833dc35a4cbadb6"}
Jul 30 02:26:06.687901 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.687859    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j8cv" event={"ID":"c9c4aa7a-b3b2-46af-a41b-c4d68170377c","Type":"ContainerStarted","Data":"c8c73763b597e92eb02380cf70772ce4356f12d467a74b45a3796c1772615a82"}
Jul 30 02:26:06.695202 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.695108    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv" event={"ID":"7424401e-7fa0-4127-bfb2-f92b65f1078e","Type":"ContainerStarted","Data":"657290f697b964bd3590e7701ad3815cae82ec2443e4df2887f20faa36b090ad"}
Jul 30 02:26:06.711266 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.711235    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vw57k" event={"ID":"d63589b0-6bb2-49ac-ba89-77bf658ce7be","Type":"ContainerStarted","Data":"259a11f4432a1caa94d9a4f6abdff0a2745b0bd9ddf573bb4a4f057568c62b49"}
Jul 30 02:26:06.730775 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.730749    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9h6rh" event={"ID":"eacab9b4-3983-46ea-9d40-b53ea3b953db","Type":"ContainerStarted","Data":"a80b57ec65988d27bb782366cc4ad43710ce118d3fbbb3bb41346f4b56a9d95d"}
Jul 30 02:26:06.748549 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:06.748354    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2qsc5" event={"ID":"df95b109-705c-4fb3-9605-4d96ed3fa417","Type":"ContainerStarted","Data":"28109ee0f181149184ed0f3ff14f267842842cae6551cec9d4e77bed09ffdb98"}
Jul 30 02:26:07.118472 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:07.118431    2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 02:26:07.213075 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:07.213039    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:07.213246 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:07.213098    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:07.213354 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:07.213261    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 02:26:07.213354 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:07.213313    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs podName:e8d68db5-cc2c-417c-9027-b71ea9c67cee nodeName:}" failed. No retries permitted until 2026-07-30 02:26:09.213298782 +0000 UTC m=+5.063611497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs") pod "network-metrics-daemon-5jft6" (UID: "e8d68db5-cc2c-417c-9027-b71ea9c67cee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 02:26:07.213690 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:07.213639    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 02:26:07.213690 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:07.213681    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret podName:73225a1c-d6ba-4d8b-a7d7-65187d4b51b6 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:09.21367036 +0000 UTC m=+5.063983071 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret") pod "global-pull-secret-syncer-8bthc" (UID: "73225a1c-d6ba-4d8b-a7d7-65187d4b51b6") : object "kube-system"/"original-pull-secret" not registered
Jul 30 02:26:07.314132 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:07.314077    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44w82\" (UniqueName: \"kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82\") pod \"network-check-target-7jsxw\" (UID: \"816208a4-330c-4b87-a3cd-913b22acc969\") " pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:07.314325 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:07.314251    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 02:26:07.314325 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:07.314270    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 02:26:07.314325 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:07.314286    2554 projected.go:196] Error preparing data for projected volume kube-api-access-44w82 for pod openshift-network-diagnostics/network-check-target-7jsxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 02:26:07.314507 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:07.314348    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82 podName:816208a4-330c-4b87-a3cd-913b22acc969 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:09.314326684 +0000 UTC m=+5.164639397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-44w82" (UniqueName: "kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82") pod "network-check-target-7jsxw" (UID: "816208a4-330c-4b87-a3cd-913b22acc969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 02:26:07.530851 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:07.530715    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 02:21:05 +0000 UTC" deadline="2028-03-06 07:05:02.964609826 +0000 UTC"
Jul 30 02:26:07.530851 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:07.530761    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14044h38m55.433857502s"
Jul 30 02:26:07.635388 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:07.635345    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:07.635550 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:07.635488    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:07.635957 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:07.635933    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:07.636089 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:07.636060    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:07.636168 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:07.636145    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:07.636248 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:07.636226    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:07.816337 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:07.816257    2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 02:26:08.320202 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:08.320052    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 02:26:09.232412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:09.231553    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:09.232412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:09.231630    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:09.232412 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:09.231791    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 02:26:09.232412 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:09.231856    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs podName:e8d68db5-cc2c-417c-9027-b71ea9c67cee nodeName:}" failed. No retries permitted until 2026-07-30 02:26:13.23183601 +0000 UTC m=+9.082148728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs") pod "network-metrics-daemon-5jft6" (UID: "e8d68db5-cc2c-417c-9027-b71ea9c67cee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 02:26:09.232412 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:09.232271    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 02:26:09.232412 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:09.232325    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret podName:73225a1c-d6ba-4d8b-a7d7-65187d4b51b6 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:13.232309173 +0000 UTC m=+9.082621886 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret") pod "global-pull-secret-syncer-8bthc" (UID: "73225a1c-d6ba-4d8b-a7d7-65187d4b51b6") : object "kube-system"/"original-pull-secret" not registered
Jul 30 02:26:09.333800 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:09.333035    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44w82\" (UniqueName: \"kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82\") pod \"network-check-target-7jsxw\" (UID: \"816208a4-330c-4b87-a3cd-913b22acc969\") " pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:09.333800 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:09.333227    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 02:26:09.333800 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:09.333247    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 02:26:09.333800 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:09.333259    2554 projected.go:196] Error preparing data for projected volume kube-api-access-44w82 for pod openshift-network-diagnostics/network-check-target-7jsxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 02:26:09.333800 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:09.333325    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82 podName:816208a4-330c-4b87-a3cd-913b22acc969 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:13.333304454 +0000 UTC m=+9.183617181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-44w82" (UniqueName: "kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82") pod "network-check-target-7jsxw" (UID: "816208a4-330c-4b87-a3cd-913b22acc969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 02:26:09.635603 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:09.635057    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:09.635603 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:09.635201    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:09.635603 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:09.635321    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:09.635603 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:09.635419    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:09.635603 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:09.635482    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:09.635603 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:09.635586    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:11.635501 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:11.635467    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:11.635501 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:11.635491    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:11.635985 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:11.635616    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:11.635985 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:11.635467    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:11.635985 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:11.635748    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:11.635985 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:11.635838    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:13.269493 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:13.269445    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:13.269928 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:13.269517    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:13.269928 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:13.269632    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 02:26:13.269928 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:13.269663    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 02:26:13.269928 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:13.269724    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret podName:73225a1c-d6ba-4d8b-a7d7-65187d4b51b6 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:21.269693708 +0000 UTC m=+17.120006423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret") pod "global-pull-secret-syncer-8bthc" (UID: "73225a1c-d6ba-4d8b-a7d7-65187d4b51b6") : object "kube-system"/"original-pull-secret" not registered
Jul 30 02:26:13.269928 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:13.269748    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs podName:e8d68db5-cc2c-417c-9027-b71ea9c67cee nodeName:}" failed. No retries permitted until 2026-07-30 02:26:21.269737269 +0000 UTC m=+17.120049979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs") pod "network-metrics-daemon-5jft6" (UID: "e8d68db5-cc2c-417c-9027-b71ea9c67cee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 02:26:13.370232 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:13.370196    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44w82\" (UniqueName: \"kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82\") pod \"network-check-target-7jsxw\" (UID: \"816208a4-330c-4b87-a3cd-913b22acc969\") " pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:13.370395 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:13.370376    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 02:26:13.370453 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:13.370402    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 02:26:13.370453 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:13.370416    2554 projected.go:196] Error preparing data for projected volume kube-api-access-44w82 for pod openshift-network-diagnostics/network-check-target-7jsxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 02:26:13.370540 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:13.370480    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82 podName:816208a4-330c-4b87-a3cd-913b22acc969 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:21.370459935 +0000 UTC m=+17.220772667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-44w82" (UniqueName: "kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82") pod "network-check-target-7jsxw" (UID: "816208a4-330c-4b87-a3cd-913b22acc969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 02:26:13.635629 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:13.635537    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:13.635629 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:13.635594    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:13.635629 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:13.635594    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:13.635864 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:13.635689    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:13.635864 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:13.635781    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:13.635978 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:13.635871    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:15.635040 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:15.635004    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:15.635040 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:15.635041    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:15.635581 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:15.635009    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:15.635581 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:15.635131    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:15.635581 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:15.635238    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:15.635581 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:15.635329    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:17.635098 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:17.635061    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:17.635454 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:17.635177    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:17.635454 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:17.635174    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:17.635454 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:17.635190    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:17.635454 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:17.635255    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:17.635454 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:17.635322    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:19.635725 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:19.635682    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:19.636148 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:19.635698    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:19.636148 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:19.635791    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:19.636148 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:19.635697    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:19.636148 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:19.635871    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:19.636148 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:19.635978    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:21.329289 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:21.329109    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:21.329678 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:21.329301    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:21.329678 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:21.329250    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 02:26:21.329678 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:21.329393    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 02:26:21.329678 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:21.329400    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret podName:73225a1c-d6ba-4d8b-a7d7-65187d4b51b6 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:37.329385817 +0000 UTC m=+33.179698529 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret") pod "global-pull-secret-syncer-8bthc" (UID: "73225a1c-d6ba-4d8b-a7d7-65187d4b51b6") : object "kube-system"/"original-pull-secret" not registered
Jul 30 02:26:21.329678 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:21.329430    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs podName:e8d68db5-cc2c-417c-9027-b71ea9c67cee nodeName:}" failed. No retries permitted until 2026-07-30 02:26:37.329418535 +0000 UTC m=+33.179731245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs") pod "network-metrics-daemon-5jft6" (UID: "e8d68db5-cc2c-417c-9027-b71ea9c67cee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 02:26:21.429683 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:21.429658    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44w82\" (UniqueName: \"kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82\") pod \"network-check-target-7jsxw\" (UID: \"816208a4-330c-4b87-a3cd-913b22acc969\") " pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:21.429821 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:21.429786    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 02:26:21.429821 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:21.429801    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 02:26:21.429821 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:21.429810    2554 projected.go:196] Error preparing data for projected volume kube-api-access-44w82 for pod openshift-network-diagnostics/network-check-target-7jsxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 02:26:21.429925 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:21.429853    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82 podName:816208a4-330c-4b87-a3cd-913b22acc969 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:37.429839999 +0000 UTC m=+33.280152709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-44w82" (UniqueName: "kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82") pod "network-check-target-7jsxw" (UID: "816208a4-330c-4b87-a3cd-913b22acc969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 02:26:21.635837 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:21.635771    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:21.635940 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:21.635871    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:21.635940 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:21.635895    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:21.635940 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:21.635886    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:21.636059 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:21.635983    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:21.636059 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:21.636050    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:23.635497 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:23.635450    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:23.635916 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:23.635450    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:23.635916 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:23.635593    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:23.635916 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:23.635470    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:23.635916 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:23.635631    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:23.635916 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:23.635772    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:25.635408 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:25.635376    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:25.635793 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:25.635376    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:25.635793 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:25.635480    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:25.635793 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:25.635571    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:25.635793 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:25.635377    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:25.635793 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:25.635648    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:26.810426 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.810237    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9h6rh" event={"ID":"eacab9b4-3983-46ea-9d40-b53ea3b953db","Type":"ContainerStarted","Data":"7666ffec0b163c20417a2c74f137e14bb06f7e869d296fcbb991ca11f062b6a6"}
Jul 30 02:26:26.811647 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.811627    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2qsc5" event={"ID":"df95b109-705c-4fb3-9605-4d96ed3fa417","Type":"ContainerStarted","Data":"b618a1c253d92449ef2b654c81351425769c65e5c283928a6f9259204c4eb248"}
Jul 30 02:26:26.813010 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.812987    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jtxnn" event={"ID":"834558a0-77d5-4868-b66e-27e265159b28","Type":"ContainerStarted","Data":"4300a4bbb183a2a90e1e2a9356ae1173f17a494e23ebef072ba6adef8a76dcf0"}
Jul 30 02:26:26.815515 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.815495    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:26:26.815907 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.815883    2554 generic.go:356] "Generic (PLEG): container finished" podID="887de7b2-9547-4b64-aa63-cb5e79cd1a5a" containerID="6eb70fa88c6c86bffa8508d5aa7eeb0e31eb5a5d28b2f1b9d4047deb30d060ac" exitCode=1
Jul 30 02:26:26.815977 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.815953    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z" event={"ID":"887de7b2-9547-4b64-aa63-cb5e79cd1a5a","Type":"ContainerStarted","Data":"f94314f79d76ef734a69205ceab845b0f6e342b01d38fc5327896b81a292c804"}
Jul 30 02:26:26.816045 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.816029    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z" event={"ID":"887de7b2-9547-4b64-aa63-cb5e79cd1a5a","Type":"ContainerStarted","Data":"5ce787b31eb1ea6e51e23e35cd8d1e215098589be2c6af4fc201a048b133c5a7"}
Jul 30 02:26:26.816105 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.816087    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z" event={"ID":"887de7b2-9547-4b64-aa63-cb5e79cd1a5a","Type":"ContainerStarted","Data":"7aa815e4bb99fce923958600d1f2051f54f54038031e72fff8041b7bcf143678"}
Jul 30 02:26:26.816158 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.816138    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z" event={"ID":"887de7b2-9547-4b64-aa63-cb5e79cd1a5a","Type":"ContainerDied","Data":"6eb70fa88c6c86bffa8508d5aa7eeb0e31eb5a5d28b2f1b9d4047deb30d060ac"}
Jul 30 02:26:26.816254 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.816190    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z" event={"ID":"887de7b2-9547-4b64-aa63-cb5e79cd1a5a","Type":"ContainerStarted","Data":"dfc7c435de5e13306db624da7f46d5b52e78402abdf2cb66c72b5ab8a31ecf0a"}
Jul 30 02:26:26.817397 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.817379    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8nlws" event={"ID":"c75033ab-a299-4583-86d9-ea212ccb4598","Type":"ContainerStarted","Data":"75a35574e8370a6c38d3be5925a67a9ac3768868c3f5fe0b0e7a82c9ad37018b"}
Jul 30 02:26:26.818816 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.818787    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sv8rz" event={"ID":"751d0197-5c04-418f-a656-a9396612d072","Type":"ContainerStarted","Data":"b55d996c1301c9f27fa0b9baaa84acf5ae0bfe9e0f8e426da7a6c8cd88fce732"}
Jul 30 02:26:26.820245 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.820216    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j8cv" event={"ID":"c9c4aa7a-b3b2-46af-a41b-c4d68170377c","Type":"ContainerStarted","Data":"21224521e612c957edc9c73e5fe4267c86ce0f1d8552e900ca2dd0145d36e02d"}
Jul 30 02:26:26.821471 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.821446    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv" event={"ID":"7424401e-7fa0-4127-bfb2-f92b65f1078e","Type":"ContainerStarted","Data":"302b378f237df8ff967af8442894857d00ecc3ec9680f077a47d127cf0647310"}
Jul 30 02:26:26.822820 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.822801    2554 generic.go:356] "Generic (PLEG): container finished" podID="2425b5be2fe9a31718cb99e90a08b50f" containerID="e6fce75c55eb73ba527e52a93f61c7cb2ee2e0400ffb0358b94e5b35bafeeb89" exitCode=0
Jul 30 02:26:26.822907 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.822866    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal" event={"ID":"2425b5be2fe9a31718cb99e90a08b50f","Type":"ContainerDied","Data":"e6fce75c55eb73ba527e52a93f61c7cb2ee2e0400ffb0358b94e5b35bafeeb89"}
Jul 30 02:26:26.824240 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.824221    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-75.ec2.internal" event={"ID":"4856b1a7fc480724b4b36024a45631a3","Type":"ContainerStarted","Data":"d2056dc24ab98c704a950cc9e5edb86bd65e884e9da11b5cf82f2614b31509ea"}
Jul 30 02:26:26.827855 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.827814    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9h6rh" podStartSLOduration=2.910293664 podStartE2EDuration="22.827802573s" totalImagesPullingTime="19.917508909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 02:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:26:26.827227312 +0000 UTC m=+22.677540054" watchObservedRunningTime="2026-07-30 02:26:26.827802573 +0000 UTC m=+22.678115300"
Jul 30 02:26:26.838994 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.838951    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-75.ec2.internal" podStartSLOduration=21.838935607 podStartE2EDuration="21.838935607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 02:26:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:26:26.838881296 +0000 UTC m=+22.689194025" watchObservedRunningTime="2026-07-30 02:26:26.838935607 +0000 UTC m=+22.689248339"
Jul 30 02:26:26.870740 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.870686    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sv8rz" podStartSLOduration=1.9829722269999999 podStartE2EDuration="21.870667451s" totalImagesPullingTime="19.887695224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 02:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:26:26.870194084 +0000 UTC m=+22.720506816" watchObservedRunningTime="2026-07-30 02:26:26.870667451 +0000 UTC m=+22.720980186"
Jul 30 02:26:26.886868 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.886759    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8nlws" podStartSLOduration=1.803782641 podStartE2EDuration="21.886743999s" totalImagesPullingTime="20.082961358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 02:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:26:26.88651625 +0000 UTC m=+22.736829190" watchObservedRunningTime="2026-07-30 02:26:26.886743999 +0000 UTC m=+22.737056731"
Jul 30 02:26:26.919616 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.919531    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2qsc5" podStartSLOduration=2.172869405 podStartE2EDuration="21.919515384s" totalImagesPullingTime="19.746645979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 02:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:26:26.919478823 +0000 UTC m=+22.769791553" watchObservedRunningTime="2026-07-30 02:26:26.919515384 +0000 UTC m=+22.769828114"
Jul 30 02:26:26.920077 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:26.920055    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jtxnn" podStartSLOduration=2.146197014 podStartE2EDuration="21.920047053s" totalImagesPullingTime="19.773850039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:26:26.899777412 +0000 UTC m=+22.750090143" watchObservedRunningTime="2026-07-30 02:26:26.920047053 +0000 UTC m=+22.770359783"
Jul 30 02:26:27.635253 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:27.635183    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:27.635253 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:27.635201    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:27.635467 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:27.635292    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:27.635467 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:27.635347    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:27.635467 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:27.635385    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:27.635586 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:27.635478    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:27.828669 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:27.828645    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:26:27.829058 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:27.829008    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z" event={"ID":"887de7b2-9547-4b64-aa63-cb5e79cd1a5a","Type":"ContainerStarted","Data":"b5ee6e660e536c364929d362e0812b2f47347b1aa450957fffa5ca794e007c70"}
Jul 30 02:26:27.830270 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:27.830248    2554 generic.go:356] "Generic (PLEG): container finished" podID="c9c4aa7a-b3b2-46af-a41b-c4d68170377c" containerID="21224521e612c957edc9c73e5fe4267c86ce0f1d8552e900ca2dd0145d36e02d" exitCode=0
Jul 30 02:26:27.830376 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:27.830316    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j8cv" event={"ID":"c9c4aa7a-b3b2-46af-a41b-c4d68170377c","Type":"ContainerDied","Data":"21224521e612c957edc9c73e5fe4267c86ce0f1d8552e900ca2dd0145d36e02d"}
Jul 30 02:26:27.831935 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:27.831918    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal" event={"ID":"2425b5be2fe9a31718cb99e90a08b50f","Type":"ContainerStarted","Data":"c0018fcbc4b72ef402eae506ba461d4c87b8d23f2145a81db3ab3ad15b619dae"}
Jul 30 02:26:27.833138 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:27.833114    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vw57k" event={"ID":"d63589b0-6bb2-49ac-ba89-77bf658ce7be","Type":"ContainerStarted","Data":"00bf48269950e72fde0bcd5182d482d5baf760910541715b99d068ba1236e968"}
Jul 30 02:26:27.886320 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:27.886245    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vw57k" podStartSLOduration=3.031627646 podStartE2EDuration="22.886232293s" totalImagesPullingTime="19.854604647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 02:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:26:27.865604826 +0000 UTC m=+23.715917558" watchObservedRunningTime="2026-07-30 02:26:27.886232293 +0000 UTC m=+23.736545023"
Jul 30 02:26:27.886733 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:27.886703    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-75.ec2.internal" podStartSLOduration=22.886688903 podStartE2EDuration="22.886688903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 02:26:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:26:27.88601036 +0000 UTC m=+23.736323092" watchObservedRunningTime="2026-07-30 02:26:27.886688903 +0000 UTC m=+23.737001635"
Jul 30 02:26:27.954479 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:27.954458    2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 02:26:28.549524 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:28.549397    2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T02:26:27.954474928Z","UUID":"ff133b8b-f2a7-4521-b156-1c2032ff0b9e","Handler":null,"Name":"","Endpoint":""}
Jul 30 02:26:28.551135 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:28.551102    2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 02:26:28.551259 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:28.551149    2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 02:26:28.837539 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:28.837456    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv" event={"ID":"7424401e-7fa0-4127-bfb2-f92b65f1078e","Type":"ContainerStarted","Data":"be847235258a2d0aef1ddd2c756b3712c49e8d202eb1edc26fcd39a1096644ce"}
Jul 30 02:26:29.635846 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:29.635814    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:29.636113 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:29.635936    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:29.636113 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:29.635946    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:29.636113 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:29.635987    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:29.636113 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:29.636071    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:29.636325 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:29.636141    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:29.843243 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:29.843211    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:26:29.843808 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:29.843692    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z" event={"ID":"887de7b2-9547-4b64-aa63-cb5e79cd1a5a","Type":"ContainerStarted","Data":"ff03bf47b04a89951c034060b86d04443057f505754382249a70612618307c56"}
Jul 30 02:26:29.845947 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:29.845917    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv" event={"ID":"7424401e-7fa0-4127-bfb2-f92b65f1078e","Type":"ContainerStarted","Data":"265caa83887178e9e389933a089324df71033dcec2a397f808f03ba12f212af9"}
Jul 30 02:26:29.863470 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:29.863426    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w2rtv" podStartSLOduration=3.591709771 podStartE2EDuration="25.863411522s" totalImagesPullingTime="22.271701751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 02:26:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:26:29.862967457 +0000 UTC m=+25.713280199" watchObservedRunningTime="2026-07-30 02:26:29.863411522 +0000 UTC m=+25.713724252"
Jul 30 02:26:31.591249 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:31.591216    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jtxnn"
Jul 30 02:26:31.592005 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:31.591983    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jtxnn"
Jul 30 02:26:31.634942 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:31.634871    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:31.635078 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:31.634872    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:31.635078 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:31.634971    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:31.635078 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:31.635064    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:31.635241 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:31.634881    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:31.635241 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:31.635148    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:31.851327 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:31.851291    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jtxnn"
Jul 30 02:26:31.851922 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:31.851899    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jtxnn"
Jul 30 02:26:32.856831 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:32.856614    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:26:32.857647 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:32.857161    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z" event={"ID":"887de7b2-9547-4b64-aa63-cb5e79cd1a5a","Type":"ContainerStarted","Data":"a7b2cd5ae7a2c146e254ed8d7493d4170fae75bc8173231f5b311e101fe6a5e4"}
Jul 30 02:26:32.857647 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:32.857387    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:32.857647 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:32.857607    2554 scope.go:117] "RemoveContainer" containerID="6eb70fa88c6c86bffa8508d5aa7eeb0e31eb5a5d28b2f1b9d4047deb30d060ac"
Jul 30 02:26:32.859210 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:32.859175    2554 generic.go:356] "Generic (PLEG): container finished" podID="c9c4aa7a-b3b2-46af-a41b-c4d68170377c" containerID="a4398bc45662d84023f4c6512cad78795a0687e0124d6e34465f58ccd5997743" exitCode=0
Jul 30 02:26:32.859312 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:32.859210    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j8cv" event={"ID":"c9c4aa7a-b3b2-46af-a41b-c4d68170377c","Type":"ContainerDied","Data":"a4398bc45662d84023f4c6512cad78795a0687e0124d6e34465f58ccd5997743"}
Jul 30 02:26:32.872831 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:32.872810    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:33.635251 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.635220    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:33.635251 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.635248    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:33.635490 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.635316    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:33.635490 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:33.635330    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:33.635490 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:33.635411    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:33.635617 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:33.635520    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:33.865107 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.865085    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:26:33.865529 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.865466    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z" event={"ID":"887de7b2-9547-4b64-aa63-cb5e79cd1a5a","Type":"ContainerStarted","Data":"caa49c859b8dcf7e1733dbbac0e90d74709d3fcedb790d8c307e6b4d9c873fb0"}
Jul 30 02:26:33.865847 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.865725    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:33.865847 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.865811    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:33.880907 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.880889    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:26:33.892350 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.892305    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z" podStartSLOduration=8.575841087 podStartE2EDuration="28.892293892s" totalImagesPullingTime="20.316452805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 02:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:26:33.891886962 +0000 UTC m=+29.742199693" watchObservedRunningTime="2026-07-30 02:26:33.892293892 +0000 UTC m=+29.742606629"
Jul 30 02:26:33.960005 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.959977    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8bthc"]
Jul 30 02:26:33.960147 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.960102    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:33.960211 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:33.960188    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:33.962748 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.962725    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7jsxw"]
Jul 30 02:26:33.962856 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.962807    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:33.962929 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:33.962873    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:33.971714 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.971684    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5jft6"]
Jul 30 02:26:33.971822 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:33.971771    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:33.971877 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:33.971853    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:34.869479 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:34.869447    2554 generic.go:356] "Generic (PLEG): container finished" podID="c9c4aa7a-b3b2-46af-a41b-c4d68170377c" containerID="b0cf41505905b5be66425f9feac9e0e52500aabdd08e7654e4821d141833e408" exitCode=0
Jul 30 02:26:34.869894 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:34.869540    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j8cv" event={"ID":"c9c4aa7a-b3b2-46af-a41b-c4d68170377c","Type":"ContainerDied","Data":"b0cf41505905b5be66425f9feac9e0e52500aabdd08e7654e4821d141833e408"}
Jul 30 02:26:35.635624 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:35.635583    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:35.635624 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:35.635608    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:35.635805 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:35.635600    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:35.635805 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:35.635710    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:35.635805 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:35.635777    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:35.635900 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:35.635843    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:36.877450 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:36.877250    2554 generic.go:356] "Generic (PLEG): container finished" podID="c9c4aa7a-b3b2-46af-a41b-c4d68170377c" containerID="ff3a4dd0872893359c8330da41702b1cc475a0d8d01898b1bcf2ae452eeef6b6" exitCode=0
Jul 30 02:26:36.877450 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:36.877327    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j8cv" event={"ID":"c9c4aa7a-b3b2-46af-a41b-c4d68170377c","Type":"ContainerDied","Data":"ff3a4dd0872893359c8330da41702b1cc475a0d8d01898b1bcf2ae452eeef6b6"}
Jul 30 02:26:37.353447 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:37.353414    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:37.353628 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:37.353469    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:37.353628 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:37.353561    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 02:26:37.353628 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:37.353620    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 02:26:37.353772 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:37.353642    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret podName:73225a1c-d6ba-4d8b-a7d7-65187d4b51b6 nodeName:}" failed. No retries permitted until 2026-07-30 02:27:09.353618602 +0000 UTC m=+65.203931313 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret") pod "global-pull-secret-syncer-8bthc" (UID: "73225a1c-d6ba-4d8b-a7d7-65187d4b51b6") : object "kube-system"/"original-pull-secret" not registered
Jul 30 02:26:37.353772 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:37.353674    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs podName:e8d68db5-cc2c-417c-9027-b71ea9c67cee nodeName:}" failed. No retries permitted until 2026-07-30 02:27:09.353657903 +0000 UTC m=+65.203970634 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs") pod "network-metrics-daemon-5jft6" (UID: "e8d68db5-cc2c-417c-9027-b71ea9c67cee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 02:26:37.454773 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:37.454743    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44w82\" (UniqueName: \"kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82\") pod \"network-check-target-7jsxw\" (UID: \"816208a4-330c-4b87-a3cd-913b22acc969\") " pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:37.454960 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:37.454866    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 02:26:37.454960 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:37.454884    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 02:26:37.454960 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:37.454896    2554 projected.go:196] Error preparing data for projected volume kube-api-access-44w82 for pod openshift-network-diagnostics/network-check-target-7jsxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 02:26:37.454960 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:37.454957    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82 podName:816208a4-330c-4b87-a3cd-913b22acc969 nodeName:}" failed. No retries permitted until 2026-07-30 02:27:09.454937061 +0000 UTC m=+65.305249771 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-44w82" (UniqueName: "kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82") pod "network-check-target-7jsxw" (UID: "816208a4-330c-4b87-a3cd-913b22acc969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 02:26:37.635238 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:37.635152    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:37.635238 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:37.635204    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:37.635452 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:37.635303    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:37.635452 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:37.635327    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:37.635452 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:37.635382    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:37.635590 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:37.635466    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:39.635315 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:39.635283    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:39.635862 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:39.635283    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:39.635862 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:39.635396    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jsxw" podUID="816208a4-330c-4b87-a3cd-913b22acc969"
Jul 30 02:26:39.635862 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:39.635283    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:39.635862 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:39.635474    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:26:39.635862 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:39.635581    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bthc" podUID="73225a1c-d6ba-4d8b-a7d7-65187d4b51b6"
Jul 30 02:26:40.005655 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.005627    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-75.ec2.internal" event="NodeReady"
Jul 30 02:26:40.005836 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.005770    2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 02:26:40.050465 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.050437    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5bkd9"]
Jul 30 02:26:40.053170 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.053147    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4ls5q"]
Jul 30 02:26:40.053298 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.053237    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:40.055303 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.055283    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4ls5q"
Jul 30 02:26:40.055764 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.055743    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 02:26:40.055848 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.055760    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5sqnz\""
Jul 30 02:26:40.055913 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.055746    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 02:26:40.058160 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.058141    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 02:26:40.058270 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.058194    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tg8zh\""
Jul 30 02:26:40.058270 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.058209    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 02:26:40.058462 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.058443    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 02:26:40.061458 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.061439    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4ls5q"]
Jul 30 02:26:40.066647 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.066631    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5bkd9"]
Jul 30 02:26:40.178779 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.178745    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:40.178929 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.178786    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75zgx\" (UniqueName: \"kubernetes.io/projected/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-kube-api-access-75zgx\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:40.178929 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.178847    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrlbw\" (UniqueName: \"kubernetes.io/projected/dd7f642f-aeeb-4c64-90a8-2ada86bc0964-kube-api-access-vrlbw\") pod \"ingress-canary-4ls5q\" (UID: \"dd7f642f-aeeb-4c64-90a8-2ada86bc0964\") " pod="openshift-ingress-canary/ingress-canary-4ls5q"
Jul 30 02:26:40.178929 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.178876    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd7f642f-aeeb-4c64-90a8-2ada86bc0964-cert\") pod \"ingress-canary-4ls5q\" (UID: \"dd7f642f-aeeb-4c64-90a8-2ada86bc0964\") " pod="openshift-ingress-canary/ingress-canary-4ls5q"
Jul 30 02:26:40.178929 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.178920    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-config-volume\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:40.179116 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.178942    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-tmp-dir\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:40.279611 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.279514    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrlbw\" (UniqueName: \"kubernetes.io/projected/dd7f642f-aeeb-4c64-90a8-2ada86bc0964-kube-api-access-vrlbw\") pod \"ingress-canary-4ls5q\" (UID: \"dd7f642f-aeeb-4c64-90a8-2ada86bc0964\") " pod="openshift-ingress-canary/ingress-canary-4ls5q"
Jul 30 02:26:40.279611 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.279572    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd7f642f-aeeb-4c64-90a8-2ada86bc0964-cert\") pod \"ingress-canary-4ls5q\" (UID: \"dd7f642f-aeeb-4c64-90a8-2ada86bc0964\") " pod="openshift-ingress-canary/ingress-canary-4ls5q"
Jul 30 02:26:40.279829 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.279619    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-config-volume\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:40.279829 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.279638    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-tmp-dir\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:40.279829 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.279691    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:40.279829 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.279747    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75zgx\" (UniqueName: \"kubernetes.io/projected/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-kube-api-access-75zgx\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:40.280016 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:40.279960    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 02:26:40.280063 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:40.280027    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls podName:9cc11f4f-f101-4b6b-a00f-01cce5a1b057 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:40.780006386 +0000 UTC m=+36.630319102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls") pod "dns-default-5bkd9" (UID: "9cc11f4f-f101-4b6b-a00f-01cce5a1b057") : secret "dns-default-metrics-tls" not found
Jul 30 02:26:40.280063 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.280027    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-tmp-dir\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:40.280258 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.280236    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-config-volume\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:40.284144 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.284123    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd7f642f-aeeb-4c64-90a8-2ada86bc0964-cert\") pod \"ingress-canary-4ls5q\" (UID: \"dd7f642f-aeeb-4c64-90a8-2ada86bc0964\") " pod="openshift-ingress-canary/ingress-canary-4ls5q"
Jul 30 02:26:40.291125 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.291104    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrlbw\" (UniqueName: \"kubernetes.io/projected/dd7f642f-aeeb-4c64-90a8-2ada86bc0964-kube-api-access-vrlbw\") pod \"ingress-canary-4ls5q\" (UID: \"dd7f642f-aeeb-4c64-90a8-2ada86bc0964\") " pod="openshift-ingress-canary/ingress-canary-4ls5q"
Jul 30 02:26:40.291406 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.291385    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75zgx\" (UniqueName: \"kubernetes.io/projected/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-kube-api-access-75zgx\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:40.372592 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.372562    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4ls5q"
Jul 30 02:26:40.721619 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.721458    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4ls5q"]
Jul 30 02:26:40.724246 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:26:40.724221    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd7f642f_aeeb_4c64_90a8_2ada86bc0964.slice/crio-6a4541a3b2a5b0d4a1acd73f78432b72df1c49fc3c55b9b0ec5fe612df079fc5 WatchSource:0}: Error finding container 6a4541a3b2a5b0d4a1acd73f78432b72df1c49fc3c55b9b0ec5fe612df079fc5: Status 404 returned error can't find the container with id 6a4541a3b2a5b0d4a1acd73f78432b72df1c49fc3c55b9b0ec5fe612df079fc5
Jul 30 02:26:40.783783 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.783749    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:40.783940 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:40.783910    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 02:26:40.783989 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:40.783977    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls podName:9cc11f4f-f101-4b6b-a00f-01cce5a1b057 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:41.783958703 +0000 UTC m=+37.634271411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls") pod "dns-default-5bkd9" (UID: "9cc11f4f-f101-4b6b-a00f-01cce5a1b057") : secret "dns-default-metrics-tls" not found
Jul 30 02:26:40.890266 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.890177    2554 generic.go:356] "Generic (PLEG): container finished" podID="c9c4aa7a-b3b2-46af-a41b-c4d68170377c" containerID="b85204675d5e7c9343d6a49d0ac466b250b50b3f5995e7ecb2d4f2ebf206cf34" exitCode=0
Jul 30 02:26:40.890385 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.890257    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j8cv" event={"ID":"c9c4aa7a-b3b2-46af-a41b-c4d68170377c","Type":"ContainerDied","Data":"b85204675d5e7c9343d6a49d0ac466b250b50b3f5995e7ecb2d4f2ebf206cf34"}
Jul 30 02:26:40.891326 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:40.891303    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4ls5q" event={"ID":"dd7f642f-aeeb-4c64-90a8-2ada86bc0964","Type":"ContainerStarted","Data":"6a4541a3b2a5b0d4a1acd73f78432b72df1c49fc3c55b9b0ec5fe612df079fc5"}
Jul 30 02:26:41.635623 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:41.635584    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:26:41.635623 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:41.635612    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:26:41.635831 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:41.635605    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:26:41.638317 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:41.638296    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 02:26:41.638421 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:41.638338    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 02:26:41.639222 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:41.639202    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-67lr8\""
Jul 30 02:26:41.639222 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:41.639228    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 02:26:41.639222 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:41.639234    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 02:26:41.639449 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:41.639244    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vvjjn\""
Jul 30 02:26:41.791941 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:41.791852    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:41.792411 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:41.792028    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 02:26:41.792411 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:41.792094    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls podName:9cc11f4f-f101-4b6b-a00f-01cce5a1b057 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:43.792075445 +0000 UTC m=+39.642388169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls") pod "dns-default-5bkd9" (UID: "9cc11f4f-f101-4b6b-a00f-01cce5a1b057") : secret "dns-default-metrics-tls" not found
Jul 30 02:26:41.897127 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:41.897050    2554 generic.go:356] "Generic (PLEG): container finished" podID="c9c4aa7a-b3b2-46af-a41b-c4d68170377c" containerID="3469cd59fd9da8040a67e81208564ee27431564d362a1e5fde98c0fa98fb556e" exitCode=0
Jul 30 02:26:41.897127 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:41.897098    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j8cv" event={"ID":"c9c4aa7a-b3b2-46af-a41b-c4d68170377c","Type":"ContainerDied","Data":"3469cd59fd9da8040a67e81208564ee27431564d362a1e5fde98c0fa98fb556e"}
Jul 30 02:26:42.902252 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:42.902191    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j8cv" event={"ID":"c9c4aa7a-b3b2-46af-a41b-c4d68170377c","Type":"ContainerStarted","Data":"e42ecad85cf48443036f761d4c23e84373dcd499dc05141c25aa33e70e767c82"}
Jul 30 02:26:42.923479 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:42.923440    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7j8cv" podStartSLOduration=7.975098943 podStartE2EDuration="37.923424221s" totalImagesPullingTime="29.948325278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 02:26:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:26:42.922008515 +0000 UTC m=+38.772321247" watchObservedRunningTime="2026-07-30 02:26:42.923424221 +0000 UTC m=+38.773736949"
Jul 30 02:26:43.808128 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:43.807907    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:43.808307 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:43.808059    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 02:26:43.808307 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:43.808287    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls podName:9cc11f4f-f101-4b6b-a00f-01cce5a1b057 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:47.808266525 +0000 UTC m=+43.658579238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls") pod "dns-default-5bkd9" (UID: "9cc11f4f-f101-4b6b-a00f-01cce5a1b057") : secret "dns-default-metrics-tls" not found
Jul 30 02:26:43.906063 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:43.906024    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4ls5q" event={"ID":"dd7f642f-aeeb-4c64-90a8-2ada86bc0964","Type":"ContainerStarted","Data":"9f91a7d5f0668f07ec5031f98e6ea87cdf562e42a2b1a580863a97351b3f188e"}
Jul 30 02:26:43.923215 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:43.923171    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4ls5q" podStartSLOduration=1.361876011 podStartE2EDuration="3.923158894s" totalImagesPullingTime="2.561282883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:26:43.922933286 +0000 UTC m=+39.773246027" watchObservedRunningTime="2026-07-30 02:26:43.923158894 +0000 UTC m=+39.773471626"
Jul 30 02:26:47.836072 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:47.836030    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:47.836536 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:47.836215    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 02:26:47.836536 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:47.836303    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls podName:9cc11f4f-f101-4b6b-a00f-01cce5a1b057 nodeName:}" failed. No retries permitted until 2026-07-30 02:26:55.836278378 +0000 UTC m=+51.686591108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls") pod "dns-default-5bkd9" (UID: "9cc11f4f-f101-4b6b-a00f-01cce5a1b057") : secret "dns-default-metrics-tls" not found
Jul 30 02:26:55.891105 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:26:55.891066    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:26:55.891578 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:55.891210    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 02:26:55.891578 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:26:55.891270    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls podName:9cc11f4f-f101-4b6b-a00f-01cce5a1b057 nodeName:}" failed. No retries permitted until 2026-07-30 02:27:11.891256484 +0000 UTC m=+67.741569193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls") pod "dns-default-5bkd9" (UID: "9cc11f4f-f101-4b6b-a00f-01cce5a1b057") : secret "dns-default-metrics-tls" not found
Jul 30 02:27:05.890561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:05.890520    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7f7z"
Jul 30 02:27:09.378257 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.378215    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:27:09.378746 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.378298    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:27:09.381005 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.380982    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 02:27:09.381081 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.381018    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 02:27:09.388967 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:27:09.388944    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 02:27:09.389032 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:27:09.389019    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs podName:e8d68db5-cc2c-417c-9027-b71ea9c67cee nodeName:}" failed. No retries permitted until 2026-07-30 02:28:13.388998791 +0000 UTC m=+129.239311500 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs") pod "network-metrics-daemon-5jft6" (UID: "e8d68db5-cc2c-417c-9027-b71ea9c67cee") : secret "metrics-daemon-secret" not found
Jul 30 02:27:09.392618 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.392592    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73225a1c-d6ba-4d8b-a7d7-65187d4b51b6-original-pull-secret\") pod \"global-pull-secret-syncer-8bthc\" (UID: \"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6\") " pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:27:09.478897 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.478849    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44w82\" (UniqueName: \"kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82\") pod \"network-check-target-7jsxw\" (UID: \"816208a4-330c-4b87-a3cd-913b22acc969\") " pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:27:09.482941 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.482922    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 02:27:09.493100 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.493078    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 02:27:09.502079 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.502062    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44w82\" (UniqueName: \"kubernetes.io/projected/816208a4-330c-4b87-a3cd-913b22acc969-kube-api-access-44w82\") pod \"network-check-target-7jsxw\" (UID: \"816208a4-330c-4b87-a3cd-913b22acc969\") " pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:27:09.558515 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.558494    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-67lr8\""
Jul 30 02:27:09.558515 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.558518    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bthc"
Jul 30 02:27:09.564917 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.564900    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:27:09.698041 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.697972    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8bthc"]
Jul 30 02:27:09.701187 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:27:09.701163    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73225a1c_d6ba_4d8b_a7d7_65187d4b51b6.slice/crio-d739ee9ee74017a6ed2443675f562eee55e30e8a94b8ec2ca65765b2afc9a35c WatchSource:0}: Error finding container d739ee9ee74017a6ed2443675f562eee55e30e8a94b8ec2ca65765b2afc9a35c: Status 404 returned error can't find the container with id d739ee9ee74017a6ed2443675f562eee55e30e8a94b8ec2ca65765b2afc9a35c
Jul 30 02:27:09.714077 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.714054    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7jsxw"]
Jul 30 02:27:09.717690 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:27:09.717668    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816208a4_330c_4b87_a3cd_913b22acc969.slice/crio-634b68ebc4dd46913fe60534a3e1fec688b143637adcfdf51d1264398b2f9b65 WatchSource:0}: Error finding container 634b68ebc4dd46913fe60534a3e1fec688b143637adcfdf51d1264398b2f9b65: Status 404 returned error can't find the container with id 634b68ebc4dd46913fe60534a3e1fec688b143637adcfdf51d1264398b2f9b65
Jul 30 02:27:09.966816 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.966722    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8bthc" event={"ID":"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6","Type":"ContainerStarted","Data":"d739ee9ee74017a6ed2443675f562eee55e30e8a94b8ec2ca65765b2afc9a35c"}
Jul 30 02:27:09.967791 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:09.967769    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7jsxw" event={"ID":"816208a4-330c-4b87-a3cd-913b22acc969","Type":"ContainerStarted","Data":"634b68ebc4dd46913fe60534a3e1fec688b143637adcfdf51d1264398b2f9b65"}
Jul 30 02:27:11.897608 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:11.897570    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:27:11.898059 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:27:11.897744    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 02:27:11.898059 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:27:11.897811    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls podName:9cc11f4f-f101-4b6b-a00f-01cce5a1b057 nodeName:}" failed. No retries permitted until 2026-07-30 02:27:43.897788835 +0000 UTC m=+99.748101545 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls") pod "dns-default-5bkd9" (UID: "9cc11f4f-f101-4b6b-a00f-01cce5a1b057") : secret "dns-default-metrics-tls" not found
Jul 30 02:27:14.983094 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:14.983059    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7jsxw" event={"ID":"816208a4-330c-4b87-a3cd-913b22acc969","Type":"ContainerStarted","Data":"5a00f2dc0084e39fb2b651bdac51d7c25caa21aeb3f511cfb4073e629083060a"}
Jul 30 02:27:14.983719 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:14.983179    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:27:14.984512 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:14.984490    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8bthc" event={"ID":"73225a1c-d6ba-4d8b-a7d7-65187d4b51b6","Type":"ContainerStarted","Data":"16d9269f9c8ba5417509cfbbb5482247201e6a4370285e329ee978666ca1a9c5"}
Jul 30 02:27:14.998849 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:14.998803    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7jsxw" podStartSLOduration=65.23345225 podStartE2EDuration="1m9.998779414s" totalImagesPullingTime="4.765327164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:27:14.998541994 +0000 UTC m=+70.848854738" watchObservedRunningTime="2026-07-30 02:27:14.998779414 +0000 UTC m=+70.849092153"
Jul 30 02:27:15.012817 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:15.012779    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8bthc" podStartSLOduration=65.219704384 podStartE2EDuration="1m10.012768s" totalImagesPullingTime="4.793063616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 02:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:27:15.012281964 +0000 UTC m=+70.862594694" watchObservedRunningTime="2026-07-30 02:27:15.012768 +0000 UTC m=+70.863080729"
Jul 30 02:27:43.904067 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:43.903985    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:27:43.904431 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:27:43.904105    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 02:27:43.904431 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:27:43.904171    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls podName:9cc11f4f-f101-4b6b-a00f-01cce5a1b057 nodeName:}" failed. No retries permitted until 2026-07-30 02:28:47.904156071 +0000 UTC m=+163.754468779 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls") pod "dns-default-5bkd9" (UID: "9cc11f4f-f101-4b6b-a00f-01cce5a1b057") : secret "dns-default-metrics-tls" not found
Jul 30 02:27:45.990108 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:27:45.990082    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7jsxw"
Jul 30 02:28:13.487322 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:13.487268    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:28:13.487837 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:28:13.487412    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 02:28:13.487837 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:28:13.487486    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs podName:e8d68db5-cc2c-417c-9027-b71ea9c67cee nodeName:}" failed. No retries permitted until 2026-07-30 02:30:15.487471461 +0000 UTC m=+251.337784173 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs") pod "network-metrics-daemon-5jft6" (UID: "e8d68db5-cc2c-417c-9027-b71ea9c67cee") : secret "metrics-daemon-secret" not found
Jul 30 02:28:35.482596 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.482563    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9"]
Jul 30 02:28:35.484480 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.484463    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9"
Jul 30 02:28:35.488147 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.488119    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 30 02:28:35.488252 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.488121    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 30 02:28:35.488252 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.488159    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 30 02:28:35.489001 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.488733    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jpm6m\""
Jul 30 02:28:35.489001 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.488569    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 30 02:28:35.493443 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.493417    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9"]
Jul 30 02:28:35.632518 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.632485    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6028787-5153-4b37-815a-598aa64931e9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-597bfff6d4-cdfp9\" (UID: \"a6028787-5153-4b37-815a-598aa64931e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9"
Jul 30 02:28:35.632681 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.632528    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksrlx\" (UniqueName: \"kubernetes.io/projected/a6028787-5153-4b37-815a-598aa64931e9-kube-api-access-ksrlx\") pod \"managed-serviceaccount-addon-agent-597bfff6d4-cdfp9\" (UID: \"a6028787-5153-4b37-815a-598aa64931e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9"
Jul 30 02:28:35.733709 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.733614    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6028787-5153-4b37-815a-598aa64931e9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-597bfff6d4-cdfp9\" (UID: \"a6028787-5153-4b37-815a-598aa64931e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9"
Jul 30 02:28:35.733709 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.733681    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksrlx\" (UniqueName: \"kubernetes.io/projected/a6028787-5153-4b37-815a-598aa64931e9-kube-api-access-ksrlx\") pod \"managed-serviceaccount-addon-agent-597bfff6d4-cdfp9\" (UID: \"a6028787-5153-4b37-815a-598aa64931e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9"
Jul 30 02:28:35.735991 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.735969    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6028787-5153-4b37-815a-598aa64931e9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-597bfff6d4-cdfp9\" (UID: \"a6028787-5153-4b37-815a-598aa64931e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9"
Jul 30 02:28:35.741022 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.740999    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksrlx\" (UniqueName: \"kubernetes.io/projected/a6028787-5153-4b37-815a-598aa64931e9-kube-api-access-ksrlx\") pod \"managed-serviceaccount-addon-agent-597bfff6d4-cdfp9\" (UID: \"a6028787-5153-4b37-815a-598aa64931e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9"
Jul 30 02:28:35.811988 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.811955    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9"
Jul 30 02:28:35.927364 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:35.927338    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9"]
Jul 30 02:28:35.931198 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:28:35.931175    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6028787_5153_4b37_815a_598aa64931e9.slice/crio-9f5b2935406d9e5732fb64a2c4d0ef6f34d4c208dac23510e4a95f1bc4d76e91 WatchSource:0}: Error finding container 9f5b2935406d9e5732fb64a2c4d0ef6f34d4c208dac23510e4a95f1bc4d76e91: Status 404 returned error can't find the container with id 9f5b2935406d9e5732fb64a2c4d0ef6f34d4c208dac23510e4a95f1bc4d76e91
Jul 30 02:28:36.166360 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:36.166333    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9" event={"ID":"a6028787-5153-4b37-815a-598aa64931e9","Type":"ContainerStarted","Data":"9f5b2935406d9e5732fb64a2c4d0ef6f34d4c208dac23510e4a95f1bc4d76e91"}
Jul 30 02:28:41.178476 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:41.178447    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9" event={"ID":"a6028787-5153-4b37-815a-598aa64931e9","Type":"ContainerStarted","Data":"faa8fb182ce3033f76ae9eb512d0002aa256fbd86dd82e421cbdef2c228c3a8b"}
Jul 30 02:28:41.194316 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:41.194270    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9" podStartSLOduration=1.5708965620000002 podStartE2EDuration="6.194254309s" totalImagesPullingTime="4.623357747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:28:41.193628398 +0000 UTC m=+157.043941130" watchObservedRunningTime="2026-07-30 02:28:41.194254309 +0000 UTC m=+157.044567039"
Jul 30 02:28:43.066757 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:28:43.066719    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5bkd9" podUID="9cc11f4f-f101-4b6b-a00f-01cce5a1b057"
Jul 30 02:28:43.182834 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:43.182811    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:28:44.646605 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:28:44.646573    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:28:47.911703 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:47.911667    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:28:47.912068 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:28:47.911772    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 02:28:47.912068 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:28:47.911826    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls podName:9cc11f4f-f101-4b6b-a00f-01cce5a1b057 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:49.911810812 +0000 UTC m=+285.762123521 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls") pod "dns-default-5bkd9" (UID: "9cc11f4f-f101-4b6b-a00f-01cce5a1b057") : secret "dns-default-metrics-tls" not found
Jul 30 02:28:56.635819 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:28:56.635740    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:30:10.114753 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.114719    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-fh26s"]
Jul 30 02:30:10.117413 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.117397    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:10.119022 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.118999    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7499746c59-kn6df"]
Jul 30 02:30:10.120601 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.120579    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 30 02:30:10.120760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.120728    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 30 02:30:10.120836 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.120811    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 30 02:30:10.120878 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.120846    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2v8gr\""
Jul 30 02:30:10.121718 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.121703    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.124241 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.124211    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 30 02:30:10.124355 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.124290    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 30 02:30:10.124355 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.124337    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 02:30:10.124468 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.124381    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 30 02:30:10.124522 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.124468    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 30 02:30:10.124522 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.124476    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 30 02:30:10.124642 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.124520    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 02:30:10.124813 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.124798    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hdw9j\""
Jul 30 02:30:10.127094 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.127074    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 30 02:30:10.129162 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.129143    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-fh26s"]
Jul 30 02:30:10.139861 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.139840    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7499746c59-kn6df"]
Jul 30 02:30:10.213639 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.213616    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-97nvg"]
Jul 30 02:30:10.216689 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.216670    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d"]
Jul 30 02:30:10.216888 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.216797    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.219697 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.219675    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 30 02:30:10.220408 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.220390    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 02:30:10.220607 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.220587    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 02:30:10.220774 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.220488    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gs8qj\""
Jul 30 02:30:10.220887 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.220423    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 30 02:30:10.221623 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.221605    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"]
Jul 30 02:30:10.221842 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.221827    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d"
Jul 30 02:30:10.223668 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.223646    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-default-certificate\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.223786 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.223681    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn5hv\" (UniqueName: \"kubernetes.io/projected/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-kube-api-access-mn5hv\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.223786 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.223759    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e89ced1-b07c-438c-83dd-15333c24ea83-serving-cert\") pod \"console-operator-584dcb6b54-fh26s\" (UID: \"7e89ced1-b07c-438c-83dd-15333c24ea83\") " pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:10.223908 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.223783    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.223908 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.223807    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-stats-auth\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.223908 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.223835    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srsdn\" (UniqueName: \"kubernetes.io/projected/7e89ced1-b07c-438c-83dd-15333c24ea83-kube-api-access-srsdn\") pod \"console-operator-584dcb6b54-fh26s\" (UID: \"7e89ced1-b07c-438c-83dd-15333c24ea83\") " pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:10.223908 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.223858    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.223908 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.223880    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e89ced1-b07c-438c-83dd-15333c24ea83-trusted-ca\") pod \"console-operator-584dcb6b54-fh26s\" (UID: \"7e89ced1-b07c-438c-83dd-15333c24ea83\") " pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:10.223908 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.223902    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e89ced1-b07c-438c-83dd-15333c24ea83-config\") pod \"console-operator-584dcb6b54-fh26s\" (UID: \"7e89ced1-b07c-438c-83dd-15333c24ea83\") " pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:10.225423 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.225401    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 30 02:30:10.225508 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.225473    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rbhds\""
Jul 30 02:30:10.225610 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.225586    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65d88b8fb6-86wmp"]
Jul 30 02:30:10.225750 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.225730    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"
Jul 30 02:30:10.225835 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.225761    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 30 02:30:10.225835 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.225784    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 30 02:30:10.225949 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.225835    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 30 02:30:10.227358 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.227303    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 30 02:30:10.228734 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.228718    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 30 02:30:10.228858 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.228719    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-97nvg"]
Jul 30 02:30:10.228951 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.228750    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6smwg\""
Jul 30 02:30:10.228951 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.228752    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 30 02:30:10.228951 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.228780    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.229199 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.228847    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 30 02:30:10.229317 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.229274    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d"]
Jul 30 02:30:10.231697 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.231672    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 02:30:10.231697 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.231690    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 02:30:10.233069 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.233052    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"]
Jul 30 02:30:10.233212 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.233079    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 02:30:10.233617 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.233595    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6r6b9\""
Jul 30 02:30:10.236795 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.236775    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65d88b8fb6-86wmp"]
Jul 30 02:30:10.238418 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.238396    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 02:30:10.324537 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324510    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3c7b535-3fd2-482e-a3db-63789390305b-tmp\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.324681 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324540    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-certificates\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.324681 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324581    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wm8p7\" (UID: \"759f88f7-10de-4f2e-8e64-3b2e14b88c44\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"
Jul 30 02:30:10.324681 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324626    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c3c7b535-3fd2-482e-a3db-63789390305b-snapshots\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.324681 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324656    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c7b535-3fd2-482e-a3db-63789390305b-service-ca-bundle\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.324681 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324678    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.324840 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324699    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28485e56-40a8-40bf-9497-53bf67edbc96-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d\" (UID: \"28485e56-40a8-40bf-9497-53bf67edbc96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d"
Jul 30 02:30:10.324840 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324722    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk9rw\" (UniqueName: \"kubernetes.io/projected/c3c7b535-3fd2-482e-a3db-63789390305b-kube-api-access-lk9rw\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.324840 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324739    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-bound-sa-token\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.324840 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324758    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7522d9db-ef6f-482d-9a3e-43ac524aa297-image-registry-private-configuration\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.324840 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324778    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj2ss\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-kube-api-access-jj2ss\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.324840 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.324781    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 02:30:10.324840 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.324836    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs podName:0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:10.824821993 +0000 UTC m=+246.675134705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs") pod "router-default-7499746c59-kn6df" (UID: "0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48") : secret "router-metrics-certs-default" not found
Jul 30 02:30:10.325047 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324920    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-stats-auth\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.325047 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324942    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c7b535-3fd2-482e-a3db-63789390305b-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.325047 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324962    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7522d9db-ef6f-482d-9a3e-43ac524aa297-installation-pull-secrets\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.325047 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.324992    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e89ced1-b07c-438c-83dd-15333c24ea83-serving-cert\") pod \"console-operator-584dcb6b54-fh26s\" (UID: \"7e89ced1-b07c-438c-83dd-15333c24ea83\") " pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:10.325047 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325012    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.325047 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325034    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3c7b535-3fd2-482e-a3db-63789390305b-serving-cert\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.325306 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325048    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.325306 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325067    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srsdn\" (UniqueName: \"kubernetes.io/projected/7e89ced1-b07c-438c-83dd-15333c24ea83-kube-api-access-srsdn\") pod \"console-operator-584dcb6b54-fh26s\" (UID: \"7e89ced1-b07c-438c-83dd-15333c24ea83\") " pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:10.325306 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325089    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e89ced1-b07c-438c-83dd-15333c24ea83-trusted-ca\") pod \"console-operator-584dcb6b54-fh26s\" (UID: \"7e89ced1-b07c-438c-83dd-15333c24ea83\") " pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:10.325306 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325125    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e89ced1-b07c-438c-83dd-15333c24ea83-config\") pod \"console-operator-584dcb6b54-fh26s\" (UID: \"7e89ced1-b07c-438c-83dd-15333c24ea83\") " pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:10.325306 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.325213    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle podName:0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:10.825194334 +0000 UTC m=+246.675507064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle") pod "router-default-7499746c59-kn6df" (UID: "0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48") : configmap references non-existent config key: service-ca.crt
Jul 30 02:30:10.325306 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325243    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64jvd\" (UniqueName: \"kubernetes.io/projected/28485e56-40a8-40bf-9497-53bf67edbc96-kube-api-access-64jvd\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d\" (UID: \"28485e56-40a8-40bf-9497-53bf67edbc96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d"
Jul 30 02:30:10.325306 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325280    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7522d9db-ef6f-482d-9a3e-43ac524aa297-ca-trust-extracted\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.325723 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325308    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28485e56-40a8-40bf-9497-53bf67edbc96-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d\" (UID: \"28485e56-40a8-40bf-9497-53bf67edbc96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d"
Jul 30 02:30:10.325723 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325350    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-default-certificate\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.325723 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325388    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn5hv\" (UniqueName: \"kubernetes.io/projected/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-kube-api-access-mn5hv\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.325723 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325620    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltbbt\" (UniqueName: \"kubernetes.io/projected/759f88f7-10de-4f2e-8e64-3b2e14b88c44-kube-api-access-ltbbt\") pod \"cluster-samples-operator-6748489656-wm8p7\" (UID: \"759f88f7-10de-4f2e-8e64-3b2e14b88c44\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"
Jul 30 02:30:10.325723 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325648    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7522d9db-ef6f-482d-9a3e-43ac524aa297-trusted-ca\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.325980 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325944    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e89ced1-b07c-438c-83dd-15333c24ea83-config\") pod \"console-operator-584dcb6b54-fh26s\" (UID: \"7e89ced1-b07c-438c-83dd-15333c24ea83\") " pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:10.325980 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.325956    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e89ced1-b07c-438c-83dd-15333c24ea83-trusted-ca\") pod \"console-operator-584dcb6b54-fh26s\" (UID: \"7e89ced1-b07c-438c-83dd-15333c24ea83\") " pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:10.327692 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.327673    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-stats-auth\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.327804 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.327785    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e89ced1-b07c-438c-83dd-15333c24ea83-serving-cert\") pod \"console-operator-584dcb6b54-fh26s\" (UID: \"7e89ced1-b07c-438c-83dd-15333c24ea83\") " pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:10.327852 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.327806    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-default-certificate\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.338343 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.338318    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn5hv\" (UniqueName: \"kubernetes.io/projected/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-kube-api-access-mn5hv\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.341112 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.341088    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srsdn\" (UniqueName: \"kubernetes.io/projected/7e89ced1-b07c-438c-83dd-15333c24ea83-kube-api-access-srsdn\") pod \"console-operator-584dcb6b54-fh26s\" (UID: \"7e89ced1-b07c-438c-83dd-15333c24ea83\") " pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:10.426776 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.426717    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7522d9db-ef6f-482d-9a3e-43ac524aa297-installation-pull-secrets\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.426776 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.426767    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3c7b535-3fd2-482e-a3db-63789390305b-serving-cert\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.426904 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.426789    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.426904 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.426822    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64jvd\" (UniqueName: \"kubernetes.io/projected/28485e56-40a8-40bf-9497-53bf67edbc96-kube-api-access-64jvd\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d\" (UID: \"28485e56-40a8-40bf-9497-53bf67edbc96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d"
Jul 30 02:30:10.426904 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.426847    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7522d9db-ef6f-482d-9a3e-43ac524aa297-ca-trust-extracted\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.426904 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.426871    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28485e56-40a8-40bf-9497-53bf67edbc96-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d\" (UID: \"28485e56-40a8-40bf-9497-53bf67edbc96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d"
Jul 30 02:30:10.427075 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.426957    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 02:30:10.427075 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.426977    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d88b8fb6-86wmp: secret "image-registry-tls" not found
Jul 30 02:30:10.427075 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427011    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltbbt\" (UniqueName: \"kubernetes.io/projected/759f88f7-10de-4f2e-8e64-3b2e14b88c44-kube-api-access-ltbbt\") pod \"cluster-samples-operator-6748489656-wm8p7\" (UID: \"759f88f7-10de-4f2e-8e64-3b2e14b88c44\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"
Jul 30 02:30:10.427075 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.427027    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls podName:7522d9db-ef6f-482d-9a3e-43ac524aa297 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:10.927011321 +0000 UTC m=+246.777324050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls") pod "image-registry-65d88b8fb6-86wmp" (UID: "7522d9db-ef6f-482d-9a3e-43ac524aa297") : secret "image-registry-tls" not found
Jul 30 02:30:10.427075 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427062    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7522d9db-ef6f-482d-9a3e-43ac524aa297-trusted-ca\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.427309 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427108    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3c7b535-3fd2-482e-a3db-63789390305b-tmp\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.427309 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427135    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-certificates\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.427309 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427164    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wm8p7\" (UID: \"759f88f7-10de-4f2e-8e64-3b2e14b88c44\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"
Jul 30 02:30:10.427309 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427188    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c3c7b535-3fd2-482e-a3db-63789390305b-snapshots\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.427309 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427221    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c7b535-3fd2-482e-a3db-63789390305b-service-ca-bundle\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.427309 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427263    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28485e56-40a8-40bf-9497-53bf67edbc96-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d\" (UID: \"28485e56-40a8-40bf-9497-53bf67edbc96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d"
Jul 30 02:30:10.427309 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427268    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7522d9db-ef6f-482d-9a3e-43ac524aa297-ca-trust-extracted\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.427681 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.427361    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 02:30:10.427681 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.427501    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls podName:759f88f7-10de-4f2e-8e64-3b2e14b88c44 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:10.927460491 +0000 UTC m=+246.777773215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls") pod "cluster-samples-operator-6748489656-wm8p7" (UID: "759f88f7-10de-4f2e-8e64-3b2e14b88c44") : secret "samples-operator-tls" not found
Jul 30 02:30:10.427681 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427523    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk9rw\" (UniqueName: \"kubernetes.io/projected/c3c7b535-3fd2-482e-a3db-63789390305b-kube-api-access-lk9rw\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.427681 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427601    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3c7b535-3fd2-482e-a3db-63789390305b-tmp\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.427681 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427647    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-bound-sa-token\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.427932 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427682    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7522d9db-ef6f-482d-9a3e-43ac524aa297-image-registry-private-configuration\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.427932 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427724    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj2ss\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-kube-api-access-jj2ss\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.427932 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427761    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c7b535-3fd2-482e-a3db-63789390305b-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.427932 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427835    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c7b535-3fd2-482e-a3db-63789390305b-service-ca-bundle\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.428181 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.427964    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-certificates\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.428181 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.428097    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28485e56-40a8-40bf-9497-53bf67edbc96-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d\" (UID: \"28485e56-40a8-40bf-9497-53bf67edbc96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d"
Jul 30 02:30:10.428181 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.428140    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c3c7b535-3fd2-482e-a3db-63789390305b-snapshots\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.428334 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.428248    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:10.428334 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.428251    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7522d9db-ef6f-482d-9a3e-43ac524aa297-trusted-ca\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.428825 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.428801    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c7b535-3fd2-482e-a3db-63789390305b-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.429350 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.429329    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28485e56-40a8-40bf-9497-53bf67edbc96-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d\" (UID: \"28485e56-40a8-40bf-9497-53bf67edbc96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d"
Jul 30 02:30:10.429825 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.429798    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3c7b535-3fd2-482e-a3db-63789390305b-serving-cert\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.430097 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.430079    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7522d9db-ef6f-482d-9a3e-43ac524aa297-installation-pull-secrets\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.430364 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.430348    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7522d9db-ef6f-482d-9a3e-43ac524aa297-image-registry-private-configuration\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.437459 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.437434    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64jvd\" (UniqueName: \"kubernetes.io/projected/28485e56-40a8-40bf-9497-53bf67edbc96-kube-api-access-64jvd\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d\" (UID: \"28485e56-40a8-40bf-9497-53bf67edbc96\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d"
Jul 30 02:30:10.438485 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.438466    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk9rw\" (UniqueName: \"kubernetes.io/projected/c3c7b535-3fd2-482e-a3db-63789390305b-kube-api-access-lk9rw\") pod \"insights-operator-5885fdb759-97nvg\" (UID: \"c3c7b535-3fd2-482e-a3db-63789390305b\") " pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.438826 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.438800    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-bound-sa-token\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.438930 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.438915    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltbbt\" (UniqueName: \"kubernetes.io/projected/759f88f7-10de-4f2e-8e64-3b2e14b88c44-kube-api-access-ltbbt\") pod \"cluster-samples-operator-6748489656-wm8p7\" (UID: \"759f88f7-10de-4f2e-8e64-3b2e14b88c44\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"
Jul 30 02:30:10.438989 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.438961    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj2ss\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-kube-api-access-jj2ss\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.528898 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.528869    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-97nvg"
Jul 30 02:30:10.538976 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.538958    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d"
Jul 30 02:30:10.546895 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.546869    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-fh26s"]
Jul 30 02:30:10.549446 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:30:10.549418    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e89ced1_b07c_438c_83dd_15333c24ea83.slice/crio-a9137c257897792d057e9a3e175ba028b815b5466eaa7a6e1d0ca2465aab3d30 WatchSource:0}: Error finding container a9137c257897792d057e9a3e175ba028b815b5466eaa7a6e1d0ca2465aab3d30: Status 404 returned error can't find the container with id a9137c257897792d057e9a3e175ba028b815b5466eaa7a6e1d0ca2465aab3d30
Jul 30 02:30:10.654581 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.654534    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-97nvg"]
Jul 30 02:30:10.657601 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:30:10.657540    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c7b535_3fd2_482e_a3db_63789390305b.slice/crio-111da960d288eea7ed2775219dafe193a6fd09dc9935f1f36111a56641ac3278 WatchSource:0}: Error finding container 111da960d288eea7ed2775219dafe193a6fd09dc9935f1f36111a56641ac3278: Status 404 returned error can't find the container with id 111da960d288eea7ed2775219dafe193a6fd09dc9935f1f36111a56641ac3278
Jul 30 02:30:10.672284 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.672168    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d"]
Jul 30 02:30:10.674921 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:30:10.674893    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28485e56_40a8_40bf_9497_53bf67edbc96.slice/crio-228e719c7850e5d8a5350b0b0f15a66d2526ea0982b9ce9e53c4db8b6bc02597 WatchSource:0}: Error finding container 228e719c7850e5d8a5350b0b0f15a66d2526ea0982b9ce9e53c4db8b6bc02597: Status 404 returned error can't find the container with id 228e719c7850e5d8a5350b0b0f15a66d2526ea0982b9ce9e53c4db8b6bc02597
Jul 30 02:30:10.831840 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.831814    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.831942 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.831862    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:10.831986 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.831954    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 02:30:10.832019 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.831999    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle podName:0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:11.831979069 +0000 UTC m=+247.682291781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle") pod "router-default-7499746c59-kn6df" (UID: "0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48") : configmap references non-existent config key: service-ca.crt
Jul 30 02:30:10.832058 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.832019    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs podName:0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:11.83201214 +0000 UTC m=+247.682324849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs") pod "router-default-7499746c59-kn6df" (UID: "0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48") : secret "router-metrics-certs-default" not found
Jul 30 02:30:10.932440 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.932383    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:10.932440 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:10.932433    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wm8p7\" (UID: \"759f88f7-10de-4f2e-8e64-3b2e14b88c44\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"
Jul 30 02:30:10.932635 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.932539    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 02:30:10.932635 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.932576    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d88b8fb6-86wmp: secret "image-registry-tls" not found
Jul 30 02:30:10.932635 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.932596    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 02:30:10.932635 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.932626    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls podName:7522d9db-ef6f-482d-9a3e-43ac524aa297 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:11.932607692 +0000 UTC m=+247.782920419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls") pod "image-registry-65d88b8fb6-86wmp" (UID: "7522d9db-ef6f-482d-9a3e-43ac524aa297") : secret "image-registry-tls" not found
Jul 30 02:30:10.932794 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:10.932643    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls podName:759f88f7-10de-4f2e-8e64-3b2e14b88c44 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:11.932634811 +0000 UTC m=+247.782947520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls") pod "cluster-samples-operator-6748489656-wm8p7" (UID: "759f88f7-10de-4f2e-8e64-3b2e14b88c44") : secret "samples-operator-tls" not found
Jul 30 02:30:11.387967 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:11.387930    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-97nvg" event={"ID":"c3c7b535-3fd2-482e-a3db-63789390305b","Type":"ContainerStarted","Data":"111da960d288eea7ed2775219dafe193a6fd09dc9935f1f36111a56641ac3278"}
Jul 30 02:30:11.388976 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:11.388948    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d" event={"ID":"28485e56-40a8-40bf-9497-53bf67edbc96","Type":"ContainerStarted","Data":"228e719c7850e5d8a5350b0b0f15a66d2526ea0982b9ce9e53c4db8b6bc02597"}
Jul 30 02:30:11.389940 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:11.389919    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s" event={"ID":"7e89ced1-b07c-438c-83dd-15333c24ea83","Type":"ContainerStarted","Data":"a9137c257897792d057e9a3e175ba028b815b5466eaa7a6e1d0ca2465aab3d30"}
Jul 30 02:30:11.840277 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:11.839863    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:11.840277 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:11.839993    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:11.840277 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:11.840118    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 02:30:11.840277 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:11.840181    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs podName:0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:13.840162355 +0000 UTC m=+249.690475092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs") pod "router-default-7499746c59-kn6df" (UID: "0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48") : secret "router-metrics-certs-default" not found
Jul 30 02:30:11.840652 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:11.840326    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle podName:0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:13.840306759 +0000 UTC m=+249.690619468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle") pod "router-default-7499746c59-kn6df" (UID: "0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48") : configmap references non-existent config key: service-ca.crt
Jul 30 02:30:11.941325 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:11.941064    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:11.941325 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:11.941160    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wm8p7\" (UID: \"759f88f7-10de-4f2e-8e64-3b2e14b88c44\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"
Jul 30 02:30:11.941325 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:11.941240    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 02:30:11.941325 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:11.941264    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d88b8fb6-86wmp: secret "image-registry-tls" not found
Jul 30 02:30:11.941325 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:11.941303    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 02:30:11.941325 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:11.941326    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls podName:7522d9db-ef6f-482d-9a3e-43ac524aa297 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:13.941304994 +0000 UTC m=+249.791617728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls") pod "image-registry-65d88b8fb6-86wmp" (UID: "7522d9db-ef6f-482d-9a3e-43ac524aa297") : secret "image-registry-tls" not found
Jul 30 02:30:11.941797 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:11.941353    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls podName:759f88f7-10de-4f2e-8e64-3b2e14b88c44 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:13.941337327 +0000 UTC m=+249.791650035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls") pod "cluster-samples-operator-6748489656-wm8p7" (UID: "759f88f7-10de-4f2e-8e64-3b2e14b88c44") : secret "samples-operator-tls" not found
Jul 30 02:30:13.856146 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:13.856119    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:13.856508 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:13.856194    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:13.856508 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:13.856276    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 02:30:13.856508 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:13.856304    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle podName:0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:17.856282145 +0000 UTC m=+253.706594858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle") pod "router-default-7499746c59-kn6df" (UID: "0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48") : configmap references non-existent config key: service-ca.crt
Jul 30 02:30:13.856508 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:13.856334    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs podName:0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:17.856323621 +0000 UTC m=+253.706636336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs") pod "router-default-7499746c59-kn6df" (UID: "0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48") : secret "router-metrics-certs-default" not found
Jul 30 02:30:13.956536 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:13.956475    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wm8p7\" (UID: \"759f88f7-10de-4f2e-8e64-3b2e14b88c44\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"
Jul 30 02:30:13.956673 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:13.956589    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:13.956673 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:13.956637    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 02:30:13.956779 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:13.956700    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls podName:759f88f7-10de-4f2e-8e64-3b2e14b88c44 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:17.956683123 +0000 UTC m=+253.806995833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls") pod "cluster-samples-operator-6748489656-wm8p7" (UID: "759f88f7-10de-4f2e-8e64-3b2e14b88c44") : secret "samples-operator-tls" not found
Jul 30 02:30:13.956779 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:13.956724    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 02:30:13.956779 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:13.956740    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d88b8fb6-86wmp: secret "image-registry-tls" not found
Jul 30 02:30:13.956779 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:13.956781    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls podName:7522d9db-ef6f-482d-9a3e-43ac524aa297 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:17.95676681 +0000 UTC m=+253.807079532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls") pod "image-registry-65d88b8fb6-86wmp" (UID: "7522d9db-ef6f-482d-9a3e-43ac524aa297") : secret "image-registry-tls" not found
Jul 30 02:30:14.400111 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.400074    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d" event={"ID":"28485e56-40a8-40bf-9497-53bf67edbc96","Type":"ContainerStarted","Data":"da199a04dcd3099491956466fa0aa456fe53b9a7ace6cf919836e41436102bea"}
Jul 30 02:30:14.401488 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.401469    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/0.log"
Jul 30 02:30:14.401634 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.401502    2554 generic.go:356] "Generic (PLEG): container finished" podID="7e89ced1-b07c-438c-83dd-15333c24ea83" containerID="7d7ee60b199a23ef333d5663d2ebe84942e9ba0eff0598ae8ed39b4001d71129" exitCode=255
Jul 30 02:30:14.401634 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.401603    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s" event={"ID":"7e89ced1-b07c-438c-83dd-15333c24ea83","Type":"ContainerDied","Data":"7d7ee60b199a23ef333d5663d2ebe84942e9ba0eff0598ae8ed39b4001d71129"}
Jul 30 02:30:14.401813 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.401794    2554 scope.go:117] "RemoveContainer" containerID="7d7ee60b199a23ef333d5663d2ebe84942e9ba0eff0598ae8ed39b4001d71129"
Jul 30 02:30:14.403084 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.403064    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-97nvg" event={"ID":"c3c7b535-3fd2-482e-a3db-63789390305b","Type":"ContainerStarted","Data":"48e8461ce60cbb3fe5373cfddf172e25f36e86eb3a73d50ecd4a8f0c632a36fc"}
Jul 30 02:30:14.415880 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.415844    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d" podStartSLOduration=1.409626985 podStartE2EDuration="4.415828355s" totalImagesPullingTime="3.00620137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:30:14.414469041 +0000 UTC m=+250.264781796" watchObservedRunningTime="2026-07-30 02:30:14.415828355 +0000 UTC m=+250.266141064"
Jul 30 02:30:14.447962 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.447912    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-97nvg" podStartSLOduration=1.420908955 podStartE2EDuration="4.447891817s" totalImagesPullingTime="3.026982862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:30:14.446209234 +0000 UTC m=+250.296521966" watchObservedRunningTime="2026-07-30 02:30:14.447891817 +0000 UTC m=+250.298204554"
Jul 30 02:30:14.631248 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.631216    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rl96w"]
Jul 30 02:30:14.634509 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.634489    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:14.637103 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.637079    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 02:30:14.637306 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.637287    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 02:30:14.637478 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.637452    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6sh2l\""
Jul 30 02:30:14.645782 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.645750    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rl96w"]
Jul 30 02:30:14.765288 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.765256    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:14.765399 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.765321    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:14.765399 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.765367    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g65q\" (UniqueName: \"kubernetes.io/projected/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-api-access-6g65q\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:14.765474 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.765429    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-data-volume\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:14.765474 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.765460    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-crio-socket\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:14.866281 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.866250    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:14.866629 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.866310    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:14.866629 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.866353    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g65q\" (UniqueName: \"kubernetes.io/projected/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-api-access-6g65q\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:14.866629 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:14.866386    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 02:30:14.866629 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:14.866426    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 02:30:14.866629 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:14.866455    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls podName:6fd23782-eaf7-4f93-aebb-20cc56cd9d75 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:15.36643505 +0000 UTC m=+251.216747779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rl96w" (UID: "6fd23782-eaf7-4f93-aebb-20cc56cd9d75") : secret "insights-runtime-extractor-tls" not found
Jul 30 02:30:14.866629 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:14.866473    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm podName:6fd23782-eaf7-4f93-aebb-20cc56cd9d75 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:15.36646367 +0000 UTC m=+251.216776382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rl96w" (UID: "6fd23782-eaf7-4f93-aebb-20cc56cd9d75") : configmap "kube-rbac-proxy" not found
Jul 30 02:30:14.866629 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.866391    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-data-volume\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:14.866629 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.866567    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-crio-socket\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:14.866884 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.866671    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-crio-socket\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:14.866884 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.866694    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-data-volume\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:14.876326 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:14.876298    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g65q\" (UniqueName: \"kubernetes.io/projected/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-api-access-6g65q\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:15.370387 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:15.370356    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:15.370634 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:15.370402    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:15.370634 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:15.370488    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 02:30:15.370634 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:15.370498    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 02:30:15.370634 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:15.370539    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm podName:6fd23782-eaf7-4f93-aebb-20cc56cd9d75 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:16.370525689 +0000 UTC m=+252.220838411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rl96w" (UID: "6fd23782-eaf7-4f93-aebb-20cc56cd9d75") : configmap "kube-rbac-proxy" not found
Jul 30 02:30:15.370634 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:15.370573    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls podName:6fd23782-eaf7-4f93-aebb-20cc56cd9d75 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:16.370565443 +0000 UTC m=+252.220878152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rl96w" (UID: "6fd23782-eaf7-4f93-aebb-20cc56cd9d75") : secret "insights-runtime-extractor-tls" not found
Jul 30 02:30:15.407655 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:15.407625    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/1.log"
Jul 30 02:30:15.407994 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:15.407979    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/0.log"
Jul 30 02:30:15.408051 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:15.408012    2554 generic.go:356] "Generic (PLEG): container finished" podID="7e89ced1-b07c-438c-83dd-15333c24ea83" containerID="749e88fab467fd882c9ee00d2ae75f2f418561b6c61259ce338b49dced8755b5" exitCode=255
Jul 30 02:30:15.408095 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:15.408083    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s" event={"ID":"7e89ced1-b07c-438c-83dd-15333c24ea83","Type":"ContainerDied","Data":"749e88fab467fd882c9ee00d2ae75f2f418561b6c61259ce338b49dced8755b5"}
Jul 30 02:30:15.408129 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:15.408122    2554 scope.go:117] "RemoveContainer" containerID="7d7ee60b199a23ef333d5663d2ebe84942e9ba0eff0598ae8ed39b4001d71129"
Jul 30 02:30:15.408357 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:15.408326    2554 scope.go:117] "RemoveContainer" containerID="749e88fab467fd882c9ee00d2ae75f2f418561b6c61259ce338b49dced8755b5"
Jul 30 02:30:15.408562 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:15.408514    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-fh26s_openshift-console-operator(7e89ced1-b07c-438c-83dd-15333c24ea83)\"" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s" podUID="7e89ced1-b07c-438c-83dd-15333c24ea83"
Jul 30 02:30:15.572556 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:15.572516    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:30:15.572722 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:15.572642    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 02:30:15.572722 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:15.572712    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs podName:e8d68db5-cc2c-417c-9027-b71ea9c67cee nodeName:}" failed. No retries permitted until 2026-07-30 02:32:17.572697923 +0000 UTC m=+373.423010632 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs") pod "network-metrics-daemon-5jft6" (UID: "e8d68db5-cc2c-417c-9027-b71ea9c67cee") : secret "metrics-daemon-secret" not found
Jul 30 02:30:16.160116 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.160079    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-bxs4p"]
Jul 30 02:30:16.164420 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.164398    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-bxs4p"
Jul 30 02:30:16.166958 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.166938    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 30 02:30:16.167047 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.166982    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 30 02:30:16.167926 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.167900    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 30 02:30:16.167926 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.167922    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tjtbp\""
Jul 30 02:30:16.168108 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.167964    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 30 02:30:16.172305 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.172284    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-bxs4p"]
Jul 30 02:30:16.279354 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.279323    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1631225d-b24f-4e4c-8d03-5fe801acd0cd-signing-key\") pod \"service-ca-658d7b7c78-bxs4p\" (UID: \"1631225d-b24f-4e4c-8d03-5fe801acd0cd\") " pod="openshift-service-ca/service-ca-658d7b7c78-bxs4p"
Jul 30 02:30:16.279534 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.279369    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjktj\" (UniqueName: \"kubernetes.io/projected/1631225d-b24f-4e4c-8d03-5fe801acd0cd-kube-api-access-zjktj\") pod \"service-ca-658d7b7c78-bxs4p\" (UID: \"1631225d-b24f-4e4c-8d03-5fe801acd0cd\") " pod="openshift-service-ca/service-ca-658d7b7c78-bxs4p"
Jul 30 02:30:16.279534 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.279426    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1631225d-b24f-4e4c-8d03-5fe801acd0cd-signing-cabundle\") pod \"service-ca-658d7b7c78-bxs4p\" (UID: \"1631225d-b24f-4e4c-8d03-5fe801acd0cd\") " pod="openshift-service-ca/service-ca-658d7b7c78-bxs4p"
Jul 30 02:30:16.380744 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.380703    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:16.380744 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.380755    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:16.380949 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:16.380871    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 02:30:16.380949 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.380895    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1631225d-b24f-4e4c-8d03-5fe801acd0cd-signing-key\") pod \"service-ca-658d7b7c78-bxs4p\" (UID: \"1631225d-b24f-4e4c-8d03-5fe801acd0cd\") " pod="openshift-service-ca/service-ca-658d7b7c78-bxs4p"
Jul 30 02:30:16.381036 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:16.380956    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls podName:6fd23782-eaf7-4f93-aebb-20cc56cd9d75 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:18.380934188 +0000 UTC m=+254.231246920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rl96w" (UID: "6fd23782-eaf7-4f93-aebb-20cc56cd9d75") : secret "insights-runtime-extractor-tls" not found
Jul 30 02:30:16.381036 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:16.380960    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 02:30:16.381036 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.380991    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjktj\" (UniqueName: \"kubernetes.io/projected/1631225d-b24f-4e4c-8d03-5fe801acd0cd-kube-api-access-zjktj\") pod \"service-ca-658d7b7c78-bxs4p\" (UID: \"1631225d-b24f-4e4c-8d03-5fe801acd0cd\") " pod="openshift-service-ca/service-ca-658d7b7c78-bxs4p"
Jul 30 02:30:16.381036 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:16.380999    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm podName:6fd23782-eaf7-4f93-aebb-20cc56cd9d75 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:18.380988462 +0000 UTC m=+254.231301174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rl96w" (UID: "6fd23782-eaf7-4f93-aebb-20cc56cd9d75") : configmap "kube-rbac-proxy" not found
Jul 30 02:30:16.381193 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.381046    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1631225d-b24f-4e4c-8d03-5fe801acd0cd-signing-cabundle\") pod \"service-ca-658d7b7c78-bxs4p\" (UID: \"1631225d-b24f-4e4c-8d03-5fe801acd0cd\") " pod="openshift-service-ca/service-ca-658d7b7c78-bxs4p"
Jul 30 02:30:16.381732 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.381715    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1631225d-b24f-4e4c-8d03-5fe801acd0cd-signing-cabundle\") pod \"service-ca-658d7b7c78-bxs4p\" (UID: \"1631225d-b24f-4e4c-8d03-5fe801acd0cd\") " pod="openshift-service-ca/service-ca-658d7b7c78-bxs4p"
Jul 30 02:30:16.383249 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.383230    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1631225d-b24f-4e4c-8d03-5fe801acd0cd-signing-key\") pod \"service-ca-658d7b7c78-bxs4p\" (UID: \"1631225d-b24f-4e4c-8d03-5fe801acd0cd\") " pod="openshift-service-ca/service-ca-658d7b7c78-bxs4p"
Jul 30 02:30:16.388977 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.388955    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjktj\" (UniqueName: \"kubernetes.io/projected/1631225d-b24f-4e4c-8d03-5fe801acd0cd-kube-api-access-zjktj\") pod \"service-ca-658d7b7c78-bxs4p\" (UID: \"1631225d-b24f-4e4c-8d03-5fe801acd0cd\") " pod="openshift-service-ca/service-ca-658d7b7c78-bxs4p"
Jul 30 02:30:16.413216 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.413166    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/1.log"
Jul 30 02:30:16.413478 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.413465    2554 scope.go:117] "RemoveContainer" containerID="749e88fab467fd882c9ee00d2ae75f2f418561b6c61259ce338b49dced8755b5"
Jul 30 02:30:16.413660 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:16.413642    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-fh26s_openshift-console-operator(7e89ced1-b07c-438c-83dd-15333c24ea83)\"" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s" podUID="7e89ced1-b07c-438c-83dd-15333c24ea83"
Jul 30 02:30:16.473562 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.473523    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-bxs4p"
Jul 30 02:30:16.592012 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.591989    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-bxs4p"]
Jul 30 02:30:16.594336 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:30:16.594311    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1631225d_b24f_4e4c_8d03_5fe801acd0cd.slice/crio-b6a7f30b9ce99ce3bb1d15170d87486411ddd17fe1aa328264c2a17ef6320c56 WatchSource:0}: Error finding container b6a7f30b9ce99ce3bb1d15170d87486411ddd17fe1aa328264c2a17ef6320c56: Status 404 returned error can't find the container with id b6a7f30b9ce99ce3bb1d15170d87486411ddd17fe1aa328264c2a17ef6320c56
Jul 30 02:30:16.816227 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:16.816204    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sv8rz_751d0197-5c04-418f-a656-a9396612d072/dns-node-resolver/0.log"
Jul 30 02:30:17.418202 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:17.418163    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-bxs4p" event={"ID":"1631225d-b24f-4e4c-8d03-5fe801acd0cd","Type":"ContainerStarted","Data":"b6a7f30b9ce99ce3bb1d15170d87486411ddd17fe1aa328264c2a17ef6320c56"}
Jul 30 02:30:17.418665 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:17.418217    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2qsc5_df95b109-705c-4fb3-9605-4d96ed3fa417/node-ca/0.log"
Jul 30 02:30:17.893832 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:17.893793    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:17.894002 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:17.893894    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:17.894002 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:17.893970    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 02:30:17.894099 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:17.894022    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle podName:0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:25.89400702 +0000 UTC m=+261.744319746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle") pod "router-default-7499746c59-kn6df" (UID: "0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48") : configmap references non-existent config key: service-ca.crt
Jul 30 02:30:17.894099 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:17.894046    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs podName:0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:25.894035536 +0000 UTC m=+261.744348261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs") pod "router-default-7499746c59-kn6df" (UID: "0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48") : secret "router-metrics-certs-default" not found
Jul 30 02:30:17.994498 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:17.994463    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:17.994694 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:17.994540    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wm8p7\" (UID: \"759f88f7-10de-4f2e-8e64-3b2e14b88c44\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"
Jul 30 02:30:17.994694 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:17.994656    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 02:30:17.994780 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:17.994723    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 02:30:17.994780 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:17.994734    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls podName:759f88f7-10de-4f2e-8e64-3b2e14b88c44 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:25.994713876 +0000 UTC m=+261.845026603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls") pod "cluster-samples-operator-6748489656-wm8p7" (UID: "759f88f7-10de-4f2e-8e64-3b2e14b88c44") : secret "samples-operator-tls" not found
Jul 30 02:30:17.994780 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:17.994742    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d88b8fb6-86wmp: secret "image-registry-tls" not found
Jul 30 02:30:17.994890 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:17.994795    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls podName:7522d9db-ef6f-482d-9a3e-43ac524aa297 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:25.994777438 +0000 UTC m=+261.845090163 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls") pod "image-registry-65d88b8fb6-86wmp" (UID: "7522d9db-ef6f-482d-9a3e-43ac524aa297") : secret "image-registry-tls" not found
Jul 30 02:30:18.216390 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:18.216243    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4ls5q_dd7f642f-aeeb-4c64-90a8-2ada86bc0964/serve-healthcheck-canary/0.log"
Jul 30 02:30:18.398365 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:18.398326    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:18.398532 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:18.398440    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 02:30:18.398532 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:18.398496    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:18.398532 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:18.398516    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm podName:6fd23782-eaf7-4f93-aebb-20cc56cd9d75 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:22.398493124 +0000 UTC m=+258.248805862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rl96w" (UID: "6fd23782-eaf7-4f93-aebb-20cc56cd9d75") : configmap "kube-rbac-proxy" not found
Jul 30 02:30:18.398695 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:18.398610    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 02:30:18.398695 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:18.398663    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls podName:6fd23782-eaf7-4f93-aebb-20cc56cd9d75 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:22.398646793 +0000 UTC m=+258.248959517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rl96w" (UID: "6fd23782-eaf7-4f93-aebb-20cc56cd9d75") : secret "insights-runtime-extractor-tls" not found
Jul 30 02:30:19.426596 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:19.426544    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-bxs4p" event={"ID":"1631225d-b24f-4e4c-8d03-5fe801acd0cd","Type":"ContainerStarted","Data":"409a4906e2743e2fbe023a3ee5eb010f1cb7ca419c7cd44a4f4c921fc964944e"}
Jul 30 02:30:19.445167 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:19.445115    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-bxs4p" podStartSLOduration=1.486149697 podStartE2EDuration="3.445098143s" totalImagesPullingTime="1.958948446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:30:19.444187202 +0000 UTC m=+255.294499936" watchObservedRunningTime="2026-07-30 02:30:19.445098143 +0000 UTC m=+255.295410877"
Jul 30 02:30:20.428441 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:20.428346    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:20.428441 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:20.428413    2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:20.428990 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:20.428882    2554 scope.go:117] "RemoveContainer" containerID="749e88fab467fd882c9ee00d2ae75f2f418561b6c61259ce338b49dced8755b5"
Jul 30 02:30:20.429095 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:20.429073    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-fh26s_openshift-console-operator(7e89ced1-b07c-438c-83dd-15333c24ea83)\"" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s" podUID="7e89ced1-b07c-438c-83dd-15333c24ea83"
Jul 30 02:30:22.437662 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:22.437629    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:22.438034 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:22.437737    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 02:30:22.438034 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:22.437747    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:22.438034 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:22.437793    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm podName:6fd23782-eaf7-4f93-aebb-20cc56cd9d75 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:30.437775617 +0000 UTC m=+266.288088326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rl96w" (UID: "6fd23782-eaf7-4f93-aebb-20cc56cd9d75") : configmap "kube-rbac-proxy" not found
Jul 30 02:30:22.438034 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:22.437849    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 02:30:22.438034 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:22.437891    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls podName:6fd23782-eaf7-4f93-aebb-20cc56cd9d75 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:30.437879538 +0000 UTC m=+266.288192247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rl96w" (UID: "6fd23782-eaf7-4f93-aebb-20cc56cd9d75") : secret "insights-runtime-extractor-tls" not found
Jul 30 02:30:25.970841 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:25.970785    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:25.970841 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:25.970845    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:25.971413 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:25.971384    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-service-ca-bundle\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:25.973292 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:25.973269    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48-metrics-certs\") pod \"router-default-7499746c59-kn6df\" (UID: \"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48\") " pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:26.034200 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.034167    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:26.071954 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.071927    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wm8p7\" (UID: \"759f88f7-10de-4f2e-8e64-3b2e14b88c44\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"
Jul 30 02:30:26.072113 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.071992    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:26.075242 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.075216    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/759f88f7-10de-4f2e-8e64-3b2e14b88c44-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wm8p7\" (UID: \"759f88f7-10de-4f2e-8e64-3b2e14b88c44\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"
Jul 30 02:30:26.075349 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.075258    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls\") pod \"image-registry-65d88b8fb6-86wmp\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") " pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:26.145878 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.145844    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"
Jul 30 02:30:26.150033 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.150009    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:26.168534 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.168508    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7499746c59-kn6df"]
Jul 30 02:30:26.172187 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:30:26.172118    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d3d8b42_5b4f_4c4d_acfb_9d35a1da9e48.slice/crio-3a1c57b2f51f848464a5863a00414ca05d305f0c367259b4c28b73b0c84391a9 WatchSource:0}: Error finding container 3a1c57b2f51f848464a5863a00414ca05d305f0c367259b4c28b73b0c84391a9: Status 404 returned error can't find the container with id 3a1c57b2f51f848464a5863a00414ca05d305f0c367259b4c28b73b0c84391a9
Jul 30 02:30:26.298871 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.298835    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65d88b8fb6-86wmp"]
Jul 30 02:30:26.302953 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:30:26.302926    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7522d9db_ef6f_482d_9a3e_43ac524aa297.slice/crio-91667be455678406b4bf7fd3bbf58dcb4bbb04b97a77e9cf5961ba8994527f55 WatchSource:0}: Error finding container 91667be455678406b4bf7fd3bbf58dcb4bbb04b97a77e9cf5961ba8994527f55: Status 404 returned error can't find the container with id 91667be455678406b4bf7fd3bbf58dcb4bbb04b97a77e9cf5961ba8994527f55
Jul 30 02:30:26.314332 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.314310    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7"]
Jul 30 02:30:26.448799 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.448761    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp" event={"ID":"7522d9db-ef6f-482d-9a3e-43ac524aa297","Type":"ContainerStarted","Data":"d420f1bc3236a363acc8038b2ed678b001bf412d75b25f9cd33aaa327010da6d"}
Jul 30 02:30:26.449014 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.448826    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp" event={"ID":"7522d9db-ef6f-482d-9a3e-43ac524aa297","Type":"ContainerStarted","Data":"91667be455678406b4bf7fd3bbf58dcb4bbb04b97a77e9cf5961ba8994527f55"}
Jul 30 02:30:26.449014 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.448898    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:30:26.450096 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.450070    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7" event={"ID":"759f88f7-10de-4f2e-8e64-3b2e14b88c44","Type":"ContainerStarted","Data":"5fcfeb2f059bd387f740fc9fd3ddf1527461cdf7badc519f485ac73c937c0be1"}
Jul 30 02:30:26.451590 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.451566    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7499746c59-kn6df" event={"ID":"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48","Type":"ContainerStarted","Data":"e93efe077e88fb8bd418da7352756110eff97df80eae3bcc4b92296f7981e06a"}
Jul 30 02:30:26.451679 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.451605    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7499746c59-kn6df" event={"ID":"0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48","Type":"ContainerStarted","Data":"3a1c57b2f51f848464a5863a00414ca05d305f0c367259b4c28b73b0c84391a9"}
Jul 30 02:30:26.466525 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.466470    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp" podStartSLOduration=16.466452147 podStartE2EDuration="16.466452147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:30:26.465497146 +0000 UTC m=+262.315809878" watchObservedRunningTime="2026-07-30 02:30:26.466452147 +0000 UTC m=+262.316764856"
Jul 30 02:30:26.483499 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:26.483439    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7499746c59-kn6df" podStartSLOduration=16.483423018 podStartE2EDuration="16.483423018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:30:26.482367981 +0000 UTC m=+262.332680726" watchObservedRunningTime="2026-07-30 02:30:26.483423018 +0000 UTC m=+262.333735749"
Jul 30 02:30:27.035262 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:27.035228    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:27.037982 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:27.037960    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:27.455675 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:27.455589    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:27.456966 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:27.456943    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7499746c59-kn6df"
Jul 30 02:30:29.464192 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:29.464156    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7" event={"ID":"759f88f7-10de-4f2e-8e64-3b2e14b88c44","Type":"ContainerStarted","Data":"a0a638f58da366250c0d0de99f76146d9c4c8124988998c7fedbad8af0e2e3d0"}
Jul 30 02:30:29.464602 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:29.464209    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7" event={"ID":"759f88f7-10de-4f2e-8e64-3b2e14b88c44","Type":"ContainerStarted","Data":"71db5cd396a61bf2921bdffe90dbdf23578fdae505216239fcaf491c344f883b"}
Jul 30 02:30:29.481470 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:29.481420    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wm8p7" podStartSLOduration=17.13173427 podStartE2EDuration="19.48140559s" totalImagesPullingTime="2.34967132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:30:29.480439141 +0000 UTC m=+265.330751871" watchObservedRunningTime="2026-07-30 02:30:29.48140559 +0000 UTC m=+265.331718321"
Jul 30 02:30:30.514601 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:30.514534    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:30.514601 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:30.514617    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:30.515131 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:30.515076    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:30.516884 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:30.516860    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6fd23782-eaf7-4f93-aebb-20cc56cd9d75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rl96w\" (UID: \"6fd23782-eaf7-4f93-aebb-20cc56cd9d75\") " pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:30.549138 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:30.549108    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rl96w"
Jul 30 02:30:30.671639 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:30.671500    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rl96w"]
Jul 30 02:30:30.674187 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:30:30.674153    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd23782_eaf7_4f93_aebb_20cc56cd9d75.slice/crio-6d431346931b8c402394904805d00ac445a7315e6b03d9004a7611d8a5e7530a WatchSource:0}: Error finding container 6d431346931b8c402394904805d00ac445a7315e6b03d9004a7611d8a5e7530a: Status 404 returned error can't find the container with id 6d431346931b8c402394904805d00ac445a7315e6b03d9004a7611d8a5e7530a
Jul 30 02:30:31.473508 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:31.473462    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rl96w" event={"ID":"6fd23782-eaf7-4f93-aebb-20cc56cd9d75","Type":"ContainerStarted","Data":"6d431346931b8c402394904805d00ac445a7315e6b03d9004a7611d8a5e7530a"}
Jul 30 02:30:31.636051 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:31.636012    2554 scope.go:117] "RemoveContainer" containerID="749e88fab467fd882c9ee00d2ae75f2f418561b6c61259ce338b49dced8755b5"
Jul 30 02:30:32.480866 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:32.480831    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:30:32.481391 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:32.481360    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/1.log"
Jul 30 02:30:32.481490 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:32.481403    2554 generic.go:356] "Generic (PLEG): container finished" podID="7e89ced1-b07c-438c-83dd-15333c24ea83" containerID="e414cc0cc760bf327971c0ad5bfd5adeee18fc65e546545ad37da16cf3e82644" exitCode=255
Jul 30 02:30:32.481490 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:32.481469    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s" event={"ID":"7e89ced1-b07c-438c-83dd-15333c24ea83","Type":"ContainerDied","Data":"e414cc0cc760bf327971c0ad5bfd5adeee18fc65e546545ad37da16cf3e82644"}
Jul 30 02:30:32.481593 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:32.481526    2554 scope.go:117] "RemoveContainer" containerID="749e88fab467fd882c9ee00d2ae75f2f418561b6c61259ce338b49dced8755b5"
Jul 30 02:30:32.481963 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:32.481921    2554 scope.go:117] "RemoveContainer" containerID="e414cc0cc760bf327971c0ad5bfd5adeee18fc65e546545ad37da16cf3e82644"
Jul 30 02:30:32.482129 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:32.482102    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-fh26s_openshift-console-operator(7e89ced1-b07c-438c-83dd-15333c24ea83)\"" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s" podUID="7e89ced1-b07c-438c-83dd-15333c24ea83"
Jul 30 02:30:33.486403 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:33.486377    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:30:34.830123 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:34.830071    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65d88b8fb6-86wmp"]
Jul 30 02:30:36.498781 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:36.498736    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rl96w" event={"ID":"6fd23782-eaf7-4f93-aebb-20cc56cd9d75","Type":"ContainerStarted","Data":"28bd6f0e31db46b629483c4fabab0ca3075742c0df9b50e1b51dc03ebfd41c32"}
Jul 30 02:30:39.513086 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:39.513046    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rl96w" event={"ID":"6fd23782-eaf7-4f93-aebb-20cc56cd9d75","Type":"ContainerStarted","Data":"2adafa7c2460a4a2d600e9a6c582a612f8042796ba254224e177c51da4e1cabf"}
Jul 30 02:30:40.428462 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:40.428426    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:40.428656 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:40.428480    2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:40.428849 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:40.428833    2554 scope.go:117] "RemoveContainer" containerID="e414cc0cc760bf327971c0ad5bfd5adeee18fc65e546545ad37da16cf3e82644"
Jul 30 02:30:40.429042 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:40.429021    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-fh26s_openshift-console-operator(7e89ced1-b07c-438c-83dd-15333c24ea83)\"" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s" podUID="7e89ced1-b07c-438c-83dd-15333c24ea83"
Jul 30 02:30:41.523296 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:41.523257    2554 generic.go:356] "Generic (PLEG): container finished" podID="a6028787-5153-4b37-815a-598aa64931e9" containerID="faa8fb182ce3033f76ae9eb512d0002aa256fbd86dd82e421cbdef2c228c3a8b" exitCode=255
Jul 30 02:30:41.523296 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:41.523308    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9" event={"ID":"a6028787-5153-4b37-815a-598aa64931e9","Type":"ContainerDied","Data":"faa8fb182ce3033f76ae9eb512d0002aa256fbd86dd82e421cbdef2c228c3a8b"}
Jul 30 02:30:41.529852 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:41.529835    2554 scope.go:117] "RemoveContainer" containerID="faa8fb182ce3033f76ae9eb512d0002aa256fbd86dd82e421cbdef2c228c3a8b"
Jul 30 02:30:43.534852 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:43.534812    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rl96w" event={"ID":"6fd23782-eaf7-4f93-aebb-20cc56cd9d75","Type":"ContainerStarted","Data":"5814f53b07dda5044a75718c8844f4c250352967c259ac0863b92049f4b32ae5"}
Jul 30 02:30:43.536350 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:43.536329    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bfff6d4-cdfp9" event={"ID":"a6028787-5153-4b37-815a-598aa64931e9","Type":"ContainerStarted","Data":"253869fc4517016d6fe4d4c791ba2eca7bde696711faf2c3f7b0cb9e58deb84d"}
Jul 30 02:30:43.552080 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:43.552032    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rl96w" podStartSLOduration=17.792276393 podStartE2EDuration="29.552018672s" totalImagesPullingTime="11.759742279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 02:30:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:30:43.550253162 +0000 UTC m=+279.400565936" watchObservedRunningTime="2026-07-30 02:30:43.552018672 +0000 UTC m=+279.402331403"
Jul 30 02:30:44.836130 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:44.836086    2554 patch_prober.go:28] interesting pod/image-registry-65d88b8fb6-86wmp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 30 02:30:44.836496 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:44.836143    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp" podUID="7522d9db-ef6f-482d-9a3e-43ac524aa297" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 02:30:46.183793 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:46.183729    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5bkd9" podUID="9cc11f4f-f101-4b6b-a00f-01cce5a1b057"
Jul 30 02:30:46.545493 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:46.545463    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:30:49.976474 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:49.976440    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:30:49.978724 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:49.978704    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cc11f4f-f101-4b6b-a00f-01cce5a1b057-metrics-tls\") pod \"dns-default-5bkd9\" (UID: \"9cc11f4f-f101-4b6b-a00f-01cce5a1b057\") " pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:30:50.149035 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:50.148997    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5sqnz\""
Jul 30 02:30:50.157107 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:50.157084    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:30:50.280243 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:50.280204    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5bkd9"]
Jul 30 02:30:50.283191 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:30:50.283167    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc11f4f_f101_4b6b_a00f_01cce5a1b057.slice/crio-442009ecbf8e1dc2b62e3398f0ee5b7ecefa157ce48456ebdcd8ef56a5f0ae5c WatchSource:0}: Error finding container 442009ecbf8e1dc2b62e3398f0ee5b7ecefa157ce48456ebdcd8ef56a5f0ae5c: Status 404 returned error can't find the container with id 442009ecbf8e1dc2b62e3398f0ee5b7ecefa157ce48456ebdcd8ef56a5f0ae5c
Jul 30 02:30:50.559717 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:50.559675    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bkd9" event={"ID":"9cc11f4f-f101-4b6b-a00f-01cce5a1b057","Type":"ContainerStarted","Data":"442009ecbf8e1dc2b62e3398f0ee5b7ecefa157ce48456ebdcd8ef56a5f0ae5c"}
Jul 30 02:30:52.569832 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:52.569800    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bkd9" event={"ID":"9cc11f4f-f101-4b6b-a00f-01cce5a1b057","Type":"ContainerStarted","Data":"c08d9a9fd7e480ac5b8456d6296fc1577ca293223c0b2b8c82a9bb3b76d634b8"}
Jul 30 02:30:52.570226 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:52.569850    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bkd9" event={"ID":"9cc11f4f-f101-4b6b-a00f-01cce5a1b057","Type":"ContainerStarted","Data":"37419b0ca7ee82c5d43b59843c0f440f152bdb77accee729e9fd2d420a6ef74c"}
Jul 30 02:30:52.570226 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:52.569913    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:30:52.587097 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:52.587030    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5bkd9" podStartSLOduration=250.936187541 podStartE2EDuration="4m12.587015136s" totalImagesPullingTime="1.650827595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:30:52.585988173 +0000 UTC m=+288.436300904" watchObservedRunningTime="2026-07-30 02:30:52.587015136 +0000 UTC m=+288.437327866"
Jul 30 02:30:53.706108 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.706072    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2x69c"]
Jul 30 02:30:53.710004 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.709974    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.712767 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.712569    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 02:30:53.712767 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.712579    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 02:30:53.713895 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.713606    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h2qjz\""
Jul 30 02:30:53.713895 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.713663    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 02:30:53.713895 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.713611    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 02:30:53.714126 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.713946    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 02:30:53.714126 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.714115    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 02:30:53.804766 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.804709    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a35e99f1-3655-4b75-8e99-2b2586a5067c-metrics-client-ca\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.804766 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.804777    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m5x7\" (UniqueName: \"kubernetes.io/projected/a35e99f1-3655-4b75-8e99-2b2586a5067c-kube-api-access-4m5x7\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.805026 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.804812    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a35e99f1-3655-4b75-8e99-2b2586a5067c-sys\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.805026 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.804846    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-accelerators-collector-config\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.805026 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.804876    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-tls\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.805026 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.804972    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a35e99f1-3655-4b75-8e99-2b2586a5067c-root\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.805026 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.805018    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.805260 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.805086    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-wtmp\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.805260 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.805123    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-textfile\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.905699 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.905663    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.905876 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.905709    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-wtmp\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.905876 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.905742    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-textfile\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.905876 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.905779    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a35e99f1-3655-4b75-8e99-2b2586a5067c-metrics-client-ca\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.905876 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.905812    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m5x7\" (UniqueName: \"kubernetes.io/projected/a35e99f1-3655-4b75-8e99-2b2586a5067c-kube-api-access-4m5x7\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.905876 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.905847    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a35e99f1-3655-4b75-8e99-2b2586a5067c-sys\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.906119 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.905883    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-accelerators-collector-config\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.906119 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.905912    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-tls\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.906119 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.905918    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-wtmp\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.906119 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.905944    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a35e99f1-3655-4b75-8e99-2b2586a5067c-root\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.906119 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.905952    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a35e99f1-3655-4b75-8e99-2b2586a5067c-sys\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.906119 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.906014    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a35e99f1-3655-4b75-8e99-2b2586a5067c-root\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.906397 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.906224    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-textfile\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.906766 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.906747    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a35e99f1-3655-4b75-8e99-2b2586a5067c-metrics-client-ca\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.906834 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.906810    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-accelerators-collector-config\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.908004 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.907981    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.908399 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.908379    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a35e99f1-3655-4b75-8e99-2b2586a5067c-node-exporter-tls\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:53.913087 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:53.913065    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m5x7\" (UniqueName: \"kubernetes.io/projected/a35e99f1-3655-4b75-8e99-2b2586a5067c-kube-api-access-4m5x7\") pod \"node-exporter-2x69c\" (UID: \"a35e99f1-3655-4b75-8e99-2b2586a5067c\") " pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:54.022576 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:54.022532    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2x69c"
Jul 30 02:30:54.034822 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:30:54.034795    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35e99f1_3655_4b75_8e99_2b2586a5067c.slice/crio-d43f593b31fb5b796957b86878e956009f1e4d154a837c99eadc923d43fbd6d9 WatchSource:0}: Error finding container d43f593b31fb5b796957b86878e956009f1e4d154a837c99eadc923d43fbd6d9: Status 404 returned error can't find the container with id d43f593b31fb5b796957b86878e956009f1e4d154a837c99eadc923d43fbd6d9
Jul 30 02:30:54.578953 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:54.578917    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2x69c" event={"ID":"a35e99f1-3655-4b75-8e99-2b2586a5067c","Type":"ContainerStarted","Data":"d43f593b31fb5b796957b86878e956009f1e4d154a837c99eadc923d43fbd6d9"}
Jul 30 02:30:54.638250 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:54.638209    2554 scope.go:117] "RemoveContainer" containerID="e414cc0cc760bf327971c0ad5bfd5adeee18fc65e546545ad37da16cf3e82644"
Jul 30 02:30:54.836701 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:54.836394    2554 patch_prober.go:28] interesting pod/image-registry-65d88b8fb6-86wmp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 30 02:30:54.836701 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:54.836453    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp" podUID="7522d9db-ef6f-482d-9a3e-43ac524aa297" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 02:30:55.584303 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:55.584279    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:30:55.584468 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:55.584397    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s" event={"ID":"7e89ced1-b07c-438c-83dd-15333c24ea83","Type":"ContainerStarted","Data":"10ef2865c5a3adcb93a56d2e4df8b918539a2e15b0daffe40640bdd446e74f4b"}
Jul 30 02:30:55.584789 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:55.584713    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:55.586172 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:55.586143    2554 generic.go:356] "Generic (PLEG): container finished" podID="a35e99f1-3655-4b75-8e99-2b2586a5067c" containerID="0cf0381bebdca8d3c6f1e515a377be8a2f00029ba4c533368008a99e23fae1d5" exitCode=0
Jul 30 02:30:55.586281 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:55.586190    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2x69c" event={"ID":"a35e99f1-3655-4b75-8e99-2b2586a5067c","Type":"ContainerDied","Data":"0cf0381bebdca8d3c6f1e515a377be8a2f00029ba4c533368008a99e23fae1d5"}
Jul 30 02:30:55.604105 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:55.604059    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s" podStartSLOduration=42.474583252 podStartE2EDuration="45.604043107s" totalImagesPullingTime="3.129459855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:30:55.600603002 +0000 UTC m=+291.450915733" watchObservedRunningTime="2026-07-30 02:30:55.604043107 +0000 UTC m=+291.454355839"
Jul 30 02:30:55.677637 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:55.677596    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-fh26s"
Jul 30 02:30:56.592528 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.592491    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2x69c" event={"ID":"a35e99f1-3655-4b75-8e99-2b2586a5067c","Type":"ContainerStarted","Data":"b824faebfdd246708cf53dc513ce8c088156b53f72f1bffbbdc8a3b70a649eaa"}
Jul 30 02:30:56.592998 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.592578    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2x69c" event={"ID":"a35e99f1-3655-4b75-8e99-2b2586a5067c","Type":"ContainerStarted","Data":"dda2181a919215c28be66fa496b9906cb0d421f694a02748458a52c75594b60d"}
Jul 30 02:30:56.612623 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.612560    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2x69c" podStartSLOduration=2.4686965499999998 podStartE2EDuration="3.61252968s" totalImagesPullingTime="1.081670293s" totalInitContainerRuntime="62.162837ms" isStatefulPod=true podCreationTimestamp="2026-07-30 02:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:30:56.610534728 +0000 UTC m=+292.460847461" watchObservedRunningTime="2026-07-30 02:30:56.61252968 +0000 UTC m=+292.462842412"
Jul 30 02:30:56.677808 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.677776    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"]
Jul 30 02:30:56.686999 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.686945    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.689938 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.689915    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 30 02:30:56.690128 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.690107    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 30 02:30:56.690270 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.690178    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 30 02:30:56.690270 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.690204    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-65lx8\""
Jul 30 02:30:56.690270 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.689963    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-e5obfm2c0al80\""
Jul 30 02:30:56.690449 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.690045    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 30 02:30:56.690449 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.690370    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 30 02:30:56.697508 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.697487    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"]
Jul 30 02:30:56.729172 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.729141    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-tls\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.729287 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.729178    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.729287 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.729241    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81350d98-0997-440e-81cf-76ee7bd63f0c-metrics-client-ca\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.729287 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.729263    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vr4x\" (UniqueName: \"kubernetes.io/projected/81350d98-0997-440e-81cf-76ee7bd63f0c-kube-api-access-7vr4x\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.729446 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.729307    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.729446 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.729328    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.729446 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.729373    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-grpc-tls\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.729446 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.729427    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.830456 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.830417    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-grpc-tls\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.830456 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.830456    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.830739 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.830478    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-tls\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.830739 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.830512    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.830739 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.830585    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81350d98-0997-440e-81cf-76ee7bd63f0c-metrics-client-ca\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.830739 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.830609    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vr4x\" (UniqueName: \"kubernetes.io/projected/81350d98-0997-440e-81cf-76ee7bd63f0c-kube-api-access-7vr4x\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.830739 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.830644    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.830739 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.830673    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.831481 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.831436    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81350d98-0997-440e-81cf-76ee7bd63f0c-metrics-client-ca\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.833414 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.833387    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.833600 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.833579    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.833713 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.833692    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.833768 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.833715    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.833879 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.833856    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-thanos-querier-tls\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.834136 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.834117    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/81350d98-0997-440e-81cf-76ee7bd63f0c-secret-grpc-tls\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.838490 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.838465    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vr4x\" (UniqueName: \"kubernetes.io/projected/81350d98-0997-440e-81cf-76ee7bd63f0c-kube-api-access-7vr4x\") pod \"thanos-querier-5f7bdcbd6f-6pz8l\" (UID: \"81350d98-0997-440e-81cf-76ee7bd63f0c\") " pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:56.999945 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:56.999915    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:30:57.135318 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:57.135284    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"]
Jul 30 02:30:57.138476 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:30:57.138448    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81350d98_0997_440e_81cf_76ee7bd63f0c.slice/crio-14cd8c5d520f9b01db08596a20f4192b87a5c16e5f925e609ac60aab5b712eda WatchSource:0}: Error finding container 14cd8c5d520f9b01db08596a20f4192b87a5c16e5f925e609ac60aab5b712eda: Status 404 returned error can't find the container with id 14cd8c5d520f9b01db08596a20f4192b87a5c16e5f925e609ac60aab5b712eda
Jul 30 02:30:57.596924 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:57.596887    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l" event={"ID":"81350d98-0997-440e-81cf-76ee7bd63f0c","Type":"ContainerStarted","Data":"14cd8c5d520f9b01db08596a20f4192b87a5c16e5f925e609ac60aab5b712eda"}
Jul 30 02:30:58.467622 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.467585    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq"]
Jul 30 02:30:58.470713 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.470696    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq"
Jul 30 02:30:58.473268 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.473249    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 30 02:30:58.473667 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.473650    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2qmwp\""
Jul 30 02:30:58.483123 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.483094    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq"]
Jul 30 02:30:58.546677 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.546628    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzxhx\" (UniqueName: \"kubernetes.io/projected/228f5777-e4d6-44d3-8b93-44d57ba23858-kube-api-access-qzxhx\") pod \"monitoring-plugin-68b7fc9574-4whwq\" (UID: \"228f5777-e4d6-44d3-8b93-44d57ba23858\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq"
Jul 30 02:30:58.546853 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.546741    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/228f5777-e4d6-44d3-8b93-44d57ba23858-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4whwq\" (UID: \"228f5777-e4d6-44d3-8b93-44d57ba23858\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq"
Jul 30 02:30:58.647996 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.647960    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzxhx\" (UniqueName: \"kubernetes.io/projected/228f5777-e4d6-44d3-8b93-44d57ba23858-kube-api-access-qzxhx\") pod \"monitoring-plugin-68b7fc9574-4whwq\" (UID: \"228f5777-e4d6-44d3-8b93-44d57ba23858\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq"
Jul 30 02:30:58.648469 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.648006    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/228f5777-e4d6-44d3-8b93-44d57ba23858-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4whwq\" (UID: \"228f5777-e4d6-44d3-8b93-44d57ba23858\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq"
Jul 30 02:30:58.648469 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:58.648117    2554 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 30 02:30:58.648469 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:58.648174    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/228f5777-e4d6-44d3-8b93-44d57ba23858-monitoring-plugin-cert podName:228f5777-e4d6-44d3-8b93-44d57ba23858 nodeName:}" failed. No retries permitted until 2026-07-30 02:30:59.148155121 +0000 UTC m=+294.998467838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/228f5777-e4d6-44d3-8b93-44d57ba23858-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-4whwq" (UID: "228f5777-e4d6-44d3-8b93-44d57ba23858") : secret "monitoring-plugin-cert" not found
Jul 30 02:30:58.659968 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.659939    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzxhx\" (UniqueName: \"kubernetes.io/projected/228f5777-e4d6-44d3-8b93-44d57ba23858-kube-api-access-qzxhx\") pod \"monitoring-plugin-68b7fc9574-4whwq\" (UID: \"228f5777-e4d6-44d3-8b93-44d57ba23858\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq"
Jul 30 02:30:58.879466 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.879420    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-57cd66d666-zc8n6"]
Jul 30 02:30:58.883084 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.883063    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:58.885686 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.885660    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 30 02:30:58.885805 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.885789    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 30 02:30:58.886111 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.885912    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 30 02:30:58.886111 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.885912    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-smnhj\""
Jul 30 02:30:58.886111 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.885978    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 30 02:30:58.886412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.886387    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 30 02:30:58.890604 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.890581    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 30 02:30:58.898900 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.898879    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57cd66d666-zc8n6"]
Jul 30 02:30:58.949678 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.949651    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjkt2\" (UniqueName: \"kubernetes.io/projected/4d172ada-9f9f-42ed-aae6-72f940f3c832-kube-api-access-vjkt2\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:58.949678 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.949684    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d172ada-9f9f-42ed-aae6-72f940f3c832-serving-certs-ca-bundle\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:58.949895 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.949704    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d172ada-9f9f-42ed-aae6-72f940f3c832-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:58.949895 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.949784    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d172ada-9f9f-42ed-aae6-72f940f3c832-metrics-client-ca\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:58.949895 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.949838    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4d172ada-9f9f-42ed-aae6-72f940f3c832-telemeter-client-tls\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:58.949895 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.949883    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4d172ada-9f9f-42ed-aae6-72f940f3c832-secret-telemeter-client\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:58.950096 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.949928    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4d172ada-9f9f-42ed-aae6-72f940f3c832-federate-client-tls\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:58.950096 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:58.949957    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d172ada-9f9f-42ed-aae6-72f940f3c832-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.051539 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.051499    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjkt2\" (UniqueName: \"kubernetes.io/projected/4d172ada-9f9f-42ed-aae6-72f940f3c832-kube-api-access-vjkt2\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.051744 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.051565    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d172ada-9f9f-42ed-aae6-72f940f3c832-serving-certs-ca-bundle\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.051744 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.051597    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d172ada-9f9f-42ed-aae6-72f940f3c832-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.051744 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.051643    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d172ada-9f9f-42ed-aae6-72f940f3c832-metrics-client-ca\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.051744 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.051675    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4d172ada-9f9f-42ed-aae6-72f940f3c832-telemeter-client-tls\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.051744 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.051715    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4d172ada-9f9f-42ed-aae6-72f940f3c832-secret-telemeter-client\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.052022 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.051756    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4d172ada-9f9f-42ed-aae6-72f940f3c832-federate-client-tls\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.052022 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.051782    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d172ada-9f9f-42ed-aae6-72f940f3c832-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.052457 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.052432    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d172ada-9f9f-42ed-aae6-72f940f3c832-serving-certs-ca-bundle\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.052736 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.052715    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d172ada-9f9f-42ed-aae6-72f940f3c832-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.052815 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.052781    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d172ada-9f9f-42ed-aae6-72f940f3c832-metrics-client-ca\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.054902 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.054877    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4d172ada-9f9f-42ed-aae6-72f940f3c832-secret-telemeter-client\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.055014 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.054987    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4d172ada-9f9f-42ed-aae6-72f940f3c832-telemeter-client-tls\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.055116 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.054985    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4d172ada-9f9f-42ed-aae6-72f940f3c832-federate-client-tls\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.055265 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.055237    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d172ada-9f9f-42ed-aae6-72f940f3c832-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.059938 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.059916    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjkt2\" (UniqueName: \"kubernetes.io/projected/4d172ada-9f9f-42ed-aae6-72f940f3c832-kube-api-access-vjkt2\") pod \"telemeter-client-57cd66d666-zc8n6\" (UID: \"4d172ada-9f9f-42ed-aae6-72f940f3c832\") " pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.152751 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.152724    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/228f5777-e4d6-44d3-8b93-44d57ba23858-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4whwq\" (UID: \"228f5777-e4d6-44d3-8b93-44d57ba23858\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq"
Jul 30 02:30:59.155037 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.155013    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/228f5777-e4d6-44d3-8b93-44d57ba23858-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4whwq\" (UID: \"228f5777-e4d6-44d3-8b93-44d57ba23858\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq"
Jul 30 02:30:59.195111 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.195091    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6"
Jul 30 02:30:59.337763 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.337737    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57cd66d666-zc8n6"]
Jul 30 02:30:59.342640 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:30:59.342612    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d172ada_9f9f_42ed_aae6_72f940f3c832.slice/crio-5c8358169adf1205b6aeae241b3ca6640142318c8e2bb5cde0eab40e94750caa WatchSource:0}: Error finding container 5c8358169adf1205b6aeae241b3ca6640142318c8e2bb5cde0eab40e94750caa: Status 404 returned error can't find the container with id 5c8358169adf1205b6aeae241b3ca6640142318c8e2bb5cde0eab40e94750caa
Jul 30 02:30:59.380176 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.380148    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq"
Jul 30 02:30:59.506634 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.506607    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq"]
Jul 30 02:30:59.509714 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:30:59.509690    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228f5777_e4d6_44d3_8b93_44d57ba23858.slice/crio-9003429fc0ddc2a8fa447fe59033e3447f772ac26af2e3ce34c4cc9cbb043351 WatchSource:0}: Error finding container 9003429fc0ddc2a8fa447fe59033e3447f772ac26af2e3ce34c4cc9cbb043351: Status 404 returned error can't find the container with id 9003429fc0ddc2a8fa447fe59033e3447f772ac26af2e3ce34c4cc9cbb043351
Jul 30 02:30:59.606478 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.606442    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l" event={"ID":"81350d98-0997-440e-81cf-76ee7bd63f0c","Type":"ContainerStarted","Data":"8938621c07990821dad821df6b0665af141f3f359bba2909c4ada6677600ca65"}
Jul 30 02:30:59.606673 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.606524    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l" event={"ID":"81350d98-0997-440e-81cf-76ee7bd63f0c","Type":"ContainerStarted","Data":"91c4d94bfe0b0db35c46ab13437e06d41c6f243c33951157f9e950adeff603bd"}
Jul 30 02:30:59.606673 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.606581    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l" event={"ID":"81350d98-0997-440e-81cf-76ee7bd63f0c","Type":"ContainerStarted","Data":"9acfd33b6e16c4aaf93c65228aaac85513a8112e2d3c67d91fff9c1700aec1aa"}
Jul 30 02:30:59.607513 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.607480    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq" event={"ID":"228f5777-e4d6-44d3-8b93-44d57ba23858","Type":"ContainerStarted","Data":"9003429fc0ddc2a8fa447fe59033e3447f772ac26af2e3ce34c4cc9cbb043351"}
Jul 30 02:30:59.608598 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.608574    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6" event={"ID":"4d172ada-9f9f-42ed-aae6-72f940f3c832","Type":"ContainerStarted","Data":"5c8358169adf1205b6aeae241b3ca6640142318c8e2bb5cde0eab40e94750caa"}
Jul 30 02:30:59.637231 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:30:59.637148    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5jft6" podUID="e8d68db5-cc2c-417c-9027-b71ea9c67cee"
Jul 30 02:30:59.852599 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:30:59.852518    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp" podUID="7522d9db-ef6f-482d-9a3e-43ac524aa297" containerName="registry" containerID="cri-o://d420f1bc3236a363acc8038b2ed678b001bf412d75b25f9cd33aaa327010da6d" gracePeriod=30
Jul 30 02:31:00.106403 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.106379    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:31:00.159317 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.159283    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-bound-sa-token\") pod \"7522d9db-ef6f-482d-9a3e-43ac524aa297\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") "
Jul 30 02:31:00.159317 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.159329    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7522d9db-ef6f-482d-9a3e-43ac524aa297-installation-pull-secrets\") pod \"7522d9db-ef6f-482d-9a3e-43ac524aa297\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") "
Jul 30 02:31:00.159541 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.159369    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls\") pod \"7522d9db-ef6f-482d-9a3e-43ac524aa297\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") "
Jul 30 02:31:00.159541 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.159417    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7522d9db-ef6f-482d-9a3e-43ac524aa297-trusted-ca\") pod \"7522d9db-ef6f-482d-9a3e-43ac524aa297\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") "
Jul 30 02:31:00.159541 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.159455    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-certificates\") pod \"7522d9db-ef6f-482d-9a3e-43ac524aa297\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") "
Jul 30 02:31:00.159541 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.159505    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7522d9db-ef6f-482d-9a3e-43ac524aa297-image-registry-private-configuration\") pod \"7522d9db-ef6f-482d-9a3e-43ac524aa297\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") "
Jul 30 02:31:00.159772 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.159543    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj2ss\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-kube-api-access-jj2ss\") pod \"7522d9db-ef6f-482d-9a3e-43ac524aa297\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") "
Jul 30 02:31:00.159772 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.159612    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7522d9db-ef6f-482d-9a3e-43ac524aa297-ca-trust-extracted\") pod \"7522d9db-ef6f-482d-9a3e-43ac524aa297\" (UID: \"7522d9db-ef6f-482d-9a3e-43ac524aa297\") "
Jul 30 02:31:00.160308 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.160126    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7522d9db-ef6f-482d-9a3e-43ac524aa297" (UID: "7522d9db-ef6f-482d-9a3e-43ac524aa297"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 02:31:00.160308 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.160134    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7522d9db-ef6f-482d-9a3e-43ac524aa297-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7522d9db-ef6f-482d-9a3e-43ac524aa297" (UID: "7522d9db-ef6f-482d-9a3e-43ac524aa297"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 02:31:00.162626 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.162577    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7522d9db-ef6f-482d-9a3e-43ac524aa297-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7522d9db-ef6f-482d-9a3e-43ac524aa297" (UID: "7522d9db-ef6f-482d-9a3e-43ac524aa297"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 02:31:00.162897 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.162858    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7522d9db-ef6f-482d-9a3e-43ac524aa297-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7522d9db-ef6f-482d-9a3e-43ac524aa297" (UID: "7522d9db-ef6f-482d-9a3e-43ac524aa297"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 02:31:00.163393 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.163341    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7522d9db-ef6f-482d-9a3e-43ac524aa297" (UID: "7522d9db-ef6f-482d-9a3e-43ac524aa297"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 02:31:00.164611 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.164571    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-kube-api-access-jj2ss" (OuterVolumeSpecName: "kube-api-access-jj2ss") pod "7522d9db-ef6f-482d-9a3e-43ac524aa297" (UID: "7522d9db-ef6f-482d-9a3e-43ac524aa297"). InnerVolumeSpecName "kube-api-access-jj2ss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 02:31:00.165462 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.165431    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7522d9db-ef6f-482d-9a3e-43ac524aa297" (UID: "7522d9db-ef6f-482d-9a3e-43ac524aa297"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 02:31:00.171701 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.171676    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7522d9db-ef6f-482d-9a3e-43ac524aa297-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7522d9db-ef6f-482d-9a3e-43ac524aa297" (UID: "7522d9db-ef6f-482d-9a3e-43ac524aa297"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 02:31:00.261174 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.261140    2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-certificates\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:31:00.261347 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.261227    2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7522d9db-ef6f-482d-9a3e-43ac524aa297-image-registry-private-configuration\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:31:00.261347 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.261246    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj2ss\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-kube-api-access-jj2ss\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:31:00.261347 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.261262    2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7522d9db-ef6f-482d-9a3e-43ac524aa297-ca-trust-extracted\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:31:00.261347 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.261276    2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-bound-sa-token\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:31:00.261347 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.261290    2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7522d9db-ef6f-482d-9a3e-43ac524aa297-installation-pull-secrets\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:31:00.261347 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.261303    2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7522d9db-ef6f-482d-9a3e-43ac524aa297-registry-tls\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:31:00.261347 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.261316    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7522d9db-ef6f-482d-9a3e-43ac524aa297-trusted-ca\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:31:00.617195 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.617105    2554 generic.go:356] "Generic (PLEG): container finished" podID="7522d9db-ef6f-482d-9a3e-43ac524aa297" containerID="d420f1bc3236a363acc8038b2ed678b001bf412d75b25f9cd33aaa327010da6d" exitCode=0
Jul 30 02:31:00.617195 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.617148    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp"
Jul 30 02:31:00.617394 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.617217    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp" event={"ID":"7522d9db-ef6f-482d-9a3e-43ac524aa297","Type":"ContainerDied","Data":"d420f1bc3236a363acc8038b2ed678b001bf412d75b25f9cd33aaa327010da6d"}
Jul 30 02:31:00.617394 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.617304    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65d88b8fb6-86wmp" event={"ID":"7522d9db-ef6f-482d-9a3e-43ac524aa297","Type":"ContainerDied","Data":"91667be455678406b4bf7fd3bbf58dcb4bbb04b97a77e9cf5961ba8994527f55"}
Jul 30 02:31:00.617394 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.617334    2554 scope.go:117] "RemoveContainer" containerID="d420f1bc3236a363acc8038b2ed678b001bf412d75b25f9cd33aaa327010da6d"
Jul 30 02:31:00.621593 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.621355    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l" event={"ID":"81350d98-0997-440e-81cf-76ee7bd63f0c","Type":"ContainerStarted","Data":"941f6a70d67c47bd23ee801900ec01b2cccc9bf103b3b04060ffbda512dd1a27"}
Jul 30 02:31:00.621593 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.621430    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l" event={"ID":"81350d98-0997-440e-81cf-76ee7bd63f0c","Type":"ContainerStarted","Data":"e46b289b6168107104778c0872ecc9b893175df79d11a0fbfb852275190ba9df"}
Jul 30 02:31:00.621593 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.621475    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l" event={"ID":"81350d98-0997-440e-81cf-76ee7bd63f0c","Type":"ContainerStarted","Data":"d317fcc794021a810a94713450d7753b1b7efc844846b0a2d1a974b900e9ae86"}
Jul 30 02:31:00.621818 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.621605    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:31:00.626334 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.626313    2554 scope.go:117] "RemoveContainer" containerID="d420f1bc3236a363acc8038b2ed678b001bf412d75b25f9cd33aaa327010da6d"
Jul 30 02:31:00.626665 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:31:00.626631    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d420f1bc3236a363acc8038b2ed678b001bf412d75b25f9cd33aaa327010da6d\": container with ID starting with d420f1bc3236a363acc8038b2ed678b001bf412d75b25f9cd33aaa327010da6d not found: ID does not exist" containerID="d420f1bc3236a363acc8038b2ed678b001bf412d75b25f9cd33aaa327010da6d"
Jul 30 02:31:00.626740 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.626670    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d420f1bc3236a363acc8038b2ed678b001bf412d75b25f9cd33aaa327010da6d"} err="failed to get container status \"d420f1bc3236a363acc8038b2ed678b001bf412d75b25f9cd33aaa327010da6d\": rpc error: code = NotFound desc = could not find container \"d420f1bc3236a363acc8038b2ed678b001bf412d75b25f9cd33aaa327010da6d\": container with ID starting with d420f1bc3236a363acc8038b2ed678b001bf412d75b25f9cd33aaa327010da6d not found: ID does not exist"
Jul 30 02:31:00.642613 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.642561    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l" podStartSLOduration=1.709012012 podStartE2EDuration="4.642529527s" totalImagesPullingTime="2.933517515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:30:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:31:00.641233424 +0000 UTC m=+296.491546156" watchObservedRunningTime="2026-07-30 02:31:00.642529527 +0000 UTC m=+296.492842260"
Jul 30 02:31:00.655404 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.655377    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65d88b8fb6-86wmp"]
Jul 30 02:31:00.658525 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:00.658499    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65d88b8fb6-86wmp"]
Jul 30 02:31:02.577041 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:02.577020    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5bkd9"
Jul 30 02:31:02.641537 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:02.641509    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7522d9db-ef6f-482d-9a3e-43ac524aa297" path="/var/lib/kubelet/pods/7522d9db-ef6f-482d-9a3e-43ac524aa297/volumes"
Jul 30 02:31:02.641886 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:02.641847    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq" event={"ID":"228f5777-e4d6-44d3-8b93-44d57ba23858","Type":"ContainerStarted","Data":"3559f1c99db22aebe9bf6c27a732ea0d4719cba5f10993f35e64505e434c069c"}
Jul 30 02:31:02.642014 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:02.641905    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6" event={"ID":"4d172ada-9f9f-42ed-aae6-72f940f3c832","Type":"ContainerStarted","Data":"56dd5adcca0871fcb93c09de0983fcd7dd704b9b9cd223aeaeb4ebad9f3d0c14"}
Jul 30 02:31:02.642014 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:02.641942    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq"
Jul 30 02:31:02.642014 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:02.642004    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6" event={"ID":"4d172ada-9f9f-42ed-aae6-72f940f3c832","Type":"ContainerStarted","Data":"17988c19b898e22be5f67c9831e2189883cf49704946f63c4f3e387331511d75"}
Jul 30 02:31:02.644560 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:02.644525    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq"
Jul 30 02:31:02.653959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:02.653875    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4whwq" podStartSLOduration=2.5964888139999998 podStartE2EDuration="4.653856867s" totalImagesPullingTime="2.057368053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:31:02.65322866 +0000 UTC m=+298.503541384" watchObservedRunningTime="2026-07-30 02:31:02.653856867 +0000 UTC m=+298.504169600"
Jul 30 02:31:03.646131 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:03.646097    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6" event={"ID":"4d172ada-9f9f-42ed-aae6-72f940f3c832","Type":"ContainerStarted","Data":"f798fa1356d587d2374222987413bbd152ed2a666470b636e69a1594e2118023"}
Jul 30 02:31:03.669965 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:03.669922    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-57cd66d666-zc8n6" podStartSLOduration=2.550710556 podStartE2EDuration="5.669907344s" totalImagesPullingTime="3.119196788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:30:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:31:03.667797309 +0000 UTC m=+299.518110042" watchObservedRunningTime="2026-07-30 02:31:03.669907344 +0000 UTC m=+299.520220074"
Jul 30 02:31:04.502489 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:04.502464    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:31:04.502695 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:04.502677    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:31:04.506678 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:04.506657    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:31:04.506865 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:04.506848    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:31:04.514117 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:04.514099    2554 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 02:31:05.464215 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.464173    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-869476fbd-t66g4"]
Jul 30 02:31:05.498222 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.464608    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7522d9db-ef6f-482d-9a3e-43ac524aa297" containerName="registry"
Jul 30 02:31:05.498222 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.464630    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7522d9db-ef6f-482d-9a3e-43ac524aa297" containerName="registry"
Jul 30 02:31:05.498222 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.464707    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7522d9db-ef6f-482d-9a3e-43ac524aa297" containerName="registry"
Jul 30 02:31:05.506505 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.506482    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-869476fbd-t66g4"]
Jul 30 02:31:05.506639 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.506605    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.509505 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.509486    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 30 02:31:05.509809 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.509788    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7m4l6\""
Jul 30 02:31:05.509914 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.509865    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 30 02:31:05.509962 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.509916    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 30 02:31:05.510010 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.509968    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 30 02:31:05.510053 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.510043    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 30 02:31:05.510444 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.510427    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 30 02:31:05.510501 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.510443    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 30 02:31:05.606028 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.605997    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-oauth-serving-cert\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.606028 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.606032    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-serving-cert\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.606237 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.606061    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-oauth-config\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.606237 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.606139    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-service-ca\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.606237 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.606163    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2fpg\" (UniqueName: \"kubernetes.io/projected/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-kube-api-access-j2fpg\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.606237 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.606192    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-config\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.707179 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.707141    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-oauth-serving-cert\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.707179 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.707183    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-serving-cert\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.707409 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.707226    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-oauth-config\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.707409 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.707269    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-service-ca\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.707521 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.707399    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2fpg\" (UniqueName: \"kubernetes.io/projected/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-kube-api-access-j2fpg\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.707521 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.707461    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-config\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.708020 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.707997    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-oauth-serving-cert\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.708140 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.707997    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-service-ca\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.708140 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.708065    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-config\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.709697 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.709667    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-oauth-config\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.709815 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.709798    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-serving-cert\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.715106 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.715051    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2fpg\" (UniqueName: \"kubernetes.io/projected/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-kube-api-access-j2fpg\") pod \"console-869476fbd-t66g4\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") " pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.815768 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.815733    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:05.982604 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.982578    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-869476fbd-t66g4"]
Jul 30 02:31:05.984754 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:31:05.984730    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ecdffa7_998c_4c80_89dd_cf6041a8ff72.slice/crio-c907a3ba2ec7f94dff28708e31bb72e6c12aaa622b4133bab4c71c74f05f64d1 WatchSource:0}: Error finding container c907a3ba2ec7f94dff28708e31bb72e6c12aaa622b4133bab4c71c74f05f64d1: Status 404 returned error can't find the container with id c907a3ba2ec7f94dff28708e31bb72e6c12aaa622b4133bab4c71c74f05f64d1
Jul 30 02:31:05.986814 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:05.986797    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 02:31:06.631499 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:06.631469    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f7bdcbd6f-6pz8l"
Jul 30 02:31:06.657438 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:06.657408    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869476fbd-t66g4" event={"ID":"0ecdffa7-998c-4c80-89dd-cf6041a8ff72","Type":"ContainerStarted","Data":"c907a3ba2ec7f94dff28708e31bb72e6c12aaa622b4133bab4c71c74f05f64d1"}
Jul 30 02:31:09.671497 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:09.671457    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869476fbd-t66g4" event={"ID":"0ecdffa7-998c-4c80-89dd-cf6041a8ff72","Type":"ContainerStarted","Data":"2ee0c9a3b1b7374c5a66e3eedb8b4c146a6f64796749937f6856f683ba39f588"}
Jul 30 02:31:09.688027 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:09.687974    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-869476fbd-t66g4" podStartSLOduration=1.14804804 podStartE2EDuration="4.687956971s" totalImagesPullingTime="3.539908931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:31:09.687749668 +0000 UTC m=+305.538062400" watchObservedRunningTime="2026-07-30 02:31:09.687956971 +0000 UTC m=+305.538269701"
Jul 30 02:31:13.635257 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:13.635205    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:31:13.951875 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:13.951800    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5df554cc84-crfpr"]
Jul 30 02:31:13.954469 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:13.954452    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:13.963591 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:13.963569    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 30 02:31:13.966562 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:13.966532    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5df554cc84-crfpr"]
Jul 30 02:31:14.079912 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.079878    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-oauth-serving-cert\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.079912 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.079914    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-console-config\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.080107 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.079938    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/515df148-d59b-42d0-bf36-427a5e6502c5-console-oauth-config\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.080107 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.080008    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46l2j\" (UniqueName: \"kubernetes.io/projected/515df148-d59b-42d0-bf36-427a5e6502c5-kube-api-access-46l2j\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.080107 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.080068    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-trusted-ca-bundle\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.080203 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.080104    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/515df148-d59b-42d0-bf36-427a5e6502c5-console-serving-cert\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.080203 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.080186    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-service-ca\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.180899 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.180867    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-service-ca\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.180899 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.180903    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-oauth-serving-cert\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.181130 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.180926    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-console-config\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.181130 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.181113    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/515df148-d59b-42d0-bf36-427a5e6502c5-console-oauth-config\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.181235 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.181149    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46l2j\" (UniqueName: \"kubernetes.io/projected/515df148-d59b-42d0-bf36-427a5e6502c5-kube-api-access-46l2j\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.181235 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.181174    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-trusted-ca-bundle\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.181235 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.181200    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/515df148-d59b-42d0-bf36-427a5e6502c5-console-serving-cert\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.181651 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.181631    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-oauth-serving-cert\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.181762 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.181665    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-console-config\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.181804 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.181787    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-service-ca\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.182009 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.181987    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-trusted-ca-bundle\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.183485 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.183467    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/515df148-d59b-42d0-bf36-427a5e6502c5-console-oauth-config\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.183688 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.183670    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/515df148-d59b-42d0-bf36-427a5e6502c5-console-serving-cert\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.191678 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.191651    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46l2j\" (UniqueName: \"kubernetes.io/projected/515df148-d59b-42d0-bf36-427a5e6502c5-kube-api-access-46l2j\") pod \"console-5df554cc84-crfpr\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") " pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.263745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.263716    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:14.411720 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.411696    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5df554cc84-crfpr"]
Jul 30 02:31:14.413601 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:31:14.413573    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515df148_d59b_42d0_bf36_427a5e6502c5.slice/crio-394f9776d8b20e15879597afb69f42bc5bec292c84b6e2fda8361584f3851d99 WatchSource:0}: Error finding container 394f9776d8b20e15879597afb69f42bc5bec292c84b6e2fda8361584f3851d99: Status 404 returned error can't find the container with id 394f9776d8b20e15879597afb69f42bc5bec292c84b6e2fda8361584f3851d99
Jul 30 02:31:14.690204 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.690129    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df554cc84-crfpr" event={"ID":"515df148-d59b-42d0-bf36-427a5e6502c5","Type":"ContainerStarted","Data":"bf1dde6cc5c3a878fb2c908f571f5a89f9518526a1f94ed83048d7939bcb99b4"}
Jul 30 02:31:14.690204 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.690173    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df554cc84-crfpr" event={"ID":"515df148-d59b-42d0-bf36-427a5e6502c5","Type":"ContainerStarted","Data":"394f9776d8b20e15879597afb69f42bc5bec292c84b6e2fda8361584f3851d99"}
Jul 30 02:31:14.708967 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:14.708921    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5df554cc84-crfpr" podStartSLOduration=1.708905599 podStartE2EDuration="1.708905599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:31:14.707891122 +0000 UTC m=+310.558203854" watchObservedRunningTime="2026-07-30 02:31:14.708905599 +0000 UTC m=+310.559218330"
Jul 30 02:31:15.815883 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:15.815851    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:15.816299 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:15.815912    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:15.820619 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:15.820596    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:16.702353 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:16.702322    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:24.264182 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:24.264154    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:24.264537 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:24.264228    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:24.269267 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:24.269248    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:24.729414 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:24.729376    2554 generic.go:356] "Generic (PLEG): container finished" podID="c3c7b535-3fd2-482e-a3db-63789390305b" containerID="48e8461ce60cbb3fe5373cfddf172e25f36e86eb3a73d50ecd4a8f0c632a36fc" exitCode=0
Jul 30 02:31:24.729620 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:24.729449    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-97nvg" event={"ID":"c3c7b535-3fd2-482e-a3db-63789390305b","Type":"ContainerDied","Data":"48e8461ce60cbb3fe5373cfddf172e25f36e86eb3a73d50ecd4a8f0c632a36fc"}
Jul 30 02:31:24.730038 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:24.730010    2554 scope.go:117] "RemoveContainer" containerID="48e8461ce60cbb3fe5373cfddf172e25f36e86eb3a73d50ecd4a8f0c632a36fc"
Jul 30 02:31:24.733567 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:24.733525    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:31:24.795841 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:24.795817    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-869476fbd-t66g4"]
Jul 30 02:31:25.734623 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:25.734583    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-97nvg" event={"ID":"c3c7b535-3fd2-482e-a3db-63789390305b","Type":"ContainerStarted","Data":"3c3086b742383b53dc5ac5f9c6f9be6cbd3f27ccdb819f1bf94d806bd1c9207f"}
Jul 30 02:31:44.804384 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:44.804351    2554 generic.go:356] "Generic (PLEG): container finished" podID="28485e56-40a8-40bf-9497-53bf67edbc96" containerID="da199a04dcd3099491956466fa0aa456fe53b9a7ace6cf919836e41436102bea" exitCode=0
Jul 30 02:31:44.804804 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:44.804402    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d" event={"ID":"28485e56-40a8-40bf-9497-53bf67edbc96","Type":"ContainerDied","Data":"da199a04dcd3099491956466fa0aa456fe53b9a7ace6cf919836e41436102bea"}
Jul 30 02:31:44.804804 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:44.804693    2554 scope.go:117] "RemoveContainer" containerID="da199a04dcd3099491956466fa0aa456fe53b9a7ace6cf919836e41436102bea"
Jul 30 02:31:45.809294 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:45.809261    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d" event={"ID":"28485e56-40a8-40bf-9497-53bf67edbc96","Type":"ContainerStarted","Data":"e2cc0f7a5c98e621acb467c8097406e7d789eea9d7e88fc7a0f2be1174eb2902"}
Jul 30 02:31:49.820806 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:49.820752    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-869476fbd-t66g4" podUID="0ecdffa7-998c-4c80-89dd-cf6041a8ff72" containerName="console" containerID="cri-o://2ee0c9a3b1b7374c5a66e3eedb8b4c146a6f64796749937f6856f683ba39f588" gracePeriod=15
Jul 30 02:31:50.059865 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.059844    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:50.068049 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.068018    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-service-ca\") pod \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") "
Jul 30 02:31:50.068165 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.068075    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-oauth-config\") pod \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") "
Jul 30 02:31:50.068261 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.068245    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-serving-cert\") pod \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") "
Jul 30 02:31:50.068327 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.068278    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-config\") pod \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") "
Jul 30 02:31:50.068327 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.068319    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-oauth-serving-cert\") pod \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") "
Jul 30 02:31:50.068422 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.068339    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-service-ca" (OuterVolumeSpecName: "service-ca") pod "0ecdffa7-998c-4c80-89dd-cf6041a8ff72" (UID: "0ecdffa7-998c-4c80-89dd-cf6041a8ff72"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 02:31:50.068422 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.068353    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2fpg\" (UniqueName: \"kubernetes.io/projected/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-kube-api-access-j2fpg\") pod \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\" (UID: \"0ecdffa7-998c-4c80-89dd-cf6041a8ff72\") "
Jul 30 02:31:50.068662 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.068643    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-service-ca\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:31:50.068762 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.068658    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-config" (OuterVolumeSpecName: "console-config") pod "0ecdffa7-998c-4c80-89dd-cf6041a8ff72" (UID: "0ecdffa7-998c-4c80-89dd-cf6041a8ff72"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 02:31:50.068762 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.068714    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0ecdffa7-998c-4c80-89dd-cf6041a8ff72" (UID: "0ecdffa7-998c-4c80-89dd-cf6041a8ff72"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 02:31:50.070179 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.070158    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0ecdffa7-998c-4c80-89dd-cf6041a8ff72" (UID: "0ecdffa7-998c-4c80-89dd-cf6041a8ff72"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 02:31:50.070297 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.070277    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0ecdffa7-998c-4c80-89dd-cf6041a8ff72" (UID: "0ecdffa7-998c-4c80-89dd-cf6041a8ff72"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 02:31:50.070369 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.070300    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-kube-api-access-j2fpg" (OuterVolumeSpecName: "kube-api-access-j2fpg") pod "0ecdffa7-998c-4c80-89dd-cf6041a8ff72" (UID: "0ecdffa7-998c-4c80-89dd-cf6041a8ff72"). InnerVolumeSpecName "kube-api-access-j2fpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 02:31:50.169879 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.169847    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-oauth-config\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:31:50.169879 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.169873    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-serving-cert\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:31:50.169879 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.169883    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-console-config\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:31:50.170075 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.169892    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-oauth-serving-cert\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:31:50.170075 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.169902    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2fpg\" (UniqueName: \"kubernetes.io/projected/0ecdffa7-998c-4c80-89dd-cf6041a8ff72-kube-api-access-j2fpg\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:31:50.828905 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.828867    2554 generic.go:356] "Generic (PLEG): container finished" podID="0ecdffa7-998c-4c80-89dd-cf6041a8ff72" containerID="2ee0c9a3b1b7374c5a66e3eedb8b4c146a6f64796749937f6856f683ba39f588" exitCode=0
Jul 30 02:31:50.829289 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.828912    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869476fbd-t66g4"
Jul 30 02:31:50.829289 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.828910    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869476fbd-t66g4" event={"ID":"0ecdffa7-998c-4c80-89dd-cf6041a8ff72","Type":"ContainerDied","Data":"2ee0c9a3b1b7374c5a66e3eedb8b4c146a6f64796749937f6856f683ba39f588"}
Jul 30 02:31:50.829289 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.828966    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869476fbd-t66g4" event={"ID":"0ecdffa7-998c-4c80-89dd-cf6041a8ff72","Type":"ContainerDied","Data":"c907a3ba2ec7f94dff28708e31bb72e6c12aaa622b4133bab4c71c74f05f64d1"}
Jul 30 02:31:50.829289 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.828991    2554 scope.go:117] "RemoveContainer" containerID="2ee0c9a3b1b7374c5a66e3eedb8b4c146a6f64796749937f6856f683ba39f588"
Jul 30 02:31:50.837045 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.837028    2554 scope.go:117] "RemoveContainer" containerID="2ee0c9a3b1b7374c5a66e3eedb8b4c146a6f64796749937f6856f683ba39f588"
Jul 30 02:31:50.837302 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:31:50.837283    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ee0c9a3b1b7374c5a66e3eedb8b4c146a6f64796749937f6856f683ba39f588\": container with ID starting with 2ee0c9a3b1b7374c5a66e3eedb8b4c146a6f64796749937f6856f683ba39f588 not found: ID does not exist" containerID="2ee0c9a3b1b7374c5a66e3eedb8b4c146a6f64796749937f6856f683ba39f588"
Jul 30 02:31:50.837361 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.837312    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ee0c9a3b1b7374c5a66e3eedb8b4c146a6f64796749937f6856f683ba39f588"} err="failed to get container status \"2ee0c9a3b1b7374c5a66e3eedb8b4c146a6f64796749937f6856f683ba39f588\": rpc error: code = NotFound desc = could not find container \"2ee0c9a3b1b7374c5a66e3eedb8b4c146a6f64796749937f6856f683ba39f588\": container with ID starting with 2ee0c9a3b1b7374c5a66e3eedb8b4c146a6f64796749937f6856f683ba39f588 not found: ID does not exist"
Jul 30 02:31:50.844722 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.844699    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-869476fbd-t66g4"]
Jul 30 02:31:50.847798 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:50.847780    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-869476fbd-t66g4"]
Jul 30 02:31:52.639876 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:31:52.639841    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ecdffa7-998c-4c80-89dd-cf6041a8ff72" path="/var/lib/kubelet/pods/0ecdffa7-998c-4c80-89dd-cf6041a8ff72/volumes"
Jul 30 02:32:17.587698 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:17.587664    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:32:17.589942 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:17.589919    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8d68db5-cc2c-417c-9027-b71ea9c67cee-metrics-certs\") pod \"network-metrics-daemon-5jft6\" (UID: \"e8d68db5-cc2c-417c-9027-b71ea9c67cee\") " pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:32:17.839290 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:17.839203    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vvjjn\""
Jul 30 02:32:17.847382 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:17.847363    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jft6"
Jul 30 02:32:17.974398 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:17.974374    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5jft6"]
Jul 30 02:32:17.977026 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:32:17.977001    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d68db5_cc2c_417c_9027_b71ea9c67cee.slice/crio-de125b957150a15853b8b215c7894de4e67c39f1b21d78fdba40ef151d2effe0 WatchSource:0}: Error finding container de125b957150a15853b8b215c7894de4e67c39f1b21d78fdba40ef151d2effe0: Status 404 returned error can't find the container with id de125b957150a15853b8b215c7894de4e67c39f1b21d78fdba40ef151d2effe0
Jul 30 02:32:18.934497 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:18.934469    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5jft6" event={"ID":"e8d68db5-cc2c-417c-9027-b71ea9c67cee","Type":"ContainerStarted","Data":"de125b957150a15853b8b215c7894de4e67c39f1b21d78fdba40ef151d2effe0"}
Jul 30 02:32:19.939668 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:19.939621    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5jft6" event={"ID":"e8d68db5-cc2c-417c-9027-b71ea9c67cee","Type":"ContainerStarted","Data":"d4c1dbaa7edb7281b953d330e5132b389e94093fa7c7e333f497d21a5dd4d079"}
Jul 30 02:32:19.940046 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:19.939682    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5jft6" event={"ID":"e8d68db5-cc2c-417c-9027-b71ea9c67cee","Type":"ContainerStarted","Data":"f418cf4b1e482c3d3e16de046830de90a3cf356c81f39e424a94e67779bbbe66"}
Jul 30 02:32:19.959506 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:19.959459    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5jft6" podStartSLOduration=374.070133105 podStartE2EDuration="6m14.959443967s" totalImagesPullingTime="889.310862ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:32:19.957634937 +0000 UTC m=+375.807947669" watchObservedRunningTime="2026-07-30 02:32:19.959443967 +0000 UTC m=+375.809756697"
Jul 30 02:32:31.183112 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.183073    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b597fb446-5dgnj"]
Jul 30 02:32:31.183697 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.183522    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ecdffa7-998c-4c80-89dd-cf6041a8ff72" containerName="console"
Jul 30 02:32:31.183697 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.183538    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ecdffa7-998c-4c80-89dd-cf6041a8ff72" containerName="console"
Jul 30 02:32:31.183697 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.183615    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ecdffa7-998c-4c80-89dd-cf6041a8ff72" containerName="console"
Jul 30 02:32:31.187209 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.187189    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.199416 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.199392    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b597fb446-5dgnj"]
Jul 30 02:32:31.300031 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.300002    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-config\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.300155 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.300046    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-serving-cert\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.300155 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.300063    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-service-ca\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.300155 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.300088    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-oauth-serving-cert\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.300155 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.300132    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-trusted-ca-bundle\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.300155 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.300152    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq7hl\" (UniqueName: \"kubernetes.io/projected/63957aa8-c9c9-43f5-ac48-98158f3f332c-kube-api-access-qq7hl\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.300318 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.300181    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-oauth-config\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.400750 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.400720    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-trusted-ca-bundle\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.400750 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.400752    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7hl\" (UniqueName: \"kubernetes.io/projected/63957aa8-c9c9-43f5-ac48-98158f3f332c-kube-api-access-qq7hl\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.400925 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.400780    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-oauth-config\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.400925 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.400806    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-config\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.400925 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.400827    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-serving-cert\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.400925 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.400842    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-service-ca\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.400925 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.400864    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-oauth-serving-cert\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.401657 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.401633    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-service-ca\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.401747 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.401640    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-oauth-serving-cert\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.401747 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.401643    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-config\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.402168 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.402142    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-trusted-ca-bundle\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.403136 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.403115    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-serving-cert\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.403338 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.403322    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-oauth-config\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.408990 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.408970    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq7hl\" (UniqueName: \"kubernetes.io/projected/63957aa8-c9c9-43f5-ac48-98158f3f332c-kube-api-access-qq7hl\") pod \"console-6b597fb446-5dgnj\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") " pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.497777 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.497751    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:31.625640 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.625614    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b597fb446-5dgnj"]
Jul 30 02:32:31.628331 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:32:31.628302    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63957aa8_c9c9_43f5_ac48_98158f3f332c.slice/crio-913a006305fa8ac28c90c57f42804490a54a2181469a90afd0881d761b0b99b8 WatchSource:0}: Error finding container 913a006305fa8ac28c90c57f42804490a54a2181469a90afd0881d761b0b99b8: Status 404 returned error can't find the container with id 913a006305fa8ac28c90c57f42804490a54a2181469a90afd0881d761b0b99b8
Jul 30 02:32:31.985992 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.985911    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b597fb446-5dgnj" event={"ID":"63957aa8-c9c9-43f5-ac48-98158f3f332c","Type":"ContainerStarted","Data":"3e7c68184b917b86aec77600cb8a70962944796d265c51ce0eb0f7167aa695f2"}
Jul 30 02:32:31.985992 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:31.985956    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b597fb446-5dgnj" event={"ID":"63957aa8-c9c9-43f5-ac48-98158f3f332c","Type":"ContainerStarted","Data":"913a006305fa8ac28c90c57f42804490a54a2181469a90afd0881d761b0b99b8"}
Jul 30 02:32:32.008682 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:32.008634    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b597fb446-5dgnj" podStartSLOduration=1.008618217 podStartE2EDuration="1.008618217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:32:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:32:32.007737891 +0000 UTC m=+387.858050623" watchObservedRunningTime="2026-07-30 02:32:32.008618217 +0000 UTC m=+387.858931031"
Jul 30 02:32:41.497861 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:41.497833    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:41.498262 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:41.497948    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:41.502893 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:41.502871    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:42.026001 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:42.025974    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:32:42.073970 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:32:42.073936    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5df554cc84-crfpr"]
Jul 30 02:33:07.098950 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.098888    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5df554cc84-crfpr" podUID="515df148-d59b-42d0-bf36-427a5e6502c5" containerName="console" containerID="cri-o://bf1dde6cc5c3a878fb2c908f571f5a89f9518526a1f94ed83048d7939bcb99b4" gracePeriod=15
Jul 30 02:33:07.333827 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.333806    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:33:07.370215 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.370156    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-console-config\") pod \"515df148-d59b-42d0-bf36-427a5e6502c5\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") "
Jul 30 02:33:07.370215 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.370205    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/515df148-d59b-42d0-bf36-427a5e6502c5-console-serving-cert\") pod \"515df148-d59b-42d0-bf36-427a5e6502c5\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") "
Jul 30 02:33:07.370395 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.370231    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-service-ca\") pod \"515df148-d59b-42d0-bf36-427a5e6502c5\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") "
Jul 30 02:33:07.370395 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.370264    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/515df148-d59b-42d0-bf36-427a5e6502c5-console-oauth-config\") pod \"515df148-d59b-42d0-bf36-427a5e6502c5\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") "
Jul 30 02:33:07.370395 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.370290    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-trusted-ca-bundle\") pod \"515df148-d59b-42d0-bf36-427a5e6502c5\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") "
Jul 30 02:33:07.370395 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.370313    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-oauth-serving-cert\") pod \"515df148-d59b-42d0-bf36-427a5e6502c5\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") "
Jul 30 02:33:07.370395 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.370336    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46l2j\" (UniqueName: \"kubernetes.io/projected/515df148-d59b-42d0-bf36-427a5e6502c5-kube-api-access-46l2j\") pod \"515df148-d59b-42d0-bf36-427a5e6502c5\" (UID: \"515df148-d59b-42d0-bf36-427a5e6502c5\") "
Jul 30 02:33:07.370672 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.370506    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-console-config" (OuterVolumeSpecName: "console-config") pod "515df148-d59b-42d0-bf36-427a5e6502c5" (UID: "515df148-d59b-42d0-bf36-427a5e6502c5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 02:33:07.370744 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.370717    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "515df148-d59b-42d0-bf36-427a5e6502c5" (UID: "515df148-d59b-42d0-bf36-427a5e6502c5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 02:33:07.370744 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.370733    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-console-config\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:33:07.370838 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.370729    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-service-ca" (OuterVolumeSpecName: "service-ca") pod "515df148-d59b-42d0-bf36-427a5e6502c5" (UID: "515df148-d59b-42d0-bf36-427a5e6502c5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 02:33:07.370838 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.370740    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "515df148-d59b-42d0-bf36-427a5e6502c5" (UID: "515df148-d59b-42d0-bf36-427a5e6502c5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 02:33:07.372364 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.372345    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/515df148-d59b-42d0-bf36-427a5e6502c5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "515df148-d59b-42d0-bf36-427a5e6502c5" (UID: "515df148-d59b-42d0-bf36-427a5e6502c5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 02:33:07.372455 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.372364    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/515df148-d59b-42d0-bf36-427a5e6502c5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "515df148-d59b-42d0-bf36-427a5e6502c5" (UID: "515df148-d59b-42d0-bf36-427a5e6502c5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 02:33:07.372455 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.372441    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/515df148-d59b-42d0-bf36-427a5e6502c5-kube-api-access-46l2j" (OuterVolumeSpecName: "kube-api-access-46l2j") pod "515df148-d59b-42d0-bf36-427a5e6502c5" (UID: "515df148-d59b-42d0-bf36-427a5e6502c5"). InnerVolumeSpecName "kube-api-access-46l2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 02:33:07.471852 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.471830    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/515df148-d59b-42d0-bf36-427a5e6502c5-console-serving-cert\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:33:07.471852 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.471851    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-service-ca\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:33:07.472029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.471861    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/515df148-d59b-42d0-bf36-427a5e6502c5-console-oauth-config\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:33:07.472029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.471870    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-trusted-ca-bundle\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:33:07.472029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.471878    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/515df148-d59b-42d0-bf36-427a5e6502c5-oauth-serving-cert\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:33:07.472029 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:07.471886    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46l2j\" (UniqueName: \"kubernetes.io/projected/515df148-d59b-42d0-bf36-427a5e6502c5-kube-api-access-46l2j\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:33:08.117845 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:08.117811    2554 generic.go:356] "Generic (PLEG): container finished" podID="515df148-d59b-42d0-bf36-427a5e6502c5" containerID="bf1dde6cc5c3a878fb2c908f571f5a89f9518526a1f94ed83048d7939bcb99b4" exitCode=0
Jul 30 02:33:08.118241 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:08.117862    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df554cc84-crfpr"
Jul 30 02:33:08.118241 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:08.117901    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df554cc84-crfpr" event={"ID":"515df148-d59b-42d0-bf36-427a5e6502c5","Type":"ContainerDied","Data":"bf1dde6cc5c3a878fb2c908f571f5a89f9518526a1f94ed83048d7939bcb99b4"}
Jul 30 02:33:08.118241 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:08.117953    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df554cc84-crfpr" event={"ID":"515df148-d59b-42d0-bf36-427a5e6502c5","Type":"ContainerDied","Data":"394f9776d8b20e15879597afb69f42bc5bec292c84b6e2fda8361584f3851d99"}
Jul 30 02:33:08.118241 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:08.117973    2554 scope.go:117] "RemoveContainer" containerID="bf1dde6cc5c3a878fb2c908f571f5a89f9518526a1f94ed83048d7939bcb99b4"
Jul 30 02:33:08.126899 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:08.126878    2554 scope.go:117] "RemoveContainer" containerID="bf1dde6cc5c3a878fb2c908f571f5a89f9518526a1f94ed83048d7939bcb99b4"
Jul 30 02:33:08.127152 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:33:08.127134    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf1dde6cc5c3a878fb2c908f571f5a89f9518526a1f94ed83048d7939bcb99b4\": container with ID starting with bf1dde6cc5c3a878fb2c908f571f5a89f9518526a1f94ed83048d7939bcb99b4 not found: ID does not exist" containerID="bf1dde6cc5c3a878fb2c908f571f5a89f9518526a1f94ed83048d7939bcb99b4"
Jul 30 02:33:08.127216 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:08.127161    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf1dde6cc5c3a878fb2c908f571f5a89f9518526a1f94ed83048d7939bcb99b4"} err="failed to get container status \"bf1dde6cc5c3a878fb2c908f571f5a89f9518526a1f94ed83048d7939bcb99b4\": rpc error: code = NotFound desc = could not find container \"bf1dde6cc5c3a878fb2c908f571f5a89f9518526a1f94ed83048d7939bcb99b4\": container with ID starting with bf1dde6cc5c3a878fb2c908f571f5a89f9518526a1f94ed83048d7939bcb99b4 not found: ID does not exist"
Jul 30 02:33:08.138041 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:08.138020    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5df554cc84-crfpr"]
Jul 30 02:33:08.141758 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:08.141739    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5df554cc84-crfpr"]
Jul 30 02:33:08.639684 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:08.639658    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="515df148-d59b-42d0-bf36-427a5e6502c5" path="/var/lib/kubelet/pods/515df148-d59b-42d0-bf36-427a5e6502c5/volumes"
Jul 30 02:33:43.346301 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.346264    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwk2t"]
Jul 30 02:33:43.346762 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.346567    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="515df148-d59b-42d0-bf36-427a5e6502c5" containerName="console"
Jul 30 02:33:43.346762 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.346579    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="515df148-d59b-42d0-bf36-427a5e6502c5" containerName="console"
Jul 30 02:33:43.346762 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.346639    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="515df148-d59b-42d0-bf36-427a5e6502c5" containerName="console"
Jul 30 02:33:43.349473 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.349459    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwk2t"
Jul 30 02:33:43.352364 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.352343    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-d4lvq\""
Jul 30 02:33:43.352364 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.352358    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 30 02:33:43.352578 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.352408    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 30 02:33:43.355506 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.355482    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwk2t"]
Jul 30 02:33:43.426302 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.426274    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00496c82-9eed-40c5-a5c7-465a68aeadd5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwk2t\" (UID: \"00496c82-9eed-40c5-a5c7-465a68aeadd5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwk2t"
Jul 30 02:33:43.426432 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.426319    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxbqn\" (UniqueName: \"kubernetes.io/projected/00496c82-9eed-40c5-a5c7-465a68aeadd5-kube-api-access-jxbqn\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwk2t\" (UID: \"00496c82-9eed-40c5-a5c7-465a68aeadd5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwk2t"
Jul 30 02:33:43.526882 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.526845    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00496c82-9eed-40c5-a5c7-465a68aeadd5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwk2t\" (UID: \"00496c82-9eed-40c5-a5c7-465a68aeadd5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwk2t"
Jul 30 02:33:43.527033 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.526902    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxbqn\" (UniqueName: \"kubernetes.io/projected/00496c82-9eed-40c5-a5c7-465a68aeadd5-kube-api-access-jxbqn\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwk2t\" (UID: \"00496c82-9eed-40c5-a5c7-465a68aeadd5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwk2t"
Jul 30 02:33:43.527255 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.527237    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00496c82-9eed-40c5-a5c7-465a68aeadd5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwk2t\" (UID: \"00496c82-9eed-40c5-a5c7-465a68aeadd5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwk2t"
Jul 30 02:33:43.534968 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.534945    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxbqn\" (UniqueName: \"kubernetes.io/projected/00496c82-9eed-40c5-a5c7-465a68aeadd5-kube-api-access-jxbqn\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwk2t\" (UID: \"00496c82-9eed-40c5-a5c7-465a68aeadd5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwk2t"
Jul 30 02:33:43.659505 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.659432    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwk2t"
Jul 30 02:33:43.785224 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:43.785192    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwk2t"]
Jul 30 02:33:43.789093 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:33:43.789063    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00496c82_9eed_40c5_a5c7_465a68aeadd5.slice/crio-726c417944fa9f65e1db10d58bbe7fa11d2fd26b4e28f80033658de524f06c98 WatchSource:0}: Error finding container 726c417944fa9f65e1db10d58bbe7fa11d2fd26b4e28f80033658de524f06c98: Status 404 returned error can't find the container with id 726c417944fa9f65e1db10d58bbe7fa11d2fd26b4e28f80033658de524f06c98
Jul 30 02:33:44.249352 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:44.249320    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwk2t" event={"ID":"00496c82-9eed-40c5-a5c7-465a68aeadd5","Type":"ContainerStarted","Data":"726c417944fa9f65e1db10d58bbe7fa11d2fd26b4e28f80033658de524f06c98"}
Jul 30 02:33:47.267618 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:47.267580    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwk2t" event={"ID":"00496c82-9eed-40c5-a5c7-465a68aeadd5","Type":"ContainerStarted","Data":"90590824251ae568ef3c93de1d4f1970b1b6b433e2a09164de91fb6f4705e2fc"}
Jul 30 02:33:47.288864 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:47.288798    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwk2t" podStartSLOduration=1.174159885 podStartE2EDuration="4.288778722s" totalImagesPullingTime="3.114618837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:33:47.287608223 +0000 UTC m=+463.137920955" watchObservedRunningTime="2026-07-30 02:33:47.288778722 +0000 UTC m=+463.139091466"
Jul 30 02:33:47.928951 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:47.928916    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dtpqg"]
Jul 30 02:33:47.932227 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:47.932201    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dtpqg"
Jul 30 02:33:47.934663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:47.934638    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lpx9v\""
Jul 30 02:33:47.935507 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:47.935491    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 30 02:33:47.935597 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:47.935491    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 30 02:33:47.946065 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:47.946043    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dtpqg"]
Jul 30 02:33:48.067710 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:48.067675    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/638c03e2-bf9a-4a36-acd6-71557b508510-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dtpqg\" (UID: \"638c03e2-bf9a-4a36-acd6-71557b508510\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dtpqg"
Jul 30 02:33:48.067710 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:48.067709    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9qth\" (UniqueName: \"kubernetes.io/projected/638c03e2-bf9a-4a36-acd6-71557b508510-kube-api-access-b9qth\") pod \"cert-manager-webhook-6486ffd997-dtpqg\" (UID: \"638c03e2-bf9a-4a36-acd6-71557b508510\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dtpqg"
Jul 30 02:33:48.168970 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:48.168937    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/638c03e2-bf9a-4a36-acd6-71557b508510-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dtpqg\" (UID: \"638c03e2-bf9a-4a36-acd6-71557b508510\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dtpqg"
Jul 30 02:33:48.168970 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:48.168969    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9qth\" (UniqueName: \"kubernetes.io/projected/638c03e2-bf9a-4a36-acd6-71557b508510-kube-api-access-b9qth\") pod \"cert-manager-webhook-6486ffd997-dtpqg\" (UID: \"638c03e2-bf9a-4a36-acd6-71557b508510\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dtpqg"
Jul 30 02:33:48.184857 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:48.184795    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9qth\" (UniqueName: \"kubernetes.io/projected/638c03e2-bf9a-4a36-acd6-71557b508510-kube-api-access-b9qth\") pod \"cert-manager-webhook-6486ffd997-dtpqg\" (UID: \"638c03e2-bf9a-4a36-acd6-71557b508510\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dtpqg"
Jul 30 02:33:48.188214 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:48.188192    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/638c03e2-bf9a-4a36-acd6-71557b508510-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dtpqg\" (UID: \"638c03e2-bf9a-4a36-acd6-71557b508510\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dtpqg"
Jul 30 02:33:48.241304 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:48.241266    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dtpqg"
Jul 30 02:33:48.366457 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:48.366434    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dtpqg"]
Jul 30 02:33:48.368846 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:33:48.368821    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod638c03e2_bf9a_4a36_acd6_71557b508510.slice/crio-127b13b6f95627d95518a9826214040eb6ceb207795f6c8daf51a295916b405c WatchSource:0}: Error finding container 127b13b6f95627d95518a9826214040eb6ceb207795f6c8daf51a295916b405c: Status 404 returned error can't find the container with id 127b13b6f95627d95518a9826214040eb6ceb207795f6c8daf51a295916b405c
Jul 30 02:33:49.279175 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:49.279141    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dtpqg" event={"ID":"638c03e2-bf9a-4a36-acd6-71557b508510","Type":"ContainerStarted","Data":"127b13b6f95627d95518a9826214040eb6ceb207795f6c8daf51a295916b405c"}
Jul 30 02:33:52.293871 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:52.293836    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dtpqg" event={"ID":"638c03e2-bf9a-4a36-acd6-71557b508510","Type":"ContainerStarted","Data":"2e2ddaa598847966280a0d9517d9eeb29381279fe67268cc5224f0ac53e99e41"}
Jul 30 02:33:52.294226 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:52.293966    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dtpqg"
Jul 30 02:33:52.313684 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:52.313641    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-dtpqg" podStartSLOduration=2.23855883 podStartE2EDuration="5.313627751s" totalImagesPullingTime="3.075068921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:33:52.313064541 +0000 UTC m=+468.163377292" watchObservedRunningTime="2026-07-30 02:33:52.313627751 +0000 UTC m=+468.163940482"
Jul 30 02:33:58.300621 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:33:58.300592    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dtpqg"
Jul 30 02:34:24.242742 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.242703    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"]
Jul 30 02:34:24.248650 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.248627    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.251526 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.251497    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fv95l\""
Jul 30 02:34:24.251674 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.251539    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 02:34:24.251674 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.251576    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 02:34:24.254622 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.254601    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 02:34:24.255262 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.255052    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 02:34:24.259861 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.259839    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"]
Jul 30 02:34:24.342599 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.342562    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93abe02a-54f1-4adf-bee4-f10aad7e1f03-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.342775 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.342623    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93abe02a-54f1-4adf-bee4-f10aad7e1f03-manifests\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.342775 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.342655    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93abe02a-54f1-4adf-bee4-f10aad7e1f03-tmp\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.342775 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.342695    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93abe02a-54f1-4adf-bee4-f10aad7e1f03-webhook-cert\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.342775 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.342731    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmztz\" (UniqueName: \"kubernetes.io/projected/93abe02a-54f1-4adf-bee4-f10aad7e1f03-kube-api-access-rmztz\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.443785 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.443756    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93abe02a-54f1-4adf-bee4-f10aad7e1f03-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.443947 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.443795    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93abe02a-54f1-4adf-bee4-f10aad7e1f03-manifests\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.443947 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.443818    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93abe02a-54f1-4adf-bee4-f10aad7e1f03-tmp\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.443947 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.443862    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93abe02a-54f1-4adf-bee4-f10aad7e1f03-webhook-cert\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.443947 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.443890    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmztz\" (UniqueName: \"kubernetes.io/projected/93abe02a-54f1-4adf-bee4-f10aad7e1f03-kube-api-access-rmztz\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.444168 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.444150    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93abe02a-54f1-4adf-bee4-f10aad7e1f03-manifests\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.446142 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.446114    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93abe02a-54f1-4adf-bee4-f10aad7e1f03-tmp\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.446302 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.446284    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93abe02a-54f1-4adf-bee4-f10aad7e1f03-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.446456 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.446432    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93abe02a-54f1-4adf-bee4-f10aad7e1f03-webhook-cert\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.459873 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.459849    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmztz\" (UniqueName: \"kubernetes.io/projected/93abe02a-54f1-4adf-bee4-f10aad7e1f03-kube-api-access-rmztz\") pod \"opendatahub-operator-controller-manager-684d7c5d99-kvgk6\" (UID: \"93abe02a-54f1-4adf-bee4-f10aad7e1f03\") " pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.559184 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.559160    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:24.701828 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:24.701803    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"]
Jul 30 02:34:24.703805 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:34:24.703779    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93abe02a_54f1_4adf_bee4_f10aad7e1f03.slice/crio-e73a4cdf5b5a1620f314878b04298b0d1dfcbd039ed5febce71a608ebc4ef6f5 WatchSource:0}: Error finding container e73a4cdf5b5a1620f314878b04298b0d1dfcbd039ed5febce71a608ebc4ef6f5: Status 404 returned error can't find the container with id e73a4cdf5b5a1620f314878b04298b0d1dfcbd039ed5febce71a608ebc4ef6f5
Jul 30 02:34:25.430115 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:25.430073    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6" event={"ID":"93abe02a-54f1-4adf-bee4-f10aad7e1f03","Type":"ContainerStarted","Data":"e73a4cdf5b5a1620f314878b04298b0d1dfcbd039ed5febce71a608ebc4ef6f5"}
Jul 30 02:34:28.446731 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:28.446689    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6" event={"ID":"93abe02a-54f1-4adf-bee4-f10aad7e1f03","Type":"ContainerStarted","Data":"478a97d244d2871bdeb3672182a37397d7cce8e59852cc2ea2d09784b4c2502d"}
Jul 30 02:34:29.452475 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:29.452441    2554 generic.go:356] "Generic (PLEG): container finished" podID="93abe02a-54f1-4adf-bee4-f10aad7e1f03" containerID="478a97d244d2871bdeb3672182a37397d7cce8e59852cc2ea2d09784b4c2502d" exitCode=0
Jul 30 02:34:29.452865 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:29.452519    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6" event={"ID":"93abe02a-54f1-4adf-bee4-f10aad7e1f03","Type":"ContainerDied","Data":"478a97d244d2871bdeb3672182a37397d7cce8e59852cc2ea2d09784b4c2502d"}
Jul 30 02:34:30.460021 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:30.459985    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6" event={"ID":"93abe02a-54f1-4adf-bee4-f10aad7e1f03","Type":"ContainerStarted","Data":"ed320f673de2fc1d5d050182732bdb6c824b90e522e9dec5a09234f718ffbcbd"}
Jul 30 02:34:30.460429 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:30.460078    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:30.484273 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:30.484221    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6" podStartSLOduration=2.174388191 podStartE2EDuration="6.484205915s" totalImagesPullingTime="3.260966907s" totalInitContainerRuntime="1.048850817s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:34:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:34:30.482941024 +0000 UTC m=+506.333253767" watchObservedRunningTime="2026-07-30 02:34:30.484205915 +0000 UTC m=+506.334518646"
Jul 30 02:34:41.467682 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:41.467650    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-684d7c5d99-kvgk6"
Jul 30 02:34:43.939953 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:43.939917    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8rftp"]
Jul 30 02:34:43.947458 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:43.947436    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8rftp"
Jul 30 02:34:43.950598 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:43.950574    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 30 02:34:43.950715 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:43.950640    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5kwhc\""
Jul 30 02:34:43.954264 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:43.954241    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8rftp"]
Jul 30 02:34:44.104708 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.104673    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws5ck\" (UniqueName: \"kubernetes.io/projected/98e683a6-5e03-452e-b653-c2362c0de009-kube-api-access-ws5ck\") pod \"odh-model-controller-7998c67dc4-8rftp\" (UID: \"98e683a6-5e03-452e-b653-c2362c0de009\") " pod="opendatahub/odh-model-controller-7998c67dc4-8rftp"
Jul 30 02:34:44.104866 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.104824    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98e683a6-5e03-452e-b653-c2362c0de009-cert\") pod \"odh-model-controller-7998c67dc4-8rftp\" (UID: \"98e683a6-5e03-452e-b653-c2362c0de009\") " pod="opendatahub/odh-model-controller-7998c67dc4-8rftp"
Jul 30 02:34:44.206308 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.206216    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98e683a6-5e03-452e-b653-c2362c0de009-cert\") pod \"odh-model-controller-7998c67dc4-8rftp\" (UID: \"98e683a6-5e03-452e-b653-c2362c0de009\") " pod="opendatahub/odh-model-controller-7998c67dc4-8rftp"
Jul 30 02:34:44.206308 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.206262    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws5ck\" (UniqueName: \"kubernetes.io/projected/98e683a6-5e03-452e-b653-c2362c0de009-kube-api-access-ws5ck\") pod \"odh-model-controller-7998c67dc4-8rftp\" (UID: \"98e683a6-5e03-452e-b653-c2362c0de009\") " pod="opendatahub/odh-model-controller-7998c67dc4-8rftp"
Jul 30 02:34:44.206489 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:34:44.206388    2554 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 30 02:34:44.206489 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:34:44.206463    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e683a6-5e03-452e-b653-c2362c0de009-cert podName:98e683a6-5e03-452e-b653-c2362c0de009 nodeName:}" failed. No retries permitted until 2026-07-30 02:34:44.706443052 +0000 UTC m=+520.556755767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/98e683a6-5e03-452e-b653-c2362c0de009-cert") pod "odh-model-controller-7998c67dc4-8rftp" (UID: "98e683a6-5e03-452e-b653-c2362c0de009") : secret "odh-model-controller-webhook-cert" not found
Jul 30 02:34:44.215310 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.215281    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws5ck\" (UniqueName: \"kubernetes.io/projected/98e683a6-5e03-452e-b653-c2362c0de009-kube-api-access-ws5ck\") pod \"odh-model-controller-7998c67dc4-8rftp\" (UID: \"98e683a6-5e03-452e-b653-c2362c0de009\") " pod="opendatahub/odh-model-controller-7998c67dc4-8rftp"
Jul 30 02:34:44.623884 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.623843    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c66vm"]
Jul 30 02:34:44.627105 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.627084    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-c66vm"
Jul 30 02:34:44.629365 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.629340    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 30 02:34:44.629488 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.629402    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-p4hq8\""
Jul 30 02:34:44.644025 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.643989    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c66vm"]
Jul 30 02:34:44.711620 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.711585    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98e683a6-5e03-452e-b653-c2362c0de009-cert\") pod \"odh-model-controller-7998c67dc4-8rftp\" (UID: \"98e683a6-5e03-452e-b653-c2362c0de009\") " pod="opendatahub/odh-model-controller-7998c67dc4-8rftp"
Jul 30 02:34:44.711841 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.711640    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cnl6\" (UniqueName: \"kubernetes.io/projected/ede6547b-21cf-4d73-8619-c302908a218b-kube-api-access-7cnl6\") pod \"model-serving-api-54d89bd5fc-c66vm\" (UID: \"ede6547b-21cf-4d73-8619-c302908a218b\") " pod="opendatahub/model-serving-api-54d89bd5fc-c66vm"
Jul 30 02:34:44.711841 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.711719    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ede6547b-21cf-4d73-8619-c302908a218b-tls-certs\") pod \"model-serving-api-54d89bd5fc-c66vm\" (UID: \"ede6547b-21cf-4d73-8619-c302908a218b\") " pod="opendatahub/model-serving-api-54d89bd5fc-c66vm"
Jul 30 02:34:44.713992 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.713967    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98e683a6-5e03-452e-b653-c2362c0de009-cert\") pod \"odh-model-controller-7998c67dc4-8rftp\" (UID: \"98e683a6-5e03-452e-b653-c2362c0de009\") " pod="opendatahub/odh-model-controller-7998c67dc4-8rftp"
Jul 30 02:34:44.812466 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.812433    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cnl6\" (UniqueName: \"kubernetes.io/projected/ede6547b-21cf-4d73-8619-c302908a218b-kube-api-access-7cnl6\") pod \"model-serving-api-54d89bd5fc-c66vm\" (UID: \"ede6547b-21cf-4d73-8619-c302908a218b\") " pod="opendatahub/model-serving-api-54d89bd5fc-c66vm"
Jul 30 02:34:44.812629 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.812490    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ede6547b-21cf-4d73-8619-c302908a218b-tls-certs\") pod \"model-serving-api-54d89bd5fc-c66vm\" (UID: \"ede6547b-21cf-4d73-8619-c302908a218b\") " pod="opendatahub/model-serving-api-54d89bd5fc-c66vm"
Jul 30 02:34:44.814899 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.814875    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ede6547b-21cf-4d73-8619-c302908a218b-tls-certs\") pod \"model-serving-api-54d89bd5fc-c66vm\" (UID: \"ede6547b-21cf-4d73-8619-c302908a218b\") " pod="opendatahub/model-serving-api-54d89bd5fc-c66vm"
Jul 30 02:34:44.819885 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.819865    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cnl6\" (UniqueName: \"kubernetes.io/projected/ede6547b-21cf-4d73-8619-c302908a218b-kube-api-access-7cnl6\") pod \"model-serving-api-54d89bd5fc-c66vm\" (UID: \"ede6547b-21cf-4d73-8619-c302908a218b\") " pod="opendatahub/model-serving-api-54d89bd5fc-c66vm"
Jul 30 02:34:44.860767 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.860741    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8rftp"
Jul 30 02:34:44.941218 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.941181    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-c66vm"
Jul 30 02:34:44.999901 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:44.999744    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8rftp"]
Jul 30 02:34:45.001851 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:34:45.001819    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e683a6_5e03_452e_b653_c2362c0de009.slice/crio-ec66e940cc3874b08fbe027bce0646222ae24f10852c074d5df887d31f6eece2 WatchSource:0}: Error finding container ec66e940cc3874b08fbe027bce0646222ae24f10852c074d5df887d31f6eece2: Status 404 returned error can't find the container with id ec66e940cc3874b08fbe027bce0646222ae24f10852c074d5df887d31f6eece2
Jul 30 02:34:45.082036 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:45.081999    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c66vm"]
Jul 30 02:34:45.085366 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:34:45.085338    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede6547b_21cf_4d73_8619_c302908a218b.slice/crio-ab0e8643554c637df7d5260fd945dda7b32d56b087280260b168d3fe7bdbb9c3 WatchSource:0}: Error finding container ab0e8643554c637df7d5260fd945dda7b32d56b087280260b168d3fe7bdbb9c3: Status 404 returned error can't find the container with id ab0e8643554c637df7d5260fd945dda7b32d56b087280260b168d3fe7bdbb9c3
Jul 30 02:34:45.523497 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:45.523456    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-c66vm" event={"ID":"ede6547b-21cf-4d73-8619-c302908a218b","Type":"ContainerStarted","Data":"ab0e8643554c637df7d5260fd945dda7b32d56b087280260b168d3fe7bdbb9c3"}
Jul 30 02:34:45.524755 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:45.524729    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8rftp" event={"ID":"98e683a6-5e03-452e-b653-c2362c0de009","Type":"ContainerStarted","Data":"ec66e940cc3874b08fbe027bce0646222ae24f10852c074d5df887d31f6eece2"}
Jul 30 02:34:46.674081 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.674044    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g"]
Jul 30 02:34:46.677840 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.677815    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g"
Jul 30 02:34:46.680252 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.680224    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 30 02:34:46.680374 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.680264    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zl6b8\""
Jul 30 02:34:46.681095 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.681040    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 30 02:34:46.685620 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.685594    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g"]
Jul 30 02:34:46.831540 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.831497    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6ae05d0-fed1-4e53-9311-dd5fa0bde918-tls-certs\") pod \"kube-auth-proxy-5b44668b45-f7p6g\" (UID: \"f6ae05d0-fed1-4e53-9311-dd5fa0bde918\") " pod="openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g"
Jul 30 02:34:46.831770 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.831595    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf46h\" (UniqueName: \"kubernetes.io/projected/f6ae05d0-fed1-4e53-9311-dd5fa0bde918-kube-api-access-wf46h\") pod \"kube-auth-proxy-5b44668b45-f7p6g\" (UID: \"f6ae05d0-fed1-4e53-9311-dd5fa0bde918\") " pod="openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g"
Jul 30 02:34:46.831770 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.831658    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6ae05d0-fed1-4e53-9311-dd5fa0bde918-tmp\") pod \"kube-auth-proxy-5b44668b45-f7p6g\" (UID: \"f6ae05d0-fed1-4e53-9311-dd5fa0bde918\") " pod="openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g"
Jul 30 02:34:46.932710 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.932622    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6ae05d0-fed1-4e53-9311-dd5fa0bde918-tmp\") pod \"kube-auth-proxy-5b44668b45-f7p6g\" (UID: \"f6ae05d0-fed1-4e53-9311-dd5fa0bde918\") " pod="openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g"
Jul 30 02:34:46.932710 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.932695    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6ae05d0-fed1-4e53-9311-dd5fa0bde918-tls-certs\") pod \"kube-auth-proxy-5b44668b45-f7p6g\" (UID: \"f6ae05d0-fed1-4e53-9311-dd5fa0bde918\") " pod="openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g"
Jul 30 02:34:46.932919 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.932746    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf46h\" (UniqueName: \"kubernetes.io/projected/f6ae05d0-fed1-4e53-9311-dd5fa0bde918-kube-api-access-wf46h\") pod \"kube-auth-proxy-5b44668b45-f7p6g\" (UID: \"f6ae05d0-fed1-4e53-9311-dd5fa0bde918\") " pod="openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g"
Jul 30 02:34:46.935606 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.935537    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6ae05d0-fed1-4e53-9311-dd5fa0bde918-tmp\") pod \"kube-auth-proxy-5b44668b45-f7p6g\" (UID: \"f6ae05d0-fed1-4e53-9311-dd5fa0bde918\") " pod="openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g"
Jul 30 02:34:46.935976 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.935952    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6ae05d0-fed1-4e53-9311-dd5fa0bde918-tls-certs\") pod \"kube-auth-proxy-5b44668b45-f7p6g\" (UID: \"f6ae05d0-fed1-4e53-9311-dd5fa0bde918\") " pod="openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g"
Jul 30 02:34:46.941038 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.940997    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf46h\" (UniqueName: \"kubernetes.io/projected/f6ae05d0-fed1-4e53-9311-dd5fa0bde918-kube-api-access-wf46h\") pod \"kube-auth-proxy-5b44668b45-f7p6g\" (UID: \"f6ae05d0-fed1-4e53-9311-dd5fa0bde918\") " pod="openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g"
Jul 30 02:34:46.997327 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:46.997274    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g"
Jul 30 02:34:48.294435 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:48.294409    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g"]
Jul 30 02:34:48.296582 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:34:48.296029    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ae05d0_fed1_4e53_9311_dd5fa0bde918.slice/crio-1b558700f406bedebb70c1f01f324f4739ecbbf85d8e0a5406d9147f015593c4 WatchSource:0}: Error finding container 1b558700f406bedebb70c1f01f324f4739ecbbf85d8e0a5406d9147f015593c4: Status 404 returned error can't find the container with id 1b558700f406bedebb70c1f01f324f4739ecbbf85d8e0a5406d9147f015593c4
Jul 30 02:34:48.543814 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:48.543772    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-c66vm" event={"ID":"ede6547b-21cf-4d73-8619-c302908a218b","Type":"ContainerStarted","Data":"eabb38ae0d0b281e98204dcdaeb964968ba46d14b7cd4a787cec56f450c780f9"}
Jul 30 02:34:48.544011 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:48.543879    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-c66vm"
Jul 30 02:34:48.545720 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:48.545691    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8rftp" event={"ID":"98e683a6-5e03-452e-b653-c2362c0de009","Type":"ContainerStarted","Data":"916b474adede27c69f26bdb76808acf7ec06f79501c2240ec6ecafeb424c4eb2"}
Jul 30 02:34:48.545855 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:48.545753    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-8rftp"
Jul 30 02:34:48.547241 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:48.547214    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g" event={"ID":"f6ae05d0-fed1-4e53-9311-dd5fa0bde918","Type":"ContainerStarted","Data":"1b558700f406bedebb70c1f01f324f4739ecbbf85d8e0a5406d9147f015593c4"}
Jul 30 02:34:48.560287 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:48.560244    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-c66vm" podStartSLOduration=1.495588151 podStartE2EDuration="4.560232396s" totalImagesPullingTime="3.064644245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:34:48.558759012 +0000 UTC m=+524.409071742" watchObservedRunningTime="2026-07-30 02:34:48.560232396 +0000 UTC m=+524.410545105"
Jul 30 02:34:48.579214 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:48.579164    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-8rftp" podStartSLOduration=2.36703923 podStartE2EDuration="5.579147147s" totalImagesPullingTime="3.212107917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:34:48.577857917 +0000 UTC m=+524.428170649" watchObservedRunningTime="2026-07-30 02:34:48.579147147 +0000 UTC m=+524.429459879"
Jul 30 02:34:50.559892 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:50.559854    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g" event={"ID":"f6ae05d0-fed1-4e53-9311-dd5fa0bde918","Type":"ContainerStarted","Data":"e7bb32b524c5872e059e8f5175052d2647cfeb3a35d593b0459e441809d86881"}
Jul 30 02:34:50.578931 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:50.578878    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b44668b45-f7p6g" podStartSLOduration=2.495092838 podStartE2EDuration="4.578856611s" totalImagesPullingTime="2.083763773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:34:50.578067826 +0000 UTC m=+526.428380604" watchObservedRunningTime="2026-07-30 02:34:50.578856611 +0000 UTC m=+526.429169345"
Jul 30 02:34:51.682524 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.682495    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"]
Jul 30 02:34:51.685985 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.685968    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:51.689117 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.689096    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 02:34:51.689984 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.689967    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 30 02:34:51.689984 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.689978    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 30 02:34:51.690278 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.690261    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 30 02:34:51.690368 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.690302    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 02:34:51.690425 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.690388    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tzr4c\""
Jul 30 02:34:51.696898 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.696878    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"]
Jul 30 02:34:51.779677 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.779646    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a-manager-config\") pod \"lws-controller-manager-5bb854bdc9-k9tcr\" (UID: \"44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a\") " pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:51.779793 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.779692    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xbh4\" (UniqueName: \"kubernetes.io/projected/44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a-kube-api-access-7xbh4\") pod \"lws-controller-manager-5bb854bdc9-k9tcr\" (UID: \"44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a\") " pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:51.779793 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.779720    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a-metrics-cert\") pod \"lws-controller-manager-5bb854bdc9-k9tcr\" (UID: \"44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a\") " pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:51.779793 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.779784    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a-cert\") pod \"lws-controller-manager-5bb854bdc9-k9tcr\" (UID: \"44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a\") " pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:51.880178 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.880146    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a-metrics-cert\") pod \"lws-controller-manager-5bb854bdc9-k9tcr\" (UID: \"44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a\") " pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:51.880332 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.880187    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a-cert\") pod \"lws-controller-manager-5bb854bdc9-k9tcr\" (UID: \"44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a\") " pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:51.880332 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.880228    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a-manager-config\") pod \"lws-controller-manager-5bb854bdc9-k9tcr\" (UID: \"44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a\") " pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:51.880332 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.880256    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xbh4\" (UniqueName: \"kubernetes.io/projected/44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a-kube-api-access-7xbh4\") pod \"lws-controller-manager-5bb854bdc9-k9tcr\" (UID: \"44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a\") " pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:51.880954 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.880930    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a-manager-config\") pod \"lws-controller-manager-5bb854bdc9-k9tcr\" (UID: \"44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a\") " pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:51.882719 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.882693    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a-cert\") pod \"lws-controller-manager-5bb854bdc9-k9tcr\" (UID: \"44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a\") " pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:51.882818 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.882693    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a-metrics-cert\") pod \"lws-controller-manager-5bb854bdc9-k9tcr\" (UID: \"44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a\") " pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:51.887665 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.887646    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xbh4\" (UniqueName: \"kubernetes.io/projected/44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a-kube-api-access-7xbh4\") pod \"lws-controller-manager-5bb854bdc9-k9tcr\" (UID: \"44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a\") " pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:51.995259 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:51.995186    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:52.144441 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:52.144413    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"]
Jul 30 02:34:52.146309 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:34:52.146280    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44f8a3f5_8065_4d0f_bfc5_b438b92d2b4a.slice/crio-23aaa9a0e1cce1eb80aba545f53def956d4aaaae1073a3accc6953ff195ae45f WatchSource:0}: Error finding container 23aaa9a0e1cce1eb80aba545f53def956d4aaaae1073a3accc6953ff195ae45f: Status 404 returned error can't find the container with id 23aaa9a0e1cce1eb80aba545f53def956d4aaaae1073a3accc6953ff195ae45f
Jul 30 02:34:52.571345 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:52.571311    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr" event={"ID":"44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a","Type":"ContainerStarted","Data":"23aaa9a0e1cce1eb80aba545f53def956d4aaaae1073a3accc6953ff195ae45f"}
Jul 30 02:34:55.586709 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:55.586672    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr" event={"ID":"44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a","Type":"ContainerStarted","Data":"f3ee414009b76ccf161e818c7b2e8b7e2fcd8b2663a121e70c6da544a6cb65e8"}
Jul 30 02:34:55.587164 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:55.586796    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:34:55.621514 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:55.621464    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr" podStartSLOduration=2.187450434 podStartE2EDuration="4.621450567s" totalImagesPullingTime="2.434000133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:34:55.620314669 +0000 UTC m=+531.470627401" watchObservedRunningTime="2026-07-30 02:34:55.621450567 +0000 UTC m=+531.471763298"
Jul 30 02:34:59.555178 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:59.555102    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-8rftp"
Jul 30 02:34:59.556999 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:34:59.556976    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-c66vm"
Jul 30 02:35:06.593936 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:35:06.593902    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5bb854bdc9-k9tcr"
Jul 30 02:36:04.528394 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:04.528367    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:36:04.531280 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:04.531253    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:36:04.532477 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:04.532456    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:36:04.535125 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:04.535108    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:36:07.548539 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.548501    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7457c6fd6d-ww869"]
Jul 30 02:36:07.552061 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.552038    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.564504 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.564474    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7457c6fd6d-ww869"]
Jul 30 02:36:07.612569 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.612530    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac0906ff-d838-41a9-973c-82e199c59d75-service-ca\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.612711 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.612577    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac0906ff-d838-41a9-973c-82e199c59d75-trusted-ca-bundle\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.612711 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.612610    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac0906ff-d838-41a9-973c-82e199c59d75-oauth-serving-cert\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.612711 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.612684    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac0906ff-d838-41a9-973c-82e199c59d75-console-serving-cert\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.612814 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.612719    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac0906ff-d838-41a9-973c-82e199c59d75-console-config\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.612814 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.612750    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac0906ff-d838-41a9-973c-82e199c59d75-console-oauth-config\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.612814 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.612776    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scv2j\" (UniqueName: \"kubernetes.io/projected/ac0906ff-d838-41a9-973c-82e199c59d75-kube-api-access-scv2j\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.713638 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.713603    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac0906ff-d838-41a9-973c-82e199c59d75-console-config\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.713803 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.713646    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac0906ff-d838-41a9-973c-82e199c59d75-console-oauth-config\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.713803 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.713684    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scv2j\" (UniqueName: \"kubernetes.io/projected/ac0906ff-d838-41a9-973c-82e199c59d75-kube-api-access-scv2j\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.713803 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.713720    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac0906ff-d838-41a9-973c-82e199c59d75-service-ca\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.713803 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.713741    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac0906ff-d838-41a9-973c-82e199c59d75-trusted-ca-bundle\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.713803 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.713779    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac0906ff-d838-41a9-973c-82e199c59d75-oauth-serving-cert\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.714073 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.713842    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac0906ff-d838-41a9-973c-82e199c59d75-console-serving-cert\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.714429 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.714405    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac0906ff-d838-41a9-973c-82e199c59d75-console-config\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.714530 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.714492    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac0906ff-d838-41a9-973c-82e199c59d75-service-ca\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.714614 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.714541    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac0906ff-d838-41a9-973c-82e199c59d75-oauth-serving-cert\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.714741 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.714716    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac0906ff-d838-41a9-973c-82e199c59d75-trusted-ca-bundle\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.716242 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.716215    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac0906ff-d838-41a9-973c-82e199c59d75-console-serving-cert\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.716242 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.716234    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac0906ff-d838-41a9-973c-82e199c59d75-console-oauth-config\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.721789 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.721772    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scv2j\" (UniqueName: \"kubernetes.io/projected/ac0906ff-d838-41a9-973c-82e199c59d75-kube-api-access-scv2j\") pod \"console-7457c6fd6d-ww869\" (UID: \"ac0906ff-d838-41a9-973c-82e199c59d75\") " pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.862216 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.862128    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:07.994403 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:07.994372    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7457c6fd6d-ww869"]
Jul 30 02:36:07.997539 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:36:07.997508    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac0906ff_d838_41a9_973c_82e199c59d75.slice/crio-f4a06b3538a745350e6a80c459c82d9e05b36b9ceae7cddd291054d2bdaf528d WatchSource:0}: Error finding container f4a06b3538a745350e6a80c459c82d9e05b36b9ceae7cddd291054d2bdaf528d: Status 404 returned error can't find the container with id f4a06b3538a745350e6a80c459c82d9e05b36b9ceae7cddd291054d2bdaf528d
Jul 30 02:36:08.909887 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:08.909848    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7457c6fd6d-ww869" event={"ID":"ac0906ff-d838-41a9-973c-82e199c59d75","Type":"ContainerStarted","Data":"eb7031ef183c5563ef8e7f41915c351c421a4ab741692df9576c65695f5f4e36"}
Jul 30 02:36:08.910313 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:08.909900    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7457c6fd6d-ww869" event={"ID":"ac0906ff-d838-41a9-973c-82e199c59d75","Type":"ContainerStarted","Data":"f4a06b3538a745350e6a80c459c82d9e05b36b9ceae7cddd291054d2bdaf528d"}
Jul 30 02:36:08.928110 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:08.928060    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7457c6fd6d-ww869" podStartSLOduration=1.9280471160000001 podStartE2EDuration="1.928047116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:36:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:36:08.926434333 +0000 UTC m=+604.776747077" watchObservedRunningTime="2026-07-30 02:36:08.928047116 +0000 UTC m=+604.778359846"
Jul 30 02:36:17.862941 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:17.862897    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:17.863342 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:17.863002    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:17.867857 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:17.867829    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:17.958629 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:17.958603    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7457c6fd6d-ww869"
Jul 30 02:36:18.012835 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:18.012803    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b597fb446-5dgnj"]
Jul 30 02:36:43.034083 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.034021    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b597fb446-5dgnj" podUID="63957aa8-c9c9-43f5-ac48-98158f3f332c" containerName="console" containerID="cri-o://3e7c68184b917b86aec77600cb8a70962944796d265c51ce0eb0f7167aa695f2" gracePeriod=15
Jul 30 02:36:43.280212 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.280190    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:36:43.317959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.317881    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-oauth-serving-cert\") pod \"63957aa8-c9c9-43f5-ac48-98158f3f332c\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") "
Jul 30 02:36:43.317959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.317920    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-oauth-config\") pod \"63957aa8-c9c9-43f5-ac48-98158f3f332c\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") "
Jul 30 02:36:43.317959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.317953    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq7hl\" (UniqueName: \"kubernetes.io/projected/63957aa8-c9c9-43f5-ac48-98158f3f332c-kube-api-access-qq7hl\") pod \"63957aa8-c9c9-43f5-ac48-98158f3f332c\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") "
Jul 30 02:36:43.318190 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.317976    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-serving-cert\") pod \"63957aa8-c9c9-43f5-ac48-98158f3f332c\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") "
Jul 30 02:36:43.318190 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.318105    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-service-ca\") pod \"63957aa8-c9c9-43f5-ac48-98158f3f332c\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") "
Jul 30 02:36:43.318190 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.318142    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-trusted-ca-bundle\") pod \"63957aa8-c9c9-43f5-ac48-98158f3f332c\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") "
Jul 30 02:36:43.318190 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.318180    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-config\") pod \"63957aa8-c9c9-43f5-ac48-98158f3f332c\" (UID: \"63957aa8-c9c9-43f5-ac48-98158f3f332c\") "
Jul 30 02:36:43.318425 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.318379    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "63957aa8-c9c9-43f5-ac48-98158f3f332c" (UID: "63957aa8-c9c9-43f5-ac48-98158f3f332c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 02:36:43.318804 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.318773    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-service-ca" (OuterVolumeSpecName: "service-ca") pod "63957aa8-c9c9-43f5-ac48-98158f3f332c" (UID: "63957aa8-c9c9-43f5-ac48-98158f3f332c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 02:36:43.318984 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.318827    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-config" (OuterVolumeSpecName: "console-config") pod "63957aa8-c9c9-43f5-ac48-98158f3f332c" (UID: "63957aa8-c9c9-43f5-ac48-98158f3f332c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 02:36:43.318984 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.318853    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "63957aa8-c9c9-43f5-ac48-98158f3f332c" (UID: "63957aa8-c9c9-43f5-ac48-98158f3f332c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 02:36:43.319104 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.318987    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-oauth-serving-cert\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:36:43.319104 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.319007    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-service-ca\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:36:43.319104 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.319025    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-trusted-ca-bundle\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:36:43.319104 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.319039    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-config\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:36:43.320320 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.320293    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "63957aa8-c9c9-43f5-ac48-98158f3f332c" (UID: "63957aa8-c9c9-43f5-ac48-98158f3f332c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 02:36:43.320635 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.320610    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "63957aa8-c9c9-43f5-ac48-98158f3f332c" (UID: "63957aa8-c9c9-43f5-ac48-98158f3f332c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 02:36:43.320635 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.320621    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63957aa8-c9c9-43f5-ac48-98158f3f332c-kube-api-access-qq7hl" (OuterVolumeSpecName: "kube-api-access-qq7hl") pod "63957aa8-c9c9-43f5-ac48-98158f3f332c" (UID: "63957aa8-c9c9-43f5-ac48-98158f3f332c"). InnerVolumeSpecName "kube-api-access-qq7hl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 02:36:43.420395 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.420363    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-oauth-config\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:36:43.420395 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.420389    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq7hl\" (UniqueName: \"kubernetes.io/projected/63957aa8-c9c9-43f5-ac48-98158f3f332c-kube-api-access-qq7hl\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:36:43.420395 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:43.420400    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63957aa8-c9c9-43f5-ac48-98158f3f332c-console-serving-cert\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:36:44.074220 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:44.074188    2554 generic.go:356] "Generic (PLEG): container finished" podID="63957aa8-c9c9-43f5-ac48-98158f3f332c" containerID="3e7c68184b917b86aec77600cb8a70962944796d265c51ce0eb0f7167aa695f2" exitCode=0
Jul 30 02:36:44.074633 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:44.074229    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b597fb446-5dgnj"
Jul 30 02:36:44.074633 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:44.074269    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b597fb446-5dgnj" event={"ID":"63957aa8-c9c9-43f5-ac48-98158f3f332c","Type":"ContainerDied","Data":"3e7c68184b917b86aec77600cb8a70962944796d265c51ce0eb0f7167aa695f2"}
Jul 30 02:36:44.074633 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:44.074318    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b597fb446-5dgnj" event={"ID":"63957aa8-c9c9-43f5-ac48-98158f3f332c","Type":"ContainerDied","Data":"913a006305fa8ac28c90c57f42804490a54a2181469a90afd0881d761b0b99b8"}
Jul 30 02:36:44.074633 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:44.074338    2554 scope.go:117] "RemoveContainer" containerID="3e7c68184b917b86aec77600cb8a70962944796d265c51ce0eb0f7167aa695f2"
Jul 30 02:36:44.088575 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:44.087592    2554 scope.go:117] "RemoveContainer" containerID="3e7c68184b917b86aec77600cb8a70962944796d265c51ce0eb0f7167aa695f2"
Jul 30 02:36:44.089659 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:36:44.088875    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e7c68184b917b86aec77600cb8a70962944796d265c51ce0eb0f7167aa695f2\": container with ID starting with 3e7c68184b917b86aec77600cb8a70962944796d265c51ce0eb0f7167aa695f2 not found: ID does not exist" containerID="3e7c68184b917b86aec77600cb8a70962944796d265c51ce0eb0f7167aa695f2"
Jul 30 02:36:44.089659 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:44.088927    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e7c68184b917b86aec77600cb8a70962944796d265c51ce0eb0f7167aa695f2"} err="failed to get container status \"3e7c68184b917b86aec77600cb8a70962944796d265c51ce0eb0f7167aa695f2\": rpc error: code = NotFound desc = could not find container \"3e7c68184b917b86aec77600cb8a70962944796d265c51ce0eb0f7167aa695f2\": container with ID starting with 3e7c68184b917b86aec77600cb8a70962944796d265c51ce0eb0f7167aa695f2 not found: ID does not exist"
Jul 30 02:36:44.099806 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:44.099783    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b597fb446-5dgnj"]
Jul 30 02:36:44.104638 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:44.104618    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b597fb446-5dgnj"]
Jul 30 02:36:44.642517 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:44.642486    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63957aa8-c9c9-43f5-ac48-98158f3f332c" path="/var/lib/kubelet/pods/63957aa8-c9c9-43f5-ac48-98158f3f332c/volumes"
Jul 30 02:36:52.521958 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.521919    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"]
Jul 30 02:36:52.522441 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.522422    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63957aa8-c9c9-43f5-ac48-98158f3f332c" containerName="console"
Jul 30 02:36:52.522516 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.522445    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="63957aa8-c9c9-43f5-ac48-98158f3f332c" containerName="console"
Jul 30 02:36:52.522585 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.522574    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="63957aa8-c9c9-43f5-ac48-98158f3f332c" containerName="console"
Jul 30 02:36:52.526899 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.526878    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:52.529683 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.529663    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 02:36:52.529789 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.529664    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kgss5\""
Jul 30 02:36:52.529789 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.529700    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 02:36:52.538675 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.538656    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"]
Jul 30 02:36:52.596871 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.596843    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zqp8f\" (UID: \"6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:52.597025 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.596971    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv7h4\" (UniqueName: \"kubernetes.io/projected/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2-kube-api-access-lv7h4\") pod \"kuadrant-operator-controller-manager-55467d9f7-zqp8f\" (UID: \"6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:52.697447 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.697417    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv7h4\" (UniqueName: \"kubernetes.io/projected/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2-kube-api-access-lv7h4\") pod \"kuadrant-operator-controller-manager-55467d9f7-zqp8f\" (UID: \"6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:52.697618 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.697460    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zqp8f\" (UID: \"6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:52.697827 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.697810    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zqp8f\" (UID: \"6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:52.705719 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.705697    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv7h4\" (UniqueName: \"kubernetes.io/projected/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2-kube-api-access-lv7h4\") pod \"kuadrant-operator-controller-manager-55467d9f7-zqp8f\" (UID: \"6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:52.836735 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.836661    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:52.912907 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.912877    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"]
Jul 30 02:36:52.915838 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.915813    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"]
Jul 30 02:36:52.937669 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.937643    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"]
Jul 30 02:36:52.941136 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.941118    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"
Jul 30 02:36:52.955735 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:52.955712    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"]
Jul 30 02:36:53.000257 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.000220    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4smmp\" (UniqueName: \"kubernetes.io/projected/27e13415-dcc8-4d39-bed5-89de442fa73e-kube-api-access-4smmp\") pod \"kuadrant-operator-controller-manager-55467d9f7-dsjb5\" (UID: \"27e13415-dcc8-4d39-bed5-89de442fa73e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"
Jul 30 02:36:53.000414 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.000343    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27e13415-dcc8-4d39-bed5-89de442fa73e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dsjb5\" (UID: \"27e13415-dcc8-4d39-bed5-89de442fa73e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"
Jul 30 02:36:53.093439 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:36:53.093407    2554 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 30 02:36:53.093439 ip-10-0-136-75 kubenswrapper[2554]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-zqp8f_kuadrant-system_6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2_0(4f7c4c778b0fc7640d2090f92823d0f647e87af3d6dac1e8e01f17d339febe3a): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-zqp8f to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"4f7c4c778b0fc7640d2090f92823d0f647e87af3d6dac1e8e01f17d339febe3a" Netns:"/var/run/netns/74307e3b-d9a2-4b65-b4b2-7b1274a0def3" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-zqp8f;K8S_POD_INFRA_CONTAINER_ID=4f7c4c778b0fc7640d2090f92823d0f647e87af3d6dac1e8e01f17d339febe3a;K8S_POD_UID=6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f 4f7c4c778b0fc7640d2090f92823d0f647e87af3d6dac1e8e01f17d339febe3a network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:1f [10.133.0.31/23]
Jul 30 02:36:53.093439 ip-10-0-136-75 kubenswrapper[2554]:         '
Jul 30 02:36:53.093439 ip-10-0-136-75 kubenswrapper[2554]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 30 02:36:53.093439 ip-10-0-136-75 kubenswrapper[2554]:  >
Jul 30 02:36:53.093642 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:36:53.093470    2554 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 30 02:36:53.093642 ip-10-0-136-75 kubenswrapper[2554]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-zqp8f_kuadrant-system_6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2_0(4f7c4c778b0fc7640d2090f92823d0f647e87af3d6dac1e8e01f17d339febe3a): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-zqp8f to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"4f7c4c778b0fc7640d2090f92823d0f647e87af3d6dac1e8e01f17d339febe3a" Netns:"/var/run/netns/74307e3b-d9a2-4b65-b4b2-7b1274a0def3" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-zqp8f;K8S_POD_INFRA_CONTAINER_ID=4f7c4c778b0fc7640d2090f92823d0f647e87af3d6dac1e8e01f17d339febe3a;K8S_POD_UID=6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f 4f7c4c778b0fc7640d2090f92823d0f647e87af3d6dac1e8e01f17d339febe3a network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:1f [10.133.0.31/23]
Jul 30 02:36:53.093642 ip-10-0-136-75 kubenswrapper[2554]:         '
Jul 30 02:36:53.093642 ip-10-0-136-75 kubenswrapper[2554]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 30 02:36:53.093642 ip-10-0-136-75 kubenswrapper[2554]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:53.100781 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.100757    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27e13415-dcc8-4d39-bed5-89de442fa73e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dsjb5\" (UID: \"27e13415-dcc8-4d39-bed5-89de442fa73e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"
Jul 30 02:36:53.100893 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.100822    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4smmp\" (UniqueName: \"kubernetes.io/projected/27e13415-dcc8-4d39-bed5-89de442fa73e-kube-api-access-4smmp\") pod \"kuadrant-operator-controller-manager-55467d9f7-dsjb5\" (UID: \"27e13415-dcc8-4d39-bed5-89de442fa73e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"
Jul 30 02:36:53.101118 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.101097    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27e13415-dcc8-4d39-bed5-89de442fa73e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dsjb5\" (UID: \"27e13415-dcc8-4d39-bed5-89de442fa73e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"
Jul 30 02:36:53.109090 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.109070    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4smmp\" (UniqueName: \"kubernetes.io/projected/27e13415-dcc8-4d39-bed5-89de442fa73e-kube-api-access-4smmp\") pod \"kuadrant-operator-controller-manager-55467d9f7-dsjb5\" (UID: \"27e13415-dcc8-4d39-bed5-89de442fa73e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"
Jul 30 02:36:53.115627 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.115608    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:53.117887 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:36:53.117858    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zqp8f\" is forbidden: User \"system:node:ip-10-0-136-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-75.ec2.internal' and this object" podUID="6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:53.123203 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.123187    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:53.125417 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:36:53.125385    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zqp8f\" is forbidden: User \"system:node:ip-10-0-136-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-75.ec2.internal' and this object" podUID="6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:53.201519 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.201491    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2-extensions-socket-volume\") pod \"6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2\" (UID: \"6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2\") "
Jul 30 02:36:53.201675 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.201573    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv7h4\" (UniqueName: \"kubernetes.io/projected/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2-kube-api-access-lv7h4\") pod \"6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2\" (UID: \"6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2\") "
Jul 30 02:36:53.201822 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.201794    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2" (UID: "6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 02:36:53.203571 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.203537    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2-kube-api-access-lv7h4" (OuterVolumeSpecName: "kube-api-access-lv7h4") pod "6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2" (UID: "6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2"). InnerVolumeSpecName "kube-api-access-lv7h4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 02:36:53.251370 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.251335    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"
Jul 30 02:36:53.302540 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.302504    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv7h4\" (UniqueName: \"kubernetes.io/projected/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2-kube-api-access-lv7h4\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:36:53.302708 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.302543    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2-extensions-socket-volume\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:36:53.386081 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.385886    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"]
Jul 30 02:36:53.390325 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:36:53.390295    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e13415_dcc8_4d39_bed5_89de442fa73e.slice/crio-d9ef4450733bf15ccad001923f37d687f7f96d1e623f0aa0571b0e43f42c8355 WatchSource:0}: Error finding container d9ef4450733bf15ccad001923f37d687f7f96d1e623f0aa0571b0e43f42c8355: Status 404 returned error can't find the container with id d9ef4450733bf15ccad001923f37d687f7f96d1e623f0aa0571b0e43f42c8355
Jul 30 02:36:53.392649 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:53.392634    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 02:36:54.122276 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:54.122234    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5" event={"ID":"27e13415-dcc8-4d39-bed5-89de442fa73e","Type":"ContainerStarted","Data":"d9ef4450733bf15ccad001923f37d687f7f96d1e623f0aa0571b0e43f42c8355"}
Jul 30 02:36:54.122713 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:54.122372    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:54.124797 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:36:54.124759    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zqp8f\" is forbidden: User \"system:node:ip-10-0-136-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-75.ec2.internal' and this object" podUID="6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:54.134256 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:36:54.134219    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zqp8f\" is forbidden: User \"system:node:ip-10-0-136-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-75.ec2.internal' and this object" podUID="6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:54.640017 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:36:54.639974    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zqp8f\" is forbidden: User \"system:node:ip-10-0-136-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-75.ec2.internal' and this object" podUID="6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zqp8f"
Jul 30 02:36:54.644228 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:54.644198    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2" path="/var/lib/kubelet/pods/6083d5a8-de2f-4c86-9d9c-b9f5b58e10d2/volumes"
Jul 30 02:36:58.141286 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:58.141212    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5" event={"ID":"27e13415-dcc8-4d39-bed5-89de442fa73e","Type":"ContainerStarted","Data":"08f0e4183942bf0c23c25a237ff5e08a3eae286eed1e3f6896b7c362f3d06bc8"}
Jul 30 02:36:58.141625 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:58.141286    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"
Jul 30 02:36:58.162182 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:36:58.162084    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5" podStartSLOduration=1.696481632 podStartE2EDuration="6.162067471s" totalImagesPullingTime="4.465585839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:36:58.160759255 +0000 UTC m=+654.011071996" watchObservedRunningTime="2026-07-30 02:36:58.162067471 +0000 UTC m=+654.012380202"
Jul 30 02:37:09.147763 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:09.147733    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"
Jul 30 02:37:21.493424 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:21.493387    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"]
Jul 30 02:37:21.493918 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:21.493608    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5" podUID="27e13415-dcc8-4d39-bed5-89de442fa73e" containerName="manager" containerID="cri-o://08f0e4183942bf0c23c25a237ff5e08a3eae286eed1e3f6896b7c362f3d06bc8" gracePeriod=10
Jul 30 02:37:21.738242 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:21.738221    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"
Jul 30 02:37:21.838065 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:21.838034    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27e13415-dcc8-4d39-bed5-89de442fa73e-extensions-socket-volume\") pod \"27e13415-dcc8-4d39-bed5-89de442fa73e\" (UID: \"27e13415-dcc8-4d39-bed5-89de442fa73e\") "
Jul 30 02:37:21.838238 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:21.838099    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4smmp\" (UniqueName: \"kubernetes.io/projected/27e13415-dcc8-4d39-bed5-89de442fa73e-kube-api-access-4smmp\") pod \"27e13415-dcc8-4d39-bed5-89de442fa73e\" (UID: \"27e13415-dcc8-4d39-bed5-89de442fa73e\") "
Jul 30 02:37:21.838405 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:21.838380    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e13415-dcc8-4d39-bed5-89de442fa73e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "27e13415-dcc8-4d39-bed5-89de442fa73e" (UID: "27e13415-dcc8-4d39-bed5-89de442fa73e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 02:37:21.840224 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:21.840200    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e13415-dcc8-4d39-bed5-89de442fa73e-kube-api-access-4smmp" (OuterVolumeSpecName: "kube-api-access-4smmp") pod "27e13415-dcc8-4d39-bed5-89de442fa73e" (UID: "27e13415-dcc8-4d39-bed5-89de442fa73e"). InnerVolumeSpecName "kube-api-access-4smmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 02:37:21.939117 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:21.939070    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27e13415-dcc8-4d39-bed5-89de442fa73e-extensions-socket-volume\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:37:21.939117 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:21.939112    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4smmp\" (UniqueName: \"kubernetes.io/projected/27e13415-dcc8-4d39-bed5-89de442fa73e-kube-api-access-4smmp\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:37:22.252531 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:22.252492    2554 generic.go:356] "Generic (PLEG): container finished" podID="27e13415-dcc8-4d39-bed5-89de442fa73e" containerID="08f0e4183942bf0c23c25a237ff5e08a3eae286eed1e3f6896b7c362f3d06bc8" exitCode=0
Jul 30 02:37:22.252704 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:22.252541    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"
Jul 30 02:37:22.252704 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:22.252580    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5" event={"ID":"27e13415-dcc8-4d39-bed5-89de442fa73e","Type":"ContainerDied","Data":"08f0e4183942bf0c23c25a237ff5e08a3eae286eed1e3f6896b7c362f3d06bc8"}
Jul 30 02:37:22.252704 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:22.252638    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5" event={"ID":"27e13415-dcc8-4d39-bed5-89de442fa73e","Type":"ContainerDied","Data":"d9ef4450733bf15ccad001923f37d687f7f96d1e623f0aa0571b0e43f42c8355"}
Jul 30 02:37:22.252704 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:22.252663    2554 scope.go:117] "RemoveContainer" containerID="08f0e4183942bf0c23c25a237ff5e08a3eae286eed1e3f6896b7c362f3d06bc8"
Jul 30 02:37:22.261289 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:22.261270    2554 scope.go:117] "RemoveContainer" containerID="08f0e4183942bf0c23c25a237ff5e08a3eae286eed1e3f6896b7c362f3d06bc8"
Jul 30 02:37:22.261558 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:37:22.261528    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08f0e4183942bf0c23c25a237ff5e08a3eae286eed1e3f6896b7c362f3d06bc8\": container with ID starting with 08f0e4183942bf0c23c25a237ff5e08a3eae286eed1e3f6896b7c362f3d06bc8 not found: ID does not exist" containerID="08f0e4183942bf0c23c25a237ff5e08a3eae286eed1e3f6896b7c362f3d06bc8"
Jul 30 02:37:22.261614 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:22.261581    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08f0e4183942bf0c23c25a237ff5e08a3eae286eed1e3f6896b7c362f3d06bc8"} err="failed to get container status \"08f0e4183942bf0c23c25a237ff5e08a3eae286eed1e3f6896b7c362f3d06bc8\": rpc error: code = NotFound desc = could not find container \"08f0e4183942bf0c23c25a237ff5e08a3eae286eed1e3f6896b7c362f3d06bc8\": container with ID starting with 08f0e4183942bf0c23c25a237ff5e08a3eae286eed1e3f6896b7c362f3d06bc8 not found: ID does not exist"
Jul 30 02:37:22.274806 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:22.274785    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"]
Jul 30 02:37:22.281378 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:22.281357    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dsjb5"]
Jul 30 02:37:22.640851 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:22.640770    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27e13415-dcc8-4d39-bed5-89de442fa73e" path="/var/lib/kubelet/pods/27e13415-dcc8-4d39-bed5-89de442fa73e/volumes"
Jul 30 02:37:40.026419 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.026388    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:37:40.026798 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.026729    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e13415-dcc8-4d39-bed5-89de442fa73e" containerName="manager"
Jul 30 02:37:40.026798 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.026740    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e13415-dcc8-4d39-bed5-89de442fa73e" containerName="manager"
Jul 30 02:37:40.026872 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.026806    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="27e13415-dcc8-4d39-bed5-89de442fa73e" containerName="manager"
Jul 30 02:37:40.028855 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.028834    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"
Jul 30 02:37:40.031421 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.031399    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 02:37:40.031511 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.031426    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 30 02:37:40.032442 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.032422    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 02:37:40.032523 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.032486    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5gcdd\""
Jul 30 02:37:40.037675 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.037655    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:37:40.079024 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.078995    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:37:40.187216 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.187184    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qp5k\" (UniqueName: \"kubernetes.io/projected/40ba0db8-c960-4b37-a78c-bbc4c938852f-kube-api-access-9qp5k\") pod \"limitador-limitador-54d6d988d5-xd9gs\" (UID: \"40ba0db8-c960-4b37-a78c-bbc4c938852f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"
Jul 30 02:37:40.187326 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.187221    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/40ba0db8-c960-4b37-a78c-bbc4c938852f-config-file\") pod \"limitador-limitador-54d6d988d5-xd9gs\" (UID: \"40ba0db8-c960-4b37-a78c-bbc4c938852f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"
Jul 30 02:37:40.287685 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.287615    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qp5k\" (UniqueName: \"kubernetes.io/projected/40ba0db8-c960-4b37-a78c-bbc4c938852f-kube-api-access-9qp5k\") pod \"limitador-limitador-54d6d988d5-xd9gs\" (UID: \"40ba0db8-c960-4b37-a78c-bbc4c938852f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"
Jul 30 02:37:40.287685 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.287654    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/40ba0db8-c960-4b37-a78c-bbc4c938852f-config-file\") pod \"limitador-limitador-54d6d988d5-xd9gs\" (UID: \"40ba0db8-c960-4b37-a78c-bbc4c938852f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"
Jul 30 02:37:40.288234 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.288216    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/40ba0db8-c960-4b37-a78c-bbc4c938852f-config-file\") pod \"limitador-limitador-54d6d988d5-xd9gs\" (UID: \"40ba0db8-c960-4b37-a78c-bbc4c938852f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"
Jul 30 02:37:40.296586 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.296566    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qp5k\" (UniqueName: \"kubernetes.io/projected/40ba0db8-c960-4b37-a78c-bbc4c938852f-kube-api-access-9qp5k\") pod \"limitador-limitador-54d6d988d5-xd9gs\" (UID: \"40ba0db8-c960-4b37-a78c-bbc4c938852f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"
Jul 30 02:37:40.340399 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.340367    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"
Jul 30 02:37:40.464117 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.464096    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:37:40.466136 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:37:40.466110    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ba0db8_c960_4b37_a78c_bbc4c938852f.slice/crio-62d1478503a65b6e9e288dabd012d34737eb8f679370d8507649dfc38aace203 WatchSource:0}: Error finding container 62d1478503a65b6e9e288dabd012d34737eb8f679370d8507649dfc38aace203: Status 404 returned error can't find the container with id 62d1478503a65b6e9e288dabd012d34737eb8f679370d8507649dfc38aace203
Jul 30 02:37:40.727397 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.727320    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-ck4xc"]
Jul 30 02:37:40.730470 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.730450    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ck4xc"
Jul 30 02:37:40.732905 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.732885    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kg85n\""
Jul 30 02:37:40.741429 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.741401    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ck4xc"]
Jul 30 02:37:40.791875 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.791841    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9k8s\" (UniqueName: \"kubernetes.io/projected/83053a9f-9706-4308-aa02-3d0fe96c6057-kube-api-access-s9k8s\") pod \"authorino-75d556bd77-ck4xc\" (UID: \"83053a9f-9706-4308-aa02-3d0fe96c6057\") " pod="kuadrant-system/authorino-75d556bd77-ck4xc"
Jul 30 02:37:40.893396 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.893362    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9k8s\" (UniqueName: \"kubernetes.io/projected/83053a9f-9706-4308-aa02-3d0fe96c6057-kube-api-access-s9k8s\") pod \"authorino-75d556bd77-ck4xc\" (UID: \"83053a9f-9706-4308-aa02-3d0fe96c6057\") " pod="kuadrant-system/authorino-75d556bd77-ck4xc"
Jul 30 02:37:40.903035 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:40.903010    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9k8s\" (UniqueName: \"kubernetes.io/projected/83053a9f-9706-4308-aa02-3d0fe96c6057-kube-api-access-s9k8s\") pod \"authorino-75d556bd77-ck4xc\" (UID: \"83053a9f-9706-4308-aa02-3d0fe96c6057\") " pod="kuadrant-system/authorino-75d556bd77-ck4xc"
Jul 30 02:37:41.040702 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:41.040374    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ck4xc"
Jul 30 02:37:41.221591 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:41.221558    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ck4xc"]
Jul 30 02:37:41.226584 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:37:41.226380    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83053a9f_9706_4308_aa02_3d0fe96c6057.slice/crio-de1bdb3f1625abd6f75f04cf5572c0ac517c3aee2db0c8e53165611a5f488731 WatchSource:0}: Error finding container de1bdb3f1625abd6f75f04cf5572c0ac517c3aee2db0c8e53165611a5f488731: Status 404 returned error can't find the container with id de1bdb3f1625abd6f75f04cf5572c0ac517c3aee2db0c8e53165611a5f488731
Jul 30 02:37:41.339888 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:41.339794    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ck4xc" event={"ID":"83053a9f-9706-4308-aa02-3d0fe96c6057","Type":"ContainerStarted","Data":"de1bdb3f1625abd6f75f04cf5572c0ac517c3aee2db0c8e53165611a5f488731"}
Jul 30 02:37:41.341130 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:41.341097    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xd9gs" event={"ID":"40ba0db8-c960-4b37-a78c-bbc4c938852f","Type":"ContainerStarted","Data":"62d1478503a65b6e9e288dabd012d34737eb8f679370d8507649dfc38aace203"}
Jul 30 02:37:43.354563 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:43.354507    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xd9gs" event={"ID":"40ba0db8-c960-4b37-a78c-bbc4c938852f","Type":"ContainerStarted","Data":"30cfa8c97ed7c6228e783173cd14756be949b10a72d3d1bfb0be038f4c27d2c4"}
Jul 30 02:37:43.355013 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:43.354706    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"
Jul 30 02:37:43.374030 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:43.373474    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-xd9gs" podStartSLOduration=0.879519482 podStartE2EDuration="3.373455713s" totalImagesPullingTime="2.493936231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:37:43.372592373 +0000 UTC m=+699.222905106" watchObservedRunningTime="2026-07-30 02:37:43.373455713 +0000 UTC m=+699.223768449"
Jul 30 02:37:45.365387 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:45.365349    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ck4xc" event={"ID":"83053a9f-9706-4308-aa02-3d0fe96c6057","Type":"ContainerStarted","Data":"4673c1aa3b323d32408fcdf3550ccf73fd686916497b9955ab3be3d4d4601fea"}
Jul 30 02:37:45.380019 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:45.379970    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-ck4xc" podStartSLOduration=1.379670078 podStartE2EDuration="5.379953124s" totalImagesPullingTime="4.000283046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:37:45.378726225 +0000 UTC m=+701.229038955" watchObservedRunningTime="2026-07-30 02:37:45.379953124 +0000 UTC m=+701.230265854"
Jul 30 02:37:54.360173 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:37:54.360141    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"
Jul 30 02:38:11.321286 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:11.321249    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9sfqc"]
Jul 30 02:38:11.325722 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:11.325701    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9sfqc"
Jul 30 02:38:11.330481 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:11.330457    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9sfqc"]
Jul 30 02:38:11.450894 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:11.450863    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl7q5\" (UniqueName: \"kubernetes.io/projected/0e64586c-cfb7-45e9-910f-3916f8770208-kube-api-access-zl7q5\") pod \"authorino-5d4b67c446-9sfqc\" (UID: \"0e64586c-cfb7-45e9-910f-3916f8770208\") " pod="kuadrant-system/authorino-5d4b67c446-9sfqc"
Jul 30 02:38:11.549886 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:11.549854    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9sfqc"]
Jul 30 02:38:11.550110 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:38:11.550090    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zl7q5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-9sfqc" podUID="0e64586c-cfb7-45e9-910f-3916f8770208"
Jul 30 02:38:11.552171 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:11.552150    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl7q5\" (UniqueName: \"kubernetes.io/projected/0e64586c-cfb7-45e9-910f-3916f8770208-kube-api-access-zl7q5\") pod \"authorino-5d4b67c446-9sfqc\" (UID: \"0e64586c-cfb7-45e9-910f-3916f8770208\") " pod="kuadrant-system/authorino-5d4b67c446-9sfqc"
Jul 30 02:38:11.564273 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:11.564247    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl7q5\" (UniqueName: \"kubernetes.io/projected/0e64586c-cfb7-45e9-910f-3916f8770208-kube-api-access-zl7q5\") pod \"authorino-5d4b67c446-9sfqc\" (UID: \"0e64586c-cfb7-45e9-910f-3916f8770208\") " pod="kuadrant-system/authorino-5d4b67c446-9sfqc"
Jul 30 02:38:12.483954 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:12.483925    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9sfqc"
Jul 30 02:38:12.495129 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:12.495106    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9sfqc"
Jul 30 02:38:12.661244 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:12.661215    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl7q5\" (UniqueName: \"kubernetes.io/projected/0e64586c-cfb7-45e9-910f-3916f8770208-kube-api-access-zl7q5\") pod \"0e64586c-cfb7-45e9-910f-3916f8770208\" (UID: \"0e64586c-cfb7-45e9-910f-3916f8770208\") "
Jul 30 02:38:12.663241 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:12.663217    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e64586c-cfb7-45e9-910f-3916f8770208-kube-api-access-zl7q5" (OuterVolumeSpecName: "kube-api-access-zl7q5") pod "0e64586c-cfb7-45e9-910f-3916f8770208" (UID: "0e64586c-cfb7-45e9-910f-3916f8770208"). InnerVolumeSpecName "kube-api-access-zl7q5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 02:38:12.762293 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:12.762267    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl7q5\" (UniqueName: \"kubernetes.io/projected/0e64586c-cfb7-45e9-910f-3916f8770208-kube-api-access-zl7q5\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:38:12.826421 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:12.826388    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ck4xc"]
Jul 30 02:38:12.826592 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:12.826569    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-ck4xc" podUID="83053a9f-9706-4308-aa02-3d0fe96c6057" containerName="authorino" containerID="cri-o://4673c1aa3b323d32408fcdf3550ccf73fd686916497b9955ab3be3d4d4601fea" gracePeriod=30
Jul 30 02:38:13.069961 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.069935    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ck4xc"
Jul 30 02:38:13.165175 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.165148    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9k8s\" (UniqueName: \"kubernetes.io/projected/83053a9f-9706-4308-aa02-3d0fe96c6057-kube-api-access-s9k8s\") pod \"83053a9f-9706-4308-aa02-3d0fe96c6057\" (UID: \"83053a9f-9706-4308-aa02-3d0fe96c6057\") "
Jul 30 02:38:13.167143 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.167116    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83053a9f-9706-4308-aa02-3d0fe96c6057-kube-api-access-s9k8s" (OuterVolumeSpecName: "kube-api-access-s9k8s") pod "83053a9f-9706-4308-aa02-3d0fe96c6057" (UID: "83053a9f-9706-4308-aa02-3d0fe96c6057"). InnerVolumeSpecName "kube-api-access-s9k8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 02:38:13.266710 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.266682    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9k8s\" (UniqueName: \"kubernetes.io/projected/83053a9f-9706-4308-aa02-3d0fe96c6057-kube-api-access-s9k8s\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:38:13.490125 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.490036    2554 generic.go:356] "Generic (PLEG): container finished" podID="83053a9f-9706-4308-aa02-3d0fe96c6057" containerID="4673c1aa3b323d32408fcdf3550ccf73fd686916497b9955ab3be3d4d4601fea" exitCode=0
Jul 30 02:38:13.490125 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.490083    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ck4xc"
Jul 30 02:38:13.490125 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.490100    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9sfqc"
Jul 30 02:38:13.490722 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.490120    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ck4xc" event={"ID":"83053a9f-9706-4308-aa02-3d0fe96c6057","Type":"ContainerDied","Data":"4673c1aa3b323d32408fcdf3550ccf73fd686916497b9955ab3be3d4d4601fea"}
Jul 30 02:38:13.490722 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.490164    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ck4xc" event={"ID":"83053a9f-9706-4308-aa02-3d0fe96c6057","Type":"ContainerDied","Data":"de1bdb3f1625abd6f75f04cf5572c0ac517c3aee2db0c8e53165611a5f488731"}
Jul 30 02:38:13.490722 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.490183    2554 scope.go:117] "RemoveContainer" containerID="4673c1aa3b323d32408fcdf3550ccf73fd686916497b9955ab3be3d4d4601fea"
Jul 30 02:38:13.499382 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.499361    2554 scope.go:117] "RemoveContainer" containerID="4673c1aa3b323d32408fcdf3550ccf73fd686916497b9955ab3be3d4d4601fea"
Jul 30 02:38:13.499673 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:38:13.499651    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4673c1aa3b323d32408fcdf3550ccf73fd686916497b9955ab3be3d4d4601fea\": container with ID starting with 4673c1aa3b323d32408fcdf3550ccf73fd686916497b9955ab3be3d4d4601fea not found: ID does not exist" containerID="4673c1aa3b323d32408fcdf3550ccf73fd686916497b9955ab3be3d4d4601fea"
Jul 30 02:38:13.499771 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.499681    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4673c1aa3b323d32408fcdf3550ccf73fd686916497b9955ab3be3d4d4601fea"} err="failed to get container status \"4673c1aa3b323d32408fcdf3550ccf73fd686916497b9955ab3be3d4d4601fea\": rpc error: code = NotFound desc = could not find container \"4673c1aa3b323d32408fcdf3550ccf73fd686916497b9955ab3be3d4d4601fea\": container with ID starting with 4673c1aa3b323d32408fcdf3550ccf73fd686916497b9955ab3be3d4d4601fea not found: ID does not exist"
Jul 30 02:38:13.526411 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.526381    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9sfqc"]
Jul 30 02:38:13.536380 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.536355    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9sfqc"]
Jul 30 02:38:13.549926 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.549896    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ck4xc"]
Jul 30 02:38:13.553919 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:13.553894    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ck4xc"]
Jul 30 02:38:14.640202 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:14.640171    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e64586c-cfb7-45e9-910f-3916f8770208" path="/var/lib/kubelet/pods/0e64586c-cfb7-45e9-910f-3916f8770208/volumes"
Jul 30 02:38:14.640574 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:14.640396    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83053a9f-9706-4308-aa02-3d0fe96c6057" path="/var/lib/kubelet/pods/83053a9f-9706-4308-aa02-3d0fe96c6057/volumes"
Jul 30 02:38:54.308473 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:38:54.308437    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:39:13.926853 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:13.926819    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:39:46.940464 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:46.940431    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:39:54.022019 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.021987    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"]
Jul 30 02:39:54.022435 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.022311    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83053a9f-9706-4308-aa02-3d0fe96c6057" containerName="authorino"
Jul 30 02:39:54.022435 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.022322    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="83053a9f-9706-4308-aa02-3d0fe96c6057" containerName="authorino"
Jul 30 02:39:54.022435 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.022393    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="83053a9f-9706-4308-aa02-3d0fe96c6057" containerName="authorino"
Jul 30 02:39:54.025419 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.025395    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.028694 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.028662    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2mqsd\""
Jul 30 02:39:54.028694 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.028677    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 30 02:39:54.028891 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.028688    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 02:39:54.028891 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.028717    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 02:39:54.036429 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.036405    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"]
Jul 30 02:39:54.155561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.155517    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.155690 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.155571    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.155690 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.155601    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jxrw\" (UniqueName: \"kubernetes.io/projected/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-kube-api-access-2jxrw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.155690 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.155632    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.155690 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.155664    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.155825 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.155714    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.256959 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.256934    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.257084 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.256968    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jxrw\" (UniqueName: \"kubernetes.io/projected/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-kube-api-access-2jxrw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.257084 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.256991    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.257193 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.257175    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.257245 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.257226    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.257324 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.257308    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.257432 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.257411    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.257533 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.257516    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.257671 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.257655    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.259263 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.259246    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.259575 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.259540    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.264444 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.264423    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jxrw\" (UniqueName: \"kubernetes.io/projected/f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b-kube-api-access-2jxrw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l6scg\" (UID: \"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.336050 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.335995    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:39:54.469237 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.469213    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"]
Jul 30 02:39:54.471200 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:39:54.471171    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ad2305_6ad0_4fd8_b5b4_c218914d8f4b.slice/crio-b8c94eb08fcdfdc42721a5ada201073118f3252786d5e396895b086e7d9ed184 WatchSource:0}: Error finding container b8c94eb08fcdfdc42721a5ada201073118f3252786d5e396895b086e7d9ed184: Status 404 returned error can't find the container with id b8c94eb08fcdfdc42721a5ada201073118f3252786d5e396895b086e7d9ed184
Jul 30 02:39:54.931983 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:54.931945    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg" event={"ID":"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b","Type":"ContainerStarted","Data":"b8c94eb08fcdfdc42721a5ada201073118f3252786d5e396895b086e7d9ed184"}
Jul 30 02:39:55.236522 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:55.236439    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:39:55.937764 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:55.937671    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg" event={"ID":"f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b","Type":"ContainerStarted","Data":"88741e36de2f8238ca833d1b86d1e779c627653bba0ae8811ae71fd49d35fb31"}
Jul 30 02:39:55.954596 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:39:55.954524    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg" podStartSLOduration=0.959082625 podStartE2EDuration="1.954484765s" totalImagesPullingTime="995.40214ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:39:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:39:55.953177942 +0000 UTC m=+831.803490693" watchObservedRunningTime="2026-07-30 02:39:55.954484765 +0000 UTC m=+831.804797474"
Jul 30 02:40:04.336235 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:04.336198    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:40:04.336709 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:04.336294    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:40:04.348561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:04.348524    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:40:04.988682 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:04.988649    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l6scg"
Jul 30 02:40:08.033639 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:08.033604    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:40:25.941011 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:25.940972    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:40:41.220858 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.220823    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"]
Jul 30 02:40:41.224334 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.224311    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.226944 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.226923    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 30 02:40:41.235953 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.235927    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"]
Jul 30 02:40:41.354819 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.354778    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.354819 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.354826    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.355044 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.354907    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.355044 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.354939    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.355044 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.354970    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9ct9\" (UniqueName: \"kubernetes.io/projected/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-kube-api-access-p9ct9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.355156 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.355052    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.456067 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.456026    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.456067 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.456071    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.456293 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.456096    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.456293 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.456133    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.456293 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.456150    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.456293 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.456175    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9ct9\" (UniqueName: \"kubernetes.io/projected/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-kube-api-access-p9ct9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.456622 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.456591    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.456745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.456630    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.456745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.456648    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.458510 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.458490    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.458728 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.458704    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.465350 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.465330    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9ct9\" (UniqueName: \"kubernetes.io/projected/7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a-kube-api-access-p9ct9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9\" (UID: \"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.535493 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.535455    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:41.682724 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:41.682701    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"]
Jul 30 02:40:41.685501 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:40:41.685472    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f9ffb4e_bc64_4f1c_8b59_542c3ba51c0a.slice/crio-817b264f193e24cb2921962b31ceace948924252acb245d9ed697395c4f707ad WatchSource:0}: Error finding container 817b264f193e24cb2921962b31ceace948924252acb245d9ed697395c4f707ad: Status 404 returned error can't find the container with id 817b264f193e24cb2921962b31ceace948924252acb245d9ed697395c4f707ad
Jul 30 02:40:42.142007 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:42.141920    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9" event={"ID":"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a","Type":"ContainerStarted","Data":"e06022c51c212ba8aebb738614b9e0e63641636df24c965f52987c6b0d128eab"}
Jul 30 02:40:42.142007 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:42.141971    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9" event={"ID":"7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a","Type":"ContainerStarted","Data":"817b264f193e24cb2921962b31ceace948924252acb245d9ed697395c4f707ad"}
Jul 30 02:40:42.158441 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:42.158393    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9" podStartSLOduration=0.977636716 podStartE2EDuration="1.158378159s" totalImagesPullingTime="180.741443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:40:42.157520391 +0000 UTC m=+878.007833122" watchObservedRunningTime="2026-07-30 02:40:42.158378159 +0000 UTC m=+878.008690930"
Jul 30 02:40:43.837446 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:43.837406    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:40:51.536101 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:51.536067    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:51.536592 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:51.536166    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:51.548379 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:51.548360    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:40:52.200443 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:40:52.200417    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9"
Jul 30 02:41:04.560884 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:04.560851    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:41:04.563779 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:04.563755    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:41:04.564741 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:04.564722    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:41:04.567707 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:04.567687    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:41:38.568004 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:38.567967    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84f55fffc7-mxgtx"]
Jul 30 02:41:38.571176 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:38.571158    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84f55fffc7-mxgtx"
Jul 30 02:41:38.574522 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:38.574478    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 30 02:41:38.574660 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:38.574525    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kg85n\""
Jul 30 02:41:38.575939 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:38.575919    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84f55fffc7-mxgtx"]
Jul 30 02:41:38.656074 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:38.656033    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6c75e8c7-52c4-4f11-acf7-d7238b052a73-tls-cert\") pod \"authorino-84f55fffc7-mxgtx\" (UID: \"6c75e8c7-52c4-4f11-acf7-d7238b052a73\") " pod="kuadrant-system/authorino-84f55fffc7-mxgtx"
Jul 30 02:41:38.656244 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:38.656155    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8p59\" (UniqueName: \"kubernetes.io/projected/6c75e8c7-52c4-4f11-acf7-d7238b052a73-kube-api-access-l8p59\") pod \"authorino-84f55fffc7-mxgtx\" (UID: \"6c75e8c7-52c4-4f11-acf7-d7238b052a73\") " pod="kuadrant-system/authorino-84f55fffc7-mxgtx"
Jul 30 02:41:38.756880 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:38.756845    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6c75e8c7-52c4-4f11-acf7-d7238b052a73-tls-cert\") pod \"authorino-84f55fffc7-mxgtx\" (UID: \"6c75e8c7-52c4-4f11-acf7-d7238b052a73\") " pod="kuadrant-system/authorino-84f55fffc7-mxgtx"
Jul 30 02:41:38.757113 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:38.756961    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8p59\" (UniqueName: \"kubernetes.io/projected/6c75e8c7-52c4-4f11-acf7-d7238b052a73-kube-api-access-l8p59\") pod \"authorino-84f55fffc7-mxgtx\" (UID: \"6c75e8c7-52c4-4f11-acf7-d7238b052a73\") " pod="kuadrant-system/authorino-84f55fffc7-mxgtx"
Jul 30 02:41:38.759430 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:38.759403    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6c75e8c7-52c4-4f11-acf7-d7238b052a73-tls-cert\") pod \"authorino-84f55fffc7-mxgtx\" (UID: \"6c75e8c7-52c4-4f11-acf7-d7238b052a73\") " pod="kuadrant-system/authorino-84f55fffc7-mxgtx"
Jul 30 02:41:38.764758 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:38.764735    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8p59\" (UniqueName: \"kubernetes.io/projected/6c75e8c7-52c4-4f11-acf7-d7238b052a73-kube-api-access-l8p59\") pod \"authorino-84f55fffc7-mxgtx\" (UID: \"6c75e8c7-52c4-4f11-acf7-d7238b052a73\") " pod="kuadrant-system/authorino-84f55fffc7-mxgtx"
Jul 30 02:41:38.881374 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:38.881290    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84f55fffc7-mxgtx"
Jul 30 02:41:39.011578 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:39.011532    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84f55fffc7-mxgtx"]
Jul 30 02:41:39.013872 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:41:39.013845    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c75e8c7_52c4_4f11_acf7_d7238b052a73.slice/crio-054f7c94c05ea11b31da5367c614668283ab8f615c2582fcc1ff1556ccc75e92 WatchSource:0}: Error finding container 054f7c94c05ea11b31da5367c614668283ab8f615c2582fcc1ff1556ccc75e92: Status 404 returned error can't find the container with id 054f7c94c05ea11b31da5367c614668283ab8f615c2582fcc1ff1556ccc75e92
Jul 30 02:41:39.402160 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:39.402121    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84f55fffc7-mxgtx" event={"ID":"6c75e8c7-52c4-4f11-acf7-d7238b052a73","Type":"ContainerStarted","Data":"054f7c94c05ea11b31da5367c614668283ab8f615c2582fcc1ff1556ccc75e92"}
Jul 30 02:41:40.408361 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:40.408326    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84f55fffc7-mxgtx" event={"ID":"6c75e8c7-52c4-4f11-acf7-d7238b052a73","Type":"ContainerStarted","Data":"c139cb4fce7bba60619b03a43e91b0f32646124e5e1cab08b8538a6f175353b4"}
Jul 30 02:41:40.425878 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:41:40.425821    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-84f55fffc7-mxgtx" podStartSLOduration=1.9910378899999999 podStartE2EDuration="2.425802851s" totalImagesPullingTime="434.764961ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:41:40.424574449 +0000 UTC m=+936.274887203" watchObservedRunningTime="2026-07-30 02:41:40.425802851 +0000 UTC m=+936.276115583"
Jul 30 02:42:10.729968 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:42:10.729931    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:42:20.227305 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:42:20.227273    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:42:31.536148 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:42:31.536111    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:44:12.737730 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:44:12.737652    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:44:22.635003 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:44:22.634966    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:44:51.123870 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:44:51.123836    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:45:00.934245 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:45:00.934210    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:45:10.729759 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:45:10.729721    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:45:19.732413 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:45:19.732378    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:45:30.840572 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:45:30.840509    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:45:41.727902 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:45:41.727859    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:45:52.225804 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:45:52.225760    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:46:01.731466 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:46:01.731431    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:46:04.589956 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:46:04.589930    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:46:04.593152 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:46:04.593128    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:46:04.593837 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:46:04.593814    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:46:04.596803 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:46:04.596788    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:46:24.633866 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:46:24.633830    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:46:36.226339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:46:36.226301    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:46:59.929078 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:46:59.928998    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:47:10.727224 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:47:10.727187    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:47:21.342320 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:47:21.342284    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:47:39.651561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:47:39.651525    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:47:48.929591 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:47:48.929559    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:47:58.641271 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:47:58.641238    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:48:08.346380 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:48:08.346343    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:48:17.550561 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:48:17.550522    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:50:25.630214 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:50:25.630176    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:50:34.537937 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:50:34.537898    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:50:44.740688 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:50:44.740649    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:50:58.626437 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:50:58.626396    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:51:04.617611 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:51:04.617584    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:51:04.620897 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:51:04.620872    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:51:04.621265 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:51:04.621247    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:51:04.624646 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:51:04.624628    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:51:07.727083 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:51:07.727045    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:51:17.530292 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:51:17.530254    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:51:27.134663 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:51:27.134587    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:51:35.232977 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:51:35.232939    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:51:46.230217 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:51:46.230184    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:51:57.156097 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:51:57.156061    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:52:05.833430 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:05.833398    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:52:16.533519 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:16.533485    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:52:40.735699 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:40.735665    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:52:46.442785 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.442749    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"]
Jul 30 02:52:46.446020 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.446004    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.448212 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.448191    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-c92912f9-kserve-self-signed-certs\""
Jul 30 02:52:46.462712 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.462689    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"]
Jul 30 02:52:46.570076 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.570044    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6467\" (UniqueName: \"kubernetes.io/projected/15191942-53b8-4842-b699-94aa2cd7e843-kube-api-access-v6467\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.570222 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.570083    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-model-cache\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.570222 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.570114    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-dshm\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.570222 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.570166    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-home\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.570222 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.570180    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15191942-53b8-4842-b699-94aa2cd7e843-tls-certs\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.570222 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.570197    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-tmp-dir\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.670692 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.670665    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6467\" (UniqueName: \"kubernetes.io/projected/15191942-53b8-4842-b699-94aa2cd7e843-kube-api-access-v6467\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.670854 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.670701    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-model-cache\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.670854 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.670725    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-dshm\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.670854 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.670754    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-home\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.670854 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.670774    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15191942-53b8-4842-b699-94aa2cd7e843-tls-certs\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.670854 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.670794    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-tmp-dir\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.671107 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.671078    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-model-cache\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.671188 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.671166    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-tmp-dir\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.671227 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.671195    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-home\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.672991 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.672973    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-dshm\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.673258 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.673241    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15191942-53b8-4842-b699-94aa2cd7e843-tls-certs\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.680070 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.680045    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6467\" (UniqueName: \"kubernetes.io/projected/15191942-53b8-4842-b699-94aa2cd7e843-kube-api-access-v6467\") pod \"e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") " pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.754888 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.754866    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:46.887478 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:46.887455    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"]
Jul 30 02:52:46.890042 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:52:46.890010    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15191942_53b8_4842_b699_94aa2cd7e843.slice/crio-e7d6d0905a5db0a210cf62d5fe03492b1b01f70d747c0488fef5c3f11d5397a7 WatchSource:0}: Error finding container e7d6d0905a5db0a210cf62d5fe03492b1b01f70d747c0488fef5c3f11d5397a7: Status 404 returned error can't find the container with id e7d6d0905a5db0a210cf62d5fe03492b1b01f70d747c0488fef5c3f11d5397a7
Jul 30 02:52:47.512716 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:47.512675    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh" event={"ID":"15191942-53b8-4842-b699-94aa2cd7e843","Type":"ContainerStarted","Data":"3b849bb3cbc45795e14396b045d0d42107e3e3a04cd48fd8147007fa775504b7"}
Jul 30 02:52:47.512716 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:47.512719    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh" event={"ID":"15191942-53b8-4842-b699-94aa2cd7e843","Type":"ContainerStarted","Data":"e7d6d0905a5db0a210cf62d5fe03492b1b01f70d747c0488fef5c3f11d5397a7"}
Jul 30 02:52:47.530409 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:47.530362    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh" podStartSLOduration=1.530347796 podStartE2EDuration="1.530347796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:52:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:52:47.527831302 +0000 UTC m=+1603.378144033" watchObservedRunningTime="2026-07-30 02:52:47.530347796 +0000 UTC m=+1603.380660562"
Jul 30 02:52:49.637026 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:49.636988    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:52:56.755760 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:56.755732    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:56.756110 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:56.755777    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:56.768011 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:56.767991    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:52:57.567827 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:52:57.567797    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:53:11.531303 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.531271    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"]
Jul 30 02:53:11.534595 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.534574    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.537844 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.537821    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-c92912f9-kserve-self-signed-certs\""
Jul 30 02:53:11.548846 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.548822    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"]
Jul 30 02:53:11.575013 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.574982    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-home\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.575013 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.575009    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-model-cache\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.575204 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.575027    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-tmp-dir\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.575204 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.575099    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-tls-certs\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.575204 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.575177    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-dshm\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.575351 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.575214    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6h76\" (UniqueName: \"kubernetes.io/projected/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-kube-api-access-r6h76\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.676508 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.676482    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-home\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.676508 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.676509    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-model-cache\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.676823 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.676529    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-tmp-dir\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.676823 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.676571    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-tls-certs\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.676823 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.676589    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-dshm\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.676823 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.676606    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6h76\" (UniqueName: \"kubernetes.io/projected/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-kube-api-access-r6h76\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.677020 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.676910    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-tmp-dir\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.677020 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.676954    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-model-cache\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.677020 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.676992    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-home\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.678850 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.678827    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-dshm\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.679007 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.678992    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-tls-certs\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.683607 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.683590    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6h76\" (UniqueName: \"kubernetes.io/projected/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-kube-api-access-r6h76\") pod \"e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") " pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.844412 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.844333    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:11.973037 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:11.972914    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"]
Jul 30 02:53:11.975470 ip-10-0-136-75 kubenswrapper[2554]: W0730 02:53:11.975442    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a2c898c_5cc8_472b_a0c5_e938935ab6f6.slice/crio-866518592ff3edaef8dac859517bf2a3037586164f3ad30ddf5c4062ca6b49d3 WatchSource:0}: Error finding container 866518592ff3edaef8dac859517bf2a3037586164f3ad30ddf5c4062ca6b49d3: Status 404 returned error can't find the container with id 866518592ff3edaef8dac859517bf2a3037586164f3ad30ddf5c4062ca6b49d3
Jul 30 02:53:12.627153 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:12.627112    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz" event={"ID":"9a2c898c-5cc8-472b-a0c5-e938935ab6f6","Type":"ContainerStarted","Data":"319af63f3262df4734fa57f74685024fa7b52c5cc632b0929e6ae60c11984760"}
Jul 30 02:53:12.627153 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:12.627159    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz" event={"ID":"9a2c898c-5cc8-472b-a0c5-e938935ab6f6","Type":"ContainerStarted","Data":"866518592ff3edaef8dac859517bf2a3037586164f3ad30ddf5c4062ca6b49d3"}
Jul 30 02:53:12.644442 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:12.644397    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz" podStartSLOduration=1.644382377 podStartE2EDuration="1.644382377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 02:53:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 02:53:12.641835309 +0000 UTC m=+1628.492148034" watchObservedRunningTime="2026-07-30 02:53:12.644382377 +0000 UTC m=+1628.494695124"
Jul 30 02:53:14.936709 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:14.936675    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:53:21.845262 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:21.845223    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:21.845262 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:21.845267    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:21.857726 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:21.857701    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:22.688690 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:22.688662    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:53:47.911621 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:47.911584    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"]
Jul 30 02:53:49.254888 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:49.254853    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"]
Jul 30 02:53:51.845723 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:53:51.845687    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:54:02.930844 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:02.930807    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh" podUID="15191942-53b8-4842-b699-94aa2cd7e843" containerName="main" containerID="cri-o://3b849bb3cbc45795e14396b045d0d42107e3e3a04cd48fd8147007fa775504b7" gracePeriod=45
Jul 30 02:54:03.184745 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.184685    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:54:03.312393 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.312366    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15191942-53b8-4842-b699-94aa2cd7e843-tls-certs\") pod \"15191942-53b8-4842-b699-94aa2cd7e843\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") "
Jul 30 02:54:03.312592 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.312420    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-tmp-dir\") pod \"15191942-53b8-4842-b699-94aa2cd7e843\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") "
Jul 30 02:54:03.312592 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.312455    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-dshm\") pod \"15191942-53b8-4842-b699-94aa2cd7e843\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") "
Jul 30 02:54:03.312592 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.312475    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-home\") pod \"15191942-53b8-4842-b699-94aa2cd7e843\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") "
Jul 30 02:54:03.312592 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.312527    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-model-cache\") pod \"15191942-53b8-4842-b699-94aa2cd7e843\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") "
Jul 30 02:54:03.312812 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.312600    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6467\" (UniqueName: \"kubernetes.io/projected/15191942-53b8-4842-b699-94aa2cd7e843-kube-api-access-v6467\") pod \"15191942-53b8-4842-b699-94aa2cd7e843\" (UID: \"15191942-53b8-4842-b699-94aa2cd7e843\") "
Jul 30 02:54:03.312812 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.312768    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-home" (OuterVolumeSpecName: "home") pod "15191942-53b8-4842-b699-94aa2cd7e843" (UID: "15191942-53b8-4842-b699-94aa2cd7e843"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 02:54:03.312812 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.312780    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "15191942-53b8-4842-b699-94aa2cd7e843" (UID: "15191942-53b8-4842-b699-94aa2cd7e843"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 02:54:03.312925 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.312873    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-model-cache" (OuterVolumeSpecName: "model-cache") pod "15191942-53b8-4842-b699-94aa2cd7e843" (UID: "15191942-53b8-4842-b699-94aa2cd7e843"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 02:54:03.312966 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.312940    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-tmp-dir\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:54:03.312966 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.312954    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-home\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:54:03.314815 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.314789    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15191942-53b8-4842-b699-94aa2cd7e843-kube-api-access-v6467" (OuterVolumeSpecName: "kube-api-access-v6467") pod "15191942-53b8-4842-b699-94aa2cd7e843" (UID: "15191942-53b8-4842-b699-94aa2cd7e843"). InnerVolumeSpecName "kube-api-access-v6467". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 02:54:03.314898 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.314876    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-dshm" (OuterVolumeSpecName: "dshm") pod "15191942-53b8-4842-b699-94aa2cd7e843" (UID: "15191942-53b8-4842-b699-94aa2cd7e843"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 02:54:03.314941 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.314923    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15191942-53b8-4842-b699-94aa2cd7e843-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "15191942-53b8-4842-b699-94aa2cd7e843" (UID: "15191942-53b8-4842-b699-94aa2cd7e843"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 02:54:03.413713 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.413682    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-model-cache\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:54:03.413713 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.413707    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6467\" (UniqueName: \"kubernetes.io/projected/15191942-53b8-4842-b699-94aa2cd7e843-kube-api-access-v6467\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:54:03.413713 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.413718    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15191942-53b8-4842-b699-94aa2cd7e843-tls-certs\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:54:03.413912 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.413728    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15191942-53b8-4842-b699-94aa2cd7e843-dshm\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:54:03.870294 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.870255    2554 generic.go:356] "Generic (PLEG): container finished" podID="15191942-53b8-4842-b699-94aa2cd7e843" containerID="3b849bb3cbc45795e14396b045d0d42107e3e3a04cd48fd8147007fa775504b7" exitCode=0
Jul 30 02:54:03.870475 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.870303    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"
Jul 30 02:54:03.870475 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.870337    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh" event={"ID":"15191942-53b8-4842-b699-94aa2cd7e843","Type":"ContainerDied","Data":"3b849bb3cbc45795e14396b045d0d42107e3e3a04cd48fd8147007fa775504b7"}
Jul 30 02:54:03.870475 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.870385    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh" event={"ID":"15191942-53b8-4842-b699-94aa2cd7e843","Type":"ContainerDied","Data":"e7d6d0905a5db0a210cf62d5fe03492b1b01f70d747c0488fef5c3f11d5397a7"}
Jul 30 02:54:03.870475 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.870407    2554 scope.go:117] "RemoveContainer" containerID="3b849bb3cbc45795e14396b045d0d42107e3e3a04cd48fd8147007fa775504b7"
Jul 30 02:54:03.880113 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.880098    2554 scope.go:117] "RemoveContainer" containerID="3b849bb3cbc45795e14396b045d0d42107e3e3a04cd48fd8147007fa775504b7"
Jul 30 02:54:03.880402 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:54:03.880383    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b849bb3cbc45795e14396b045d0d42107e3e3a04cd48fd8147007fa775504b7\": container with ID starting with 3b849bb3cbc45795e14396b045d0d42107e3e3a04cd48fd8147007fa775504b7 not found: ID does not exist" containerID="3b849bb3cbc45795e14396b045d0d42107e3e3a04cd48fd8147007fa775504b7"
Jul 30 02:54:03.880446 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.880410    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b849bb3cbc45795e14396b045d0d42107e3e3a04cd48fd8147007fa775504b7"} err="failed to get container status \"3b849bb3cbc45795e14396b045d0d42107e3e3a04cd48fd8147007fa775504b7\": rpc error: code = NotFound desc = could not find container \"3b849bb3cbc45795e14396b045d0d42107e3e3a04cd48fd8147007fa775504b7\": container with ID starting with 3b849bb3cbc45795e14396b045d0d42107e3e3a04cd48fd8147007fa775504b7 not found: ID does not exist"
Jul 30 02:54:03.893362 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.893341    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"]
Jul 30 02:54:03.900177 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:03.900158    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-c92912f9-kserve-5bd56b57dc-27wwh"]
Jul 30 02:54:04.273659 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.273623    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz" podUID="9a2c898c-5cc8-472b-a0c5-e938935ab6f6" containerName="main" containerID="cri-o://319af63f3262df4734fa57f74685024fa7b52c5cc632b0929e6ae60c11984760" gracePeriod=45
Jul 30 02:54:04.441233 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.441204    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:54:04.518752 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.518731    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:54:04.626095 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.626016    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-model-cache\") pod \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") "
Jul 30 02:54:04.626241 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.626117    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6h76\" (UniqueName: \"kubernetes.io/projected/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-kube-api-access-r6h76\") pod \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") "
Jul 30 02:54:04.626241 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.626162    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-tmp-dir\") pod \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") "
Jul 30 02:54:04.626241 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.626185    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-home\") pod \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") "
Jul 30 02:54:04.626241 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.626201    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-dshm\") pod \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") "
Jul 30 02:54:04.626455 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.626269    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-tls-certs\") pod \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\" (UID: \"9a2c898c-5cc8-472b-a0c5-e938935ab6f6\") "
Jul 30 02:54:04.626455 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.626273    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "9a2c898c-5cc8-472b-a0c5-e938935ab6f6" (UID: "9a2c898c-5cc8-472b-a0c5-e938935ab6f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 02:54:04.626582 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.626451    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9a2c898c-5cc8-472b-a0c5-e938935ab6f6" (UID: "9a2c898c-5cc8-472b-a0c5-e938935ab6f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 02:54:04.626582 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.626470    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-home" (OuterVolumeSpecName: "home") pod "9a2c898c-5cc8-472b-a0c5-e938935ab6f6" (UID: "9a2c898c-5cc8-472b-a0c5-e938935ab6f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 02:54:04.626696 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.626677    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-model-cache\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:54:04.626749 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.626702    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-tmp-dir\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:54:04.626749 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.626716    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-home\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:54:04.628298 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.628272    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9a2c898c-5cc8-472b-a0c5-e938935ab6f6" (UID: "9a2c898c-5cc8-472b-a0c5-e938935ab6f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 02:54:04.628432 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.628414    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-kube-api-access-r6h76" (OuterVolumeSpecName: "kube-api-access-r6h76") pod "9a2c898c-5cc8-472b-a0c5-e938935ab6f6" (UID: "9a2c898c-5cc8-472b-a0c5-e938935ab6f6"). InnerVolumeSpecName "kube-api-access-r6h76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 02:54:04.628501 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.628478    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-dshm" (OuterVolumeSpecName: "dshm") pod "9a2c898c-5cc8-472b-a0c5-e938935ab6f6" (UID: "9a2c898c-5cc8-472b-a0c5-e938935ab6f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 02:54:04.640780 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.640757    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15191942-53b8-4842-b699-94aa2cd7e843" path="/var/lib/kubelet/pods/15191942-53b8-4842-b699-94aa2cd7e843/volumes"
Jul 30 02:54:04.727292 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.727264    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6h76\" (UniqueName: \"kubernetes.io/projected/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-kube-api-access-r6h76\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:54:04.727292 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.727290    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-dshm\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:54:04.727420 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.727300    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a2c898c-5cc8-472b-a0c5-e938935ab6f6-tls-certs\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 02:54:04.876037 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.876006    2554 generic.go:356] "Generic (PLEG): container finished" podID="9a2c898c-5cc8-472b-a0c5-e938935ab6f6" containerID="319af63f3262df4734fa57f74685024fa7b52c5cc632b0929e6ae60c11984760" exitCode=0
Jul 30 02:54:04.876188 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.876047    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"
Jul 30 02:54:04.876188 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.876096    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz" event={"ID":"9a2c898c-5cc8-472b-a0c5-e938935ab6f6","Type":"ContainerDied","Data":"319af63f3262df4734fa57f74685024fa7b52c5cc632b0929e6ae60c11984760"}
Jul 30 02:54:04.876188 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.876134    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz" event={"ID":"9a2c898c-5cc8-472b-a0c5-e938935ab6f6","Type":"ContainerDied","Data":"866518592ff3edaef8dac859517bf2a3037586164f3ad30ddf5c4062ca6b49d3"}
Jul 30 02:54:04.876188 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.876155    2554 scope.go:117] "RemoveContainer" containerID="319af63f3262df4734fa57f74685024fa7b52c5cc632b0929e6ae60c11984760"
Jul 30 02:54:04.884026 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.884007    2554 scope.go:117] "RemoveContainer" containerID="319af63f3262df4734fa57f74685024fa7b52c5cc632b0929e6ae60c11984760"
Jul 30 02:54:04.884285 ip-10-0-136-75 kubenswrapper[2554]: E0730 02:54:04.884265    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"319af63f3262df4734fa57f74685024fa7b52c5cc632b0929e6ae60c11984760\": container with ID starting with 319af63f3262df4734fa57f74685024fa7b52c5cc632b0929e6ae60c11984760 not found: ID does not exist" containerID="319af63f3262df4734fa57f74685024fa7b52c5cc632b0929e6ae60c11984760"
Jul 30 02:54:04.884338 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.884293    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"319af63f3262df4734fa57f74685024fa7b52c5cc632b0929e6ae60c11984760"} err="failed to get container status \"319af63f3262df4734fa57f74685024fa7b52c5cc632b0929e6ae60c11984760\": rpc error: code = NotFound desc = could not find container \"319af63f3262df4734fa57f74685024fa7b52c5cc632b0929e6ae60c11984760\": container with ID starting with 319af63f3262df4734fa57f74685024fa7b52c5cc632b0929e6ae60c11984760 not found: ID does not exist"
Jul 30 02:54:04.895643 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.895621    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"]
Jul 30 02:54:04.899339 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:04.899315    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-c92912f9-kserve-678b98c5ff-9xngz"]
Jul 30 02:54:06.641579 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:06.641523    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a2c898c-5cc8-472b-a0c5-e938935ab6f6" path="/var/lib/kubelet/pods/9a2c898c-5cc8-472b-a0c5-e938935ab6f6/volumes"
Jul 30 02:54:11.334429 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:11.334394    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:54:27.231637 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:27.231525    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:54:41.436014 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:41.435976    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:54:50.826612 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:54:50.826574    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:55:04.331889 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:55:04.331853    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:55:13.925721 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:55:13.925684    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:55:26.930335 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:55:26.930291    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:55:35.835690 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:55:35.835654    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:55:45.934281 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:55:45.934240    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:55:55.326979 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:55:55.326942    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:56:04.652852 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:56:04.652823    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:56:04.656163 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:56:04.656129    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 02:56:04.656826 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:56:04.656806    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:56:04.659845 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:56:04.659828    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 02:56:08.729965 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:56:08.729928    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:56:17.933926 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:56:17.933886    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:56:29.647018 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:56:29.646978    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:56:41.537807 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:56:41.537760    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:56:52.033445 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:56:52.033407    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:57:01.535526 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:57:01.535487    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:57:10.732360 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:57:10.732319    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:57:32.340874 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:57:32.340836    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:57:48.129879 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:57:48.129842    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:58:19.431567 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:58:19.431514    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:58:33.328822 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:58:33.328781    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:59:03.429022 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:59:03.428940    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:59:15.534912 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:59:15.534875    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:59:32.334517 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:59:32.334475    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 02:59:45.831604 ip-10-0-136-75 kubenswrapper[2554]: I0730 02:59:45.831565    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:00:16.544193 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:00:16.544155    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:01:04.679264 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:01:04.679230    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 03:01:04.683345 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:01:04.683320    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 03:01:04.684161 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:01:04.684140    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 03:01:04.688103 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:01:04.688086    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 03:01:44.721901 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:01:44.721862    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:01:55.123949 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:01:55.123911    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:02:08.626728 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:02:08.626696    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:02:22.821528 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:02:22.821485    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:02:53.729781 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:02:53.729733    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:04:39.581380 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:39.581343    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:04:52.033943 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:52.033908    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:04:57.631075 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.630991    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"]
Jul 30 03:04:57.631592 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.631538    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15191942-53b8-4842-b699-94aa2cd7e843" containerName="main"
Jul 30 03:04:57.631592 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.631578    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="15191942-53b8-4842-b699-94aa2cd7e843" containerName="main"
Jul 30 03:04:57.631732 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.631601    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2c898c-5cc8-472b-a0c5-e938935ab6f6" containerName="main"
Jul 30 03:04:57.631732 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.631610    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2c898c-5cc8-472b-a0c5-e938935ab6f6" containerName="main"
Jul 30 03:04:57.631732 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.631718    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="15191942-53b8-4842-b699-94aa2cd7e843" containerName="main"
Jul 30 03:04:57.631885 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.631736    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a2c898c-5cc8-472b-a0c5-e938935ab6f6" containerName="main"
Jul 30 03:04:57.635284 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.635261    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.638046 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.638016    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-adb22f94\"/\"kube-root-ca.crt\""
Jul 30 03:04:57.639114 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.639093    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-adb22f94\"/\"default-dockercfg-txx8k\""
Jul 30 03:04:57.639198 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.639093    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-adb22f94\"/\"e2e-lifecycle-model-adb22f94-kserve-self-signed-certs\""
Jul 30 03:04:57.639198 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.639104    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-adb22f94\"/\"openshift-service-ca.crt\""
Jul 30 03:04:57.646829 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.646804    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"]
Jul 30 03:04:57.767860 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.767828    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-tls-certs\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.768005 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.767867    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjslq\" (UniqueName: \"kubernetes.io/projected/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-kube-api-access-fjslq\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.768005 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.767896    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-dshm\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.768099 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.767995    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-tmp-dir\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.768099 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.768039    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-model-cache\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.768099 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.768071    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-home\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.868671 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.868643    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-tls-certs\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.868801 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.868678    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjslq\" (UniqueName: \"kubernetes.io/projected/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-kube-api-access-fjslq\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.868801 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.868698    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-dshm\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.868801 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.868763    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-tmp-dir\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.868801 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.868797    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-model-cache\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.868992 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.868834    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-home\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.869216 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.869197    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-home\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.869301 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.869244    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-tmp-dir\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.869301 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.869273    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-model-cache\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.870938 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.870915    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-dshm\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.871192 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.871175    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-tls-certs\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.876678 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.876658    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjslq\" (UniqueName: \"kubernetes.io/projected/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-kube-api-access-fjslq\") pod \"e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") " pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:57.944514 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:57.944455    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:04:58.089789 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:58.089756    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"]
Jul 30 03:04:58.091534 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:04:58.091506    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbc55e77_ba0b_411d_aebc_4713e3c4fdf4.slice/crio-9ec8683d170b8fa5839aa8b01b7b210d6aa51505b02ff55e4faf0b036ed7883b WatchSource:0}: Error finding container 9ec8683d170b8fa5839aa8b01b7b210d6aa51505b02ff55e4faf0b036ed7883b: Status 404 returned error can't find the container with id 9ec8683d170b8fa5839aa8b01b7b210d6aa51505b02ff55e4faf0b036ed7883b
Jul 30 03:04:58.860876 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:58.860841    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9" event={"ID":"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4","Type":"ContainerStarted","Data":"5ea03a0af1ac3a156b8fd4c1a70cb6a76d956d82e0aeaaf0c710966d08c83287"}
Jul 30 03:04:58.861343 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:58.860883    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9" event={"ID":"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4","Type":"ContainerStarted","Data":"9ec8683d170b8fa5839aa8b01b7b210d6aa51505b02ff55e4faf0b036ed7883b"}
Jul 30 03:04:58.879072 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:04:58.879025    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9" podStartSLOduration=1.879012224 podStartE2EDuration="1.879012224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:04:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:04:58.877006963 +0000 UTC m=+2334.727319693" watchObservedRunningTime="2026-07-30 03:04:58.879012224 +0000 UTC m=+2334.729324957"
Jul 30 03:05:02.044756 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:05:02.044725    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:05:07.945324 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:05:07.945288    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:05:07.945738 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:05:07.945362    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:05:07.958341 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:05:07.958315    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:05:08.914469 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:05:08.914439    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:05:14.286991 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:05:14.286952    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:05:37.231936 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:05:37.231897    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:05:45.755427 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:05:45.755391    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:05:51.056258 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:05:51.056218    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"]
Jul 30 03:06:04.707730 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:04.707698    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 03:06:04.711796 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:04.711776    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 03:06:04.714865 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:04.714847    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 03:06:04.718806 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:04.718788    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 03:06:06.075410 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.075360    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9" podUID="cbc55e77-ba0b-411d-aebc-4713e3c4fdf4" containerName="main" containerID="cri-o://5ea03a0af1ac3a156b8fd4c1a70cb6a76d956d82e0aeaaf0c710966d08c83287" gracePeriod=45
Jul 30 03:06:06.325744 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.325681    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:06:06.465619 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.465571    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjslq\" (UniqueName: \"kubernetes.io/projected/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-kube-api-access-fjslq\") pod \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") "
Jul 30 03:06:06.465821 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.465657    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-tmp-dir\") pod \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") "
Jul 30 03:06:06.465821 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.465691    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-home\") pod \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") "
Jul 30 03:06:06.465821 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.465736    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-tls-certs\") pod \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") "
Jul 30 03:06:06.465821 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.465795    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-dshm\") pod \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") "
Jul 30 03:06:06.465821 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.465821    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-model-cache\") pod \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\" (UID: \"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4\") "
Jul 30 03:06:06.466071 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.465966    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cbc55e77-ba0b-411d-aebc-4713e3c4fdf4" (UID: "cbc55e77-ba0b-411d-aebc-4713e3c4fdf4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:06:06.466071 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.465984    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-home" (OuterVolumeSpecName: "home") pod "cbc55e77-ba0b-411d-aebc-4713e3c4fdf4" (UID: "cbc55e77-ba0b-411d-aebc-4713e3c4fdf4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:06:06.466153 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.466090    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-model-cache" (OuterVolumeSpecName: "model-cache") pod "cbc55e77-ba0b-411d-aebc-4713e3c4fdf4" (UID: "cbc55e77-ba0b-411d-aebc-4713e3c4fdf4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:06:06.466192 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.466175    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-tmp-dir\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:06:06.466227 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.466191    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-home\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:06:06.467890 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.467868    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-kube-api-access-fjslq" (OuterVolumeSpecName: "kube-api-access-fjslq") pod "cbc55e77-ba0b-411d-aebc-4713e3c4fdf4" (UID: "cbc55e77-ba0b-411d-aebc-4713e3c4fdf4"). InnerVolumeSpecName "kube-api-access-fjslq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:06:06.467979 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.467867    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-dshm" (OuterVolumeSpecName: "dshm") pod "cbc55e77-ba0b-411d-aebc-4713e3c4fdf4" (UID: "cbc55e77-ba0b-411d-aebc-4713e3c4fdf4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:06:06.467979 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.467909    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cbc55e77-ba0b-411d-aebc-4713e3c4fdf4" (UID: "cbc55e77-ba0b-411d-aebc-4713e3c4fdf4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:06:06.567525 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.567484    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjslq\" (UniqueName: \"kubernetes.io/projected/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-kube-api-access-fjslq\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:06:06.567525 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.567521    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-tls-certs\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:06:06.567525 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.567532    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-dshm\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:06:06.567525 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:06.567540    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4-model-cache\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:06:07.178701 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:07.178668    2554 generic.go:356] "Generic (PLEG): container finished" podID="cbc55e77-ba0b-411d-aebc-4713e3c4fdf4" containerID="5ea03a0af1ac3a156b8fd4c1a70cb6a76d956d82e0aeaaf0c710966d08c83287" exitCode=0
Jul 30 03:06:07.179148 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:07.178724    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9" event={"ID":"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4","Type":"ContainerDied","Data":"5ea03a0af1ac3a156b8fd4c1a70cb6a76d956d82e0aeaaf0c710966d08c83287"}
Jul 30 03:06:07.179148 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:07.178727    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"
Jul 30 03:06:07.179148 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:07.178754    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9" event={"ID":"cbc55e77-ba0b-411d-aebc-4713e3c4fdf4","Type":"ContainerDied","Data":"9ec8683d170b8fa5839aa8b01b7b210d6aa51505b02ff55e4faf0b036ed7883b"}
Jul 30 03:06:07.179148 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:07.178773    2554 scope.go:117] "RemoveContainer" containerID="5ea03a0af1ac3a156b8fd4c1a70cb6a76d956d82e0aeaaf0c710966d08c83287"
Jul 30 03:06:07.187242 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:07.187217    2554 scope.go:117] "RemoveContainer" containerID="5ea03a0af1ac3a156b8fd4c1a70cb6a76d956d82e0aeaaf0c710966d08c83287"
Jul 30 03:06:07.187492 ip-10-0-136-75 kubenswrapper[2554]: E0730 03:06:07.187471    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ea03a0af1ac3a156b8fd4c1a70cb6a76d956d82e0aeaaf0c710966d08c83287\": container with ID starting with 5ea03a0af1ac3a156b8fd4c1a70cb6a76d956d82e0aeaaf0c710966d08c83287 not found: ID does not exist" containerID="5ea03a0af1ac3a156b8fd4c1a70cb6a76d956d82e0aeaaf0c710966d08c83287"
Jul 30 03:06:07.187539 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:07.187501    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ea03a0af1ac3a156b8fd4c1a70cb6a76d956d82e0aeaaf0c710966d08c83287"} err="failed to get container status \"5ea03a0af1ac3a156b8fd4c1a70cb6a76d956d82e0aeaaf0c710966d08c83287\": rpc error: code = NotFound desc = could not find container \"5ea03a0af1ac3a156b8fd4c1a70cb6a76d956d82e0aeaaf0c710966d08c83287\": container with ID starting with 5ea03a0af1ac3a156b8fd4c1a70cb6a76d956d82e0aeaaf0c710966d08c83287 not found: ID does not exist"
Jul 30 03:06:07.194097 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:07.194074    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"]
Jul 30 03:06:07.198123 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:07.198104    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-adb22f94/e2e-lifecycle-model-adb22f94-kserve-5cbf564bdc-s4sx9"]
Jul 30 03:06:08.641347 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:08.641307    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbc55e77-ba0b-411d-aebc-4713e3c4fdf4" path="/var/lib/kubelet/pods/cbc55e77-ba0b-411d-aebc-4713e3c4fdf4/volumes"
Jul 30 03:06:37.531385 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:37.531349    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:06:49.144218 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:06:49.144176    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:07:39.829699 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:39.829661    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:07:54.933039 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:54.933004    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:07:56.326527 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.326446    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"]
Jul 30 03:07:56.326885 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.326814    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc55e77-ba0b-411d-aebc-4713e3c4fdf4" containerName="main"
Jul 30 03:07:56.326885 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.326826    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc55e77-ba0b-411d-aebc-4713e3c4fdf4" containerName="main"
Jul 30 03:07:56.326885 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.326872    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbc55e77-ba0b-411d-aebc-4713e3c4fdf4" containerName="main"
Jul 30 03:07:56.329916 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.329898    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.333246 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.333221    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3b8039\"/\"kube-root-ca.crt\""
Jul 30 03:07:56.333397 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.333304    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3b8039\"/\"test-model-3b8039-kserve-self-signed-certs\""
Jul 30 03:07:56.333397 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.333302    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3b8039\"/\"default-dockercfg-6dmss\""
Jul 30 03:07:56.333508 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.333302    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3b8039\"/\"openshift-service-ca.crt\""
Jul 30 03:07:56.340137 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.340111    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"]
Jul 30 03:07:56.341182 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.341091    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-tmp-dir\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.341182 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.341148    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-dshm\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.341381 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.341191    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-model-cache\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.341495 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.341472    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-home\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.341575 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.341525    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqcjc\" (UniqueName: \"kubernetes.io/projected/79ed95b6-e82a-489f-a97a-1ddada1f5012-kube-api-access-fqcjc\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.341672 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.341646    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79ed95b6-e82a-489f-a97a-1ddada1f5012-tls-certs\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.442691 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.442654    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqcjc\" (UniqueName: \"kubernetes.io/projected/79ed95b6-e82a-489f-a97a-1ddada1f5012-kube-api-access-fqcjc\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.442850 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.442707    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79ed95b6-e82a-489f-a97a-1ddada1f5012-tls-certs\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.442850 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.442741    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-tmp-dir\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.442850 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.442763    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-dshm\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.442850 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.442787    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-model-cache\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.442850 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.442807    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-home\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.443232 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.443208    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-tmp-dir\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.443315 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.443250    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-home\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.443315 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.443262    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-model-cache\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.445014 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.444996    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-dshm\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.445399 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.445378    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79ed95b6-e82a-489f-a97a-1ddada1f5012-tls-certs\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.449510 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.449492    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqcjc\" (UniqueName: \"kubernetes.io/projected/79ed95b6-e82a-489f-a97a-1ddada1f5012-kube-api-access-fqcjc\") pod \"test-model-3b8039-kserve-686b7c6fc9-b4q7z\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") " pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.645892 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.645811    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:07:56.774235 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:56.774209    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"]
Jul 30 03:07:56.776049 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:07:56.776024    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79ed95b6_e82a_489f_a97a_1ddada1f5012.slice/crio-1f6cbd055eb429a6e518d2444e51181310e7718999575531b632978633f01a85 WatchSource:0}: Error finding container 1f6cbd055eb429a6e518d2444e51181310e7718999575531b632978633f01a85: Status 404 returned error can't find the container with id 1f6cbd055eb429a6e518d2444e51181310e7718999575531b632978633f01a85
Jul 30 03:07:57.685494 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:57.685460    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z" event={"ID":"79ed95b6-e82a-489f-a97a-1ddada1f5012","Type":"ContainerStarted","Data":"98d1f204c8fe8dba2ff6d4b2d0989396817be93b59af0cc1705a63f7d68b4670"}
Jul 30 03:07:57.685494 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:57.685501    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z" event={"ID":"79ed95b6-e82a-489f-a97a-1ddada1f5012","Type":"ContainerStarted","Data":"1f6cbd055eb429a6e518d2444e51181310e7718999575531b632978633f01a85"}
Jul 30 03:07:57.703982 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:07:57.703935    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z" podStartSLOduration=1.703920293 podStartE2EDuration="1.703920293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:07:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:07:57.701432846 +0000 UTC m=+2513.551745592" watchObservedRunningTime="2026-07-30 03:07:57.703920293 +0000 UTC m=+2513.554233025"
Jul 30 03:08:06.533792 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:06.533759    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:08:06.646560 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:06.646511    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:08:06.646725 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:06.646581    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:08:06.659332 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:06.659306    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:08:06.741366 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:06.741330    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:08:25.937677 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:25.937641    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"]
Jul 30 03:08:25.941611 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:25.941580    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:25.945412 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:25.945385    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cb71ac\"/\"openshift-service-ca.crt\""
Jul 30 03:08:25.945412 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:25.945405    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cb71ac\"/\"kube-root-ca.crt\""
Jul 30 03:08:25.945616 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:25.945395    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cb71ac\"/\"test-model-cb71ac-kserve-self-signed-certs\""
Jul 30 03:08:25.945616 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:25.945466    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cb71ac\"/\"default-dockercfg-rhqdn\""
Jul 30 03:08:25.950598 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:25.950574    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"]
Jul 30 03:08:26.099713 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.099684    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-dshm\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.099859 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.099716    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfq8m\" (UniqueName: \"kubernetes.io/projected/c61d4267-c3cd-406f-8677-30ce63e88848-kube-api-access-gfq8m\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.099859 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.099736    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-home\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.099859 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.099755    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-tmp-dir\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.099859 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.099842    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-model-cache\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.099998 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.099868    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c61d4267-c3cd-406f-8677-30ce63e88848-tls-certs\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.200447 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.200378    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-model-cache\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.200447 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.200407    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c61d4267-c3cd-406f-8677-30ce63e88848-tls-certs\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.200666 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.200480    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-dshm\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.200666 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.200497    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfq8m\" (UniqueName: \"kubernetes.io/projected/c61d4267-c3cd-406f-8677-30ce63e88848-kube-api-access-gfq8m\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.200666 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.200522    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-home\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.200666 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.200569    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-tmp-dir\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.200868 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.200826    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-model-cache\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.200948 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.200922    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-home\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.201023 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.201007    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-tmp-dir\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.202693 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.202675    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-dshm\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.202880 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.202864    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c61d4267-c3cd-406f-8677-30ce63e88848-tls-certs\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.208774 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.208755    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfq8m\" (UniqueName: \"kubernetes.io/projected/c61d4267-c3cd-406f-8677-30ce63e88848-kube-api-access-gfq8m\") pod \"test-model-cb71ac-kserve-bfb77ffd7-zlhft\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") " pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.251782 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.251761    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:26.379639 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.379612    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"]
Jul 30 03:08:26.381366 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:08:26.381339    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc61d4267_c3cd_406f_8677_30ce63e88848.slice/crio-307836933df1e17c0d7e2b684844a5e257d17d596d293c57b58289b9c424e5da WatchSource:0}: Error finding container 307836933df1e17c0d7e2b684844a5e257d17d596d293c57b58289b9c424e5da: Status 404 returned error can't find the container with id 307836933df1e17c0d7e2b684844a5e257d17d596d293c57b58289b9c424e5da
Jul 30 03:08:26.828480 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.828435    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft" event={"ID":"c61d4267-c3cd-406f-8677-30ce63e88848","Type":"ContainerStarted","Data":"1fa9fb2f2d356719b4ad41e9642b9144c0dbc0d9c159cae0fd8524a94c208359"}
Jul 30 03:08:26.828672 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.828490    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft" event={"ID":"c61d4267-c3cd-406f-8677-30ce63e88848","Type":"ContainerStarted","Data":"307836933df1e17c0d7e2b684844a5e257d17d596d293c57b58289b9c424e5da"}
Jul 30 03:08:26.846967 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:26.846917    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft" podStartSLOduration=1.8469016150000002 podStartE2EDuration="1.846901615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:08:26.845244017 +0000 UTC m=+2542.695556750" watchObservedRunningTime="2026-07-30 03:08:26.846901615 +0000 UTC m=+2542.697214346"
Jul 30 03:08:31.340372 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:31.340336    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:08:36.252340 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:36.252302    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:36.252786 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:36.252364    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:36.264819 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:36.264796    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:08:36.883506 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:08:36.883478    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:09:03.887925 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:03.887887    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"]
Jul 30 03:09:04.878131 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:04.878095    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"]
Jul 30 03:09:09.135464 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:09.135423    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:09:18.907207 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:18.907162    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z" podUID="79ed95b6-e82a-489f-a97a-1ddada1f5012" containerName="main" containerID="cri-o://98d1f204c8fe8dba2ff6d4b2d0989396817be93b59af0cc1705a63f7d68b4670" gracePeriod=45
Jul 30 03:09:19.081611 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.081577    2554 generic.go:356] "Generic (PLEG): container finished" podID="79ed95b6-e82a-489f-a97a-1ddada1f5012" containerID="98d1f204c8fe8dba2ff6d4b2d0989396817be93b59af0cc1705a63f7d68b4670" exitCode=0
Jul 30 03:09:19.081762 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.081646    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z" event={"ID":"79ed95b6-e82a-489f-a97a-1ddada1f5012","Type":"ContainerDied","Data":"98d1f204c8fe8dba2ff6d4b2d0989396817be93b59af0cc1705a63f7d68b4670"}
Jul 30 03:09:19.160999 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.160948    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:09:19.243050 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.243021    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-home\") pod \"79ed95b6-e82a-489f-a97a-1ddada1f5012\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") "
Jul 30 03:09:19.243199 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.243057    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqcjc\" (UniqueName: \"kubernetes.io/projected/79ed95b6-e82a-489f-a97a-1ddada1f5012-kube-api-access-fqcjc\") pod \"79ed95b6-e82a-489f-a97a-1ddada1f5012\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") "
Jul 30 03:09:19.243199 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.243129    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-model-cache\") pod \"79ed95b6-e82a-489f-a97a-1ddada1f5012\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") "
Jul 30 03:09:19.243199 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.243143    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-dshm\") pod \"79ed95b6-e82a-489f-a97a-1ddada1f5012\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") "
Jul 30 03:09:19.243199 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.243188    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-tmp-dir\") pod \"79ed95b6-e82a-489f-a97a-1ddada1f5012\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") "
Jul 30 03:09:19.243420 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.243239    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79ed95b6-e82a-489f-a97a-1ddada1f5012-tls-certs\") pod \"79ed95b6-e82a-489f-a97a-1ddada1f5012\" (UID: \"79ed95b6-e82a-489f-a97a-1ddada1f5012\") "
Jul 30 03:09:19.243420 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.243305    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-home" (OuterVolumeSpecName: "home") pod "79ed95b6-e82a-489f-a97a-1ddada1f5012" (UID: "79ed95b6-e82a-489f-a97a-1ddada1f5012"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:09:19.243533 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.243409    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-model-cache" (OuterVolumeSpecName: "model-cache") pod "79ed95b6-e82a-489f-a97a-1ddada1f5012" (UID: "79ed95b6-e82a-489f-a97a-1ddada1f5012"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:09:19.243533 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.243466    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "79ed95b6-e82a-489f-a97a-1ddada1f5012" (UID: "79ed95b6-e82a-489f-a97a-1ddada1f5012"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:09:19.243533 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.243504    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-model-cache\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:09:19.243533 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.243519    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-home\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:09:19.245298 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.245273    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-dshm" (OuterVolumeSpecName: "dshm") pod "79ed95b6-e82a-489f-a97a-1ddada1f5012" (UID: "79ed95b6-e82a-489f-a97a-1ddada1f5012"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:09:19.245388 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.245363    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79ed95b6-e82a-489f-a97a-1ddada1f5012-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "79ed95b6-e82a-489f-a97a-1ddada1f5012" (UID: "79ed95b6-e82a-489f-a97a-1ddada1f5012"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:09:19.245430 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.245402    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79ed95b6-e82a-489f-a97a-1ddada1f5012-kube-api-access-fqcjc" (OuterVolumeSpecName: "kube-api-access-fqcjc") pod "79ed95b6-e82a-489f-a97a-1ddada1f5012" (UID: "79ed95b6-e82a-489f-a97a-1ddada1f5012"). InnerVolumeSpecName "kube-api-access-fqcjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:09:19.344045 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.344020    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79ed95b6-e82a-489f-a97a-1ddada1f5012-tls-certs\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:09:19.344045 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.344045    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqcjc\" (UniqueName: \"kubernetes.io/projected/79ed95b6-e82a-489f-a97a-1ddada1f5012-kube-api-access-fqcjc\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:09:19.344202 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.344054    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-dshm\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:09:19.344202 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.344063    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79ed95b6-e82a-489f-a97a-1ddada1f5012-tmp-dir\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:09:19.897081 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:19.897019    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft" podUID="c61d4267-c3cd-406f-8677-30ce63e88848" containerName="main" containerID="cri-o://1fa9fb2f2d356719b4ad41e9642b9144c0dbc0d9c159cae0fd8524a94c208359" gracePeriod=45
Jul 30 03:09:20.088761 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.088717    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z" event={"ID":"79ed95b6-e82a-489f-a97a-1ddada1f5012","Type":"ContainerDied","Data":"1f6cbd055eb429a6e518d2444e51181310e7718999575531b632978633f01a85"}
Jul 30 03:09:20.089253 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.088785    2554 scope.go:117] "RemoveContainer" containerID="98d1f204c8fe8dba2ff6d4b2d0989396817be93b59af0cc1705a63f7d68b4670"
Jul 30 03:09:20.089253 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.088731    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"
Jul 30 03:09:20.091828 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.091714    2554 generic.go:356] "Generic (PLEG): container finished" podID="c61d4267-c3cd-406f-8677-30ce63e88848" containerID="1fa9fb2f2d356719b4ad41e9642b9144c0dbc0d9c159cae0fd8524a94c208359" exitCode=0
Jul 30 03:09:20.092083 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.092003    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft" event={"ID":"c61d4267-c3cd-406f-8677-30ce63e88848","Type":"ContainerDied","Data":"1fa9fb2f2d356719b4ad41e9642b9144c0dbc0d9c159cae0fd8524a94c208359"}
Jul 30 03:09:20.112319 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.112293    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"]
Jul 30 03:09:20.120799 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.120780    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-3b8039/test-model-3b8039-kserve-686b7c6fc9-b4q7z"]
Jul 30 03:09:20.147108 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.147064    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:09:20.251148 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.251122    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfq8m\" (UniqueName: \"kubernetes.io/projected/c61d4267-c3cd-406f-8677-30ce63e88848-kube-api-access-gfq8m\") pod \"c61d4267-c3cd-406f-8677-30ce63e88848\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") "
Jul 30 03:09:20.251278 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.251164    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-model-cache\") pod \"c61d4267-c3cd-406f-8677-30ce63e88848\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") "
Jul 30 03:09:20.251278 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.251212    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-tmp-dir\") pod \"c61d4267-c3cd-406f-8677-30ce63e88848\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") "
Jul 30 03:09:20.251278 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.251263    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-dshm\") pod \"c61d4267-c3cd-406f-8677-30ce63e88848\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") "
Jul 30 03:09:20.251407 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.251304    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c61d4267-c3cd-406f-8677-30ce63e88848-tls-certs\") pod \"c61d4267-c3cd-406f-8677-30ce63e88848\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") "
Jul 30 03:09:20.251407 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.251341    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-home\") pod \"c61d4267-c3cd-406f-8677-30ce63e88848\" (UID: \"c61d4267-c3cd-406f-8677-30ce63e88848\") "
Jul 30 03:09:20.251520 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.251480    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-model-cache" (OuterVolumeSpecName: "model-cache") pod "c61d4267-c3cd-406f-8677-30ce63e88848" (UID: "c61d4267-c3cd-406f-8677-30ce63e88848"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:09:20.251609 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.251512    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c61d4267-c3cd-406f-8677-30ce63e88848" (UID: "c61d4267-c3cd-406f-8677-30ce63e88848"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:09:20.251689 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.251669    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-model-cache\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:09:20.251745 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.251694    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-tmp-dir\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:09:20.251745 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.251699    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-home" (OuterVolumeSpecName: "home") pod "c61d4267-c3cd-406f-8677-30ce63e88848" (UID: "c61d4267-c3cd-406f-8677-30ce63e88848"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:09:20.253467 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.253443    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c61d4267-c3cd-406f-8677-30ce63e88848-kube-api-access-gfq8m" (OuterVolumeSpecName: "kube-api-access-gfq8m") pod "c61d4267-c3cd-406f-8677-30ce63e88848" (UID: "c61d4267-c3cd-406f-8677-30ce63e88848"). InnerVolumeSpecName "kube-api-access-gfq8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:09:20.253467 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.253451    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-dshm" (OuterVolumeSpecName: "dshm") pod "c61d4267-c3cd-406f-8677-30ce63e88848" (UID: "c61d4267-c3cd-406f-8677-30ce63e88848"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:09:20.253709 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.253576    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c61d4267-c3cd-406f-8677-30ce63e88848-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c61d4267-c3cd-406f-8677-30ce63e88848" (UID: "c61d4267-c3cd-406f-8677-30ce63e88848"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:09:20.352757 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.352734    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c61d4267-c3cd-406f-8677-30ce63e88848-tls-certs\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:09:20.352757 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.352756    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-home\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:09:20.352925 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.352765    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfq8m\" (UniqueName: \"kubernetes.io/projected/c61d4267-c3cd-406f-8677-30ce63e88848-kube-api-access-gfq8m\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:09:20.352925 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.352773    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c61d4267-c3cd-406f-8677-30ce63e88848-dshm\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:09:20.641439 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:20.641406    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79ed95b6-e82a-489f-a97a-1ddada1f5012" path="/var/lib/kubelet/pods/79ed95b6-e82a-489f-a97a-1ddada1f5012/volumes"
Jul 30 03:09:21.104451 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:21.104419    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"
Jul 30 03:09:21.104451 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:21.104437    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft" event={"ID":"c61d4267-c3cd-406f-8677-30ce63e88848","Type":"ContainerDied","Data":"307836933df1e17c0d7e2b684844a5e257d17d596d293c57b58289b9c424e5da"}
Jul 30 03:09:21.104955 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:21.104487    2554 scope.go:117] "RemoveContainer" containerID="1fa9fb2f2d356719b4ad41e9642b9144c0dbc0d9c159cae0fd8524a94c208359"
Jul 30 03:09:21.124395 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:21.124369    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"]
Jul 30 03:09:21.128388 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:21.128364    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-cb71ac/test-model-cb71ac-kserve-bfb77ffd7-zlhft"]
Jul 30 03:09:22.640790 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:22.640757    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c61d4267-c3cd-406f-8677-30ce63e88848" path="/var/lib/kubelet/pods/c61d4267-c3cd-406f-8677-30ce63e88848/volumes"
Jul 30 03:09:24.842976 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:24.842942    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:09:40.338057 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:09:40.338024    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:10:01.023970 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:10:01.023934    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:10:17.168993 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:10:17.168958    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:10:34.539715 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:10:34.539679    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:11:02.351306 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:02.351222    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:11:04.736042 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:04.736010    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 03:11:04.739800 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:04.739778    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 03:11:04.744616 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:04.744598    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 03:11:04.748333 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:04.748316    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 03:11:19.639541 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:19.639506    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:11:33.885498 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:33.885465    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:11:34.807503 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.807473    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"]
Jul 30 03:11:34.807857 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.807842    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c61d4267-c3cd-406f-8677-30ce63e88848" containerName="main"
Jul 30 03:11:34.807903 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.807859    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c61d4267-c3cd-406f-8677-30ce63e88848" containerName="main"
Jul 30 03:11:34.807903 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.807879    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79ed95b6-e82a-489f-a97a-1ddada1f5012" containerName="main"
Jul 30 03:11:34.807903 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.807885    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="79ed95b6-e82a-489f-a97a-1ddada1f5012" containerName="main"
Jul 30 03:11:34.807995 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.807942    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c61d4267-c3cd-406f-8677-30ce63e88848" containerName="main"
Jul 30 03:11:34.807995 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.807950    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="79ed95b6-e82a-489f-a97a-1ddada1f5012" containerName="main"
Jul 30 03:11:34.811093 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.811078    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:34.814787 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.814767    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-da5459\"/\"kube-root-ca.crt\""
Jul 30 03:11:34.815716 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.815696    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-da5459\"/\"default-dockercfg-n6rlw\""
Jul 30 03:11:34.815827 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.815730    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-da5459\"/\"openshift-service-ca.crt\""
Jul 30 03:11:34.816032 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.816015    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-da5459\"/\"auth-test-model-da5459-kserve-self-signed-certs\""
Jul 30 03:11:34.839276 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.839256    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"]
Jul 30 03:11:34.996686 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.996641    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-tls-certs\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:34.996686 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.996693    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-dshm\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:34.997079 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.996719    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-model-cache\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:34.997079 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.996756    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc5wn\" (UniqueName: \"kubernetes.io/projected/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-kube-api-access-sc5wn\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:34.997079 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.996806    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-home\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:34.997079 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:34.996831    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-tmp-dir\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:35.098023 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.097943    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-tls-certs\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:35.098023 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.097980    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-dshm\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:35.098023 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.097998    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-model-cache\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:35.098282 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.098049    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc5wn\" (UniqueName: \"kubernetes.io/projected/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-kube-api-access-sc5wn\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:35.098282 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.098089    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-home\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:35.098282 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.098118    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-tmp-dir\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:35.098424 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.098395    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-home\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:35.098478 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.098455    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-model-cache\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:35.098572 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.098532    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-tmp-dir\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:35.100335 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.100314    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-dshm\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:35.100541 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.100528    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-tls-certs\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:35.107327 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.107305    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc5wn\" (UniqueName: \"kubernetes.io/projected/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-kube-api-access-sc5wn\") pod \"auth-test-model-da5459-kserve-644b4656b7-jzdk4\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") " pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:35.119704 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.119684    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:35.261471 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.261438    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"]
Jul 30 03:11:35.264092 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:11:35.264061    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf07a8e6_f969_4840_8ff5_a6f72a7e6c4c.slice/crio-d1c3c0772b837ed159a736f4505d4b702c47a2543e539ffbdd2236b9de237101 WatchSource:0}: Error finding container d1c3c0772b837ed159a736f4505d4b702c47a2543e539ffbdd2236b9de237101: Status 404 returned error can't find the container with id d1c3c0772b837ed159a736f4505d4b702c47a2543e539ffbdd2236b9de237101
Jul 30 03:11:35.728609 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.728540    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4" event={"ID":"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c","Type":"ContainerStarted","Data":"6a985cb88d30cb51df6c4997e7ff0e5900197be94b3ca850abbd7a2dbee0f422"}
Jul 30 03:11:35.728609 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.728613    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4" event={"ID":"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c","Type":"ContainerStarted","Data":"d1c3c0772b837ed159a736f4505d4b702c47a2543e539ffbdd2236b9de237101"}
Jul 30 03:11:35.767019 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:35.766964    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4" podStartSLOduration=1.766947284 podStartE2EDuration="1.766947284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:11:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:11:35.764392323 +0000 UTC m=+2731.614705054" watchObservedRunningTime="2026-07-30 03:11:35.766947284 +0000 UTC m=+2731.617260014"
Jul 30 03:11:45.120598 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:45.120565    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:45.121006 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:45.120611    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:45.132700 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:45.132676    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:11:45.358599 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:45.358568    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:11:45.787528 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:11:45.787497    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:12:06.537025 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.536993    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"]
Jul 30 03:12:06.540526 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.540511    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.544426 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.544403    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2a805\"/\"auth-test-model-f2a805-kserve-self-signed-certs\""
Jul 30 03:12:06.544426 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.544423    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2a805\"/\"openshift-service-ca.crt\""
Jul 30 03:12:06.544592 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.544504    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2a805\"/\"default-dockercfg-f492q\""
Jul 30 03:12:06.544592 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.544569    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2a805\"/\"kube-root-ca.crt\""
Jul 30 03:12:06.548745 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.548722    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"]
Jul 30 03:12:06.669404 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.669370    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-model-cache\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.669602 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.669425    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-home\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.669602 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.669476    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-dshm\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.669602 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.669503    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-tmp-dir\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.669602 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.669565    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad293239-bb62-401d-8cd5-91e59afceaf8-tls-certs\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.669602 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.669590    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqnwj\" (UniqueName: \"kubernetes.io/projected/ad293239-bb62-401d-8cd5-91e59afceaf8-kube-api-access-sqnwj\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.770485 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.770451    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-model-cache\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.770664 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.770508    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-home\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.770664 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.770534    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-dshm\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.770664 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.770573    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-tmp-dir\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.770664 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.770608    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad293239-bb62-401d-8cd5-91e59afceaf8-tls-certs\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.770879 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.770733    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqnwj\" (UniqueName: \"kubernetes.io/projected/ad293239-bb62-401d-8cd5-91e59afceaf8-kube-api-access-sqnwj\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.770925 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.770894    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-model-cache\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.770965 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.770921    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-home\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.771038 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.771014    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-tmp-dir\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.772948 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.772924    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-dshm\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.773080 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.773066    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad293239-bb62-401d-8cd5-91e59afceaf8-tls-certs\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.780985 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.780964    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqnwj\" (UniqueName: \"kubernetes.io/projected/ad293239-bb62-401d-8cd5-91e59afceaf8-kube-api-access-sqnwj\") pod \"auth-test-model-f2a805-kserve-bc6f575bc-stj5l\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") " pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.851106 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.851026    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:06.999696 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:06.999662    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"]
Jul 30 03:12:07.002425 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:12:07.002396    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad293239_bb62_401d_8cd5_91e59afceaf8.slice/crio-586b4841f84ae29df8776b4e12827886224a2d971f01ee6e4741d8f76bf87eac WatchSource:0}: Error finding container 586b4841f84ae29df8776b4e12827886224a2d971f01ee6e4741d8f76bf87eac: Status 404 returned error can't find the container with id 586b4841f84ae29df8776b4e12827886224a2d971f01ee6e4741d8f76bf87eac
Jul 30 03:12:07.884498 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:07.884462    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l" event={"ID":"ad293239-bb62-401d-8cd5-91e59afceaf8","Type":"ContainerStarted","Data":"ac8215094865cb8c5bde762828b0b1a46969e5267068ed62c06e6dccf68e70d8"}
Jul 30 03:12:07.884879 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:07.884505    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l" event={"ID":"ad293239-bb62-401d-8cd5-91e59afceaf8","Type":"ContainerStarted","Data":"586b4841f84ae29df8776b4e12827886224a2d971f01ee6e4741d8f76bf87eac"}
Jul 30 03:12:07.907625 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:07.907571    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l" podStartSLOduration=1.907544123 podStartE2EDuration="1.907544123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:12:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:12:07.905081622 +0000 UTC m=+2763.755394366" watchObservedRunningTime="2026-07-30 03:12:07.907544123 +0000 UTC m=+2763.757856855"
Jul 30 03:12:10.239019 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:10.238986    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:12:16.851330 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:16.851294    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:16.851755 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:16.851351    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:16.863647 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:16.863621    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:16.942643 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:16.942620    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:12:51.935614 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:12:51.935579    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:13:11.956969 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:13:11.956935    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:13:31.137845 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:13:31.137807    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:13:53.440611 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:13:53.440569    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:14:10.028483 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:14:10.028398    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:14:31.734209 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:14:31.734173    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:14:50.440841 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:14:50.440802    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:15:13.329235 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:15:13.329196    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:15:32.929446 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:15:32.929414    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:15:52.635136 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:15:52.635096    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:16:04.763651 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:04.763623    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 03:16:04.768114 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:04.768090    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 03:16:04.774413 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:04.774392    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 03:16:04.778140 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:04.778123    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 03:16:11.630944 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:11.630906    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:16:34.834599 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:34.834558    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:16:38.132376 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:38.132341    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"]
Jul 30 03:16:39.021683 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:39.021648    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"]
Jul 30 03:16:50.641592 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:50.641541    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:16:53.151062 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.151025    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4" podUID="af07a8e6-f969-4840-8ff5-a6f72a7e6c4c" containerName="main" containerID="cri-o://6a985cb88d30cb51df6c4997e7ff0e5900197be94b3ca850abbd7a2dbee0f422" gracePeriod=45
Jul 30 03:16:53.407527 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.407462    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:16:53.530955 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.530912    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-model-cache\") pod \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") "
Jul 30 03:16:53.530955 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.530956    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc5wn\" (UniqueName: \"kubernetes.io/projected/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-kube-api-access-sc5wn\") pod \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") "
Jul 30 03:16:53.531207 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.530999    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-dshm\") pod \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") "
Jul 30 03:16:53.531207 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.531013    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-home\") pod \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") "
Jul 30 03:16:53.531207 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.531076    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-tmp-dir\") pod \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") "
Jul 30 03:16:53.531207 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.531128    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-tls-certs\") pod \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\" (UID: \"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c\") "
Jul 30 03:16:53.531461 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.531287    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-model-cache" (OuterVolumeSpecName: "model-cache") pod "af07a8e6-f969-4840-8ff5-a6f72a7e6c4c" (UID: "af07a8e6-f969-4840-8ff5-a6f72a7e6c4c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:16:53.531461 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.531313    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-home" (OuterVolumeSpecName: "home") pod "af07a8e6-f969-4840-8ff5-a6f72a7e6c4c" (UID: "af07a8e6-f969-4840-8ff5-a6f72a7e6c4c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:16:53.531461 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.531358    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "af07a8e6-f969-4840-8ff5-a6f72a7e6c4c" (UID: "af07a8e6-f969-4840-8ff5-a6f72a7e6c4c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:16:53.531606 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.531470    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-home\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:16:53.531606 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.531484    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-tmp-dir\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:16:53.531606 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.531493    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-model-cache\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:16:53.533351 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.533325    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "af07a8e6-f969-4840-8ff5-a6f72a7e6c4c" (UID: "af07a8e6-f969-4840-8ff5-a6f72a7e6c4c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:16:53.533617 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.533600    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-dshm" (OuterVolumeSpecName: "dshm") pod "af07a8e6-f969-4840-8ff5-a6f72a7e6c4c" (UID: "af07a8e6-f969-4840-8ff5-a6f72a7e6c4c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:16:53.533683 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.533628    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-kube-api-access-sc5wn" (OuterVolumeSpecName: "kube-api-access-sc5wn") pod "af07a8e6-f969-4840-8ff5-a6f72a7e6c4c" (UID: "af07a8e6-f969-4840-8ff5-a6f72a7e6c4c"). InnerVolumeSpecName "kube-api-access-sc5wn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:16:53.632116 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.632078    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-tls-certs\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:16:53.632116 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.632110    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc5wn\" (UniqueName: \"kubernetes.io/projected/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-kube-api-access-sc5wn\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:16:53.632116 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:53.632121    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c-dshm\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:16:54.041184 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.041140    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l" podUID="ad293239-bb62-401d-8cd5-91e59afceaf8" containerName="main" containerID="cri-o://ac8215094865cb8c5bde762828b0b1a46969e5267068ed62c06e6dccf68e70d8" gracePeriod=45
Jul 30 03:16:54.248316 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.248286    2554 generic.go:356] "Generic (PLEG): container finished" podID="ad293239-bb62-401d-8cd5-91e59afceaf8" containerID="ac8215094865cb8c5bde762828b0b1a46969e5267068ed62c06e6dccf68e70d8" exitCode=0
Jul 30 03:16:54.248752 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.248359    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l" event={"ID":"ad293239-bb62-401d-8cd5-91e59afceaf8","Type":"ContainerDied","Data":"ac8215094865cb8c5bde762828b0b1a46969e5267068ed62c06e6dccf68e70d8"}
Jul 30 03:16:54.249715 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.249692    2554 generic.go:356] "Generic (PLEG): container finished" podID="af07a8e6-f969-4840-8ff5-a6f72a7e6c4c" containerID="6a985cb88d30cb51df6c4997e7ff0e5900197be94b3ca850abbd7a2dbee0f422" exitCode=0
Jul 30 03:16:54.249832 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.249735    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4" event={"ID":"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c","Type":"ContainerDied","Data":"6a985cb88d30cb51df6c4997e7ff0e5900197be94b3ca850abbd7a2dbee0f422"}
Jul 30 03:16:54.249832 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.249736    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"
Jul 30 03:16:54.249832 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.249763    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4" event={"ID":"af07a8e6-f969-4840-8ff5-a6f72a7e6c4c","Type":"ContainerDied","Data":"d1c3c0772b837ed159a736f4505d4b702c47a2543e539ffbdd2236b9de237101"}
Jul 30 03:16:54.249832 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.249786    2554 scope.go:117] "RemoveContainer" containerID="6a985cb88d30cb51df6c4997e7ff0e5900197be94b3ca850abbd7a2dbee0f422"
Jul 30 03:16:54.258831 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.258805    2554 scope.go:117] "RemoveContainer" containerID="6a985cb88d30cb51df6c4997e7ff0e5900197be94b3ca850abbd7a2dbee0f422"
Jul 30 03:16:54.259101 ip-10-0-136-75 kubenswrapper[2554]: E0730 03:16:54.259073    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a985cb88d30cb51df6c4997e7ff0e5900197be94b3ca850abbd7a2dbee0f422\": container with ID starting with 6a985cb88d30cb51df6c4997e7ff0e5900197be94b3ca850abbd7a2dbee0f422 not found: ID does not exist" containerID="6a985cb88d30cb51df6c4997e7ff0e5900197be94b3ca850abbd7a2dbee0f422"
Jul 30 03:16:54.259163 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.259112    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a985cb88d30cb51df6c4997e7ff0e5900197be94b3ca850abbd7a2dbee0f422"} err="failed to get container status \"6a985cb88d30cb51df6c4997e7ff0e5900197be94b3ca850abbd7a2dbee0f422\": rpc error: code = NotFound desc = could not find container \"6a985cb88d30cb51df6c4997e7ff0e5900197be94b3ca850abbd7a2dbee0f422\": container with ID starting with 6a985cb88d30cb51df6c4997e7ff0e5900197be94b3ca850abbd7a2dbee0f422 not found: ID does not exist"
Jul 30 03:16:54.271844 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.271817    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"]
Jul 30 03:16:54.276614 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.276583    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/auth-test-model-da5459-kserve-644b4656b7-jzdk4"]
Jul 30 03:16:54.291501 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.291447    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:16:54.441048 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.441014    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-dshm\") pod \"ad293239-bb62-401d-8cd5-91e59afceaf8\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") "
Jul 30 03:16:54.441245 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.441056    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad293239-bb62-401d-8cd5-91e59afceaf8-tls-certs\") pod \"ad293239-bb62-401d-8cd5-91e59afceaf8\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") "
Jul 30 03:16:54.441245 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.441086    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-tmp-dir\") pod \"ad293239-bb62-401d-8cd5-91e59afceaf8\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") "
Jul 30 03:16:54.441245 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.441118    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqnwj\" (UniqueName: \"kubernetes.io/projected/ad293239-bb62-401d-8cd5-91e59afceaf8-kube-api-access-sqnwj\") pod \"ad293239-bb62-401d-8cd5-91e59afceaf8\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") "
Jul 30 03:16:54.441245 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.441222    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-home\") pod \"ad293239-bb62-401d-8cd5-91e59afceaf8\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") "
Jul 30 03:16:54.441465 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.441336    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-model-cache\") pod \"ad293239-bb62-401d-8cd5-91e59afceaf8\" (UID: \"ad293239-bb62-401d-8cd5-91e59afceaf8\") "
Jul 30 03:16:54.441465 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.441385    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ad293239-bb62-401d-8cd5-91e59afceaf8" (UID: "ad293239-bb62-401d-8cd5-91e59afceaf8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:16:54.441465 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.441430    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-home" (OuterVolumeSpecName: "home") pod "ad293239-bb62-401d-8cd5-91e59afceaf8" (UID: "ad293239-bb62-401d-8cd5-91e59afceaf8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:16:54.441648 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.441616    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-model-cache" (OuterVolumeSpecName: "model-cache") pod "ad293239-bb62-401d-8cd5-91e59afceaf8" (UID: "ad293239-bb62-401d-8cd5-91e59afceaf8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:16:54.441703 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.441666    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-tmp-dir\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:16:54.441703 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.441678    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-home\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:16:54.443385 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.443365    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad293239-bb62-401d-8cd5-91e59afceaf8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ad293239-bb62-401d-8cd5-91e59afceaf8" (UID: "ad293239-bb62-401d-8cd5-91e59afceaf8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:16:54.443685 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.443659    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad293239-bb62-401d-8cd5-91e59afceaf8-kube-api-access-sqnwj" (OuterVolumeSpecName: "kube-api-access-sqnwj") pod "ad293239-bb62-401d-8cd5-91e59afceaf8" (UID: "ad293239-bb62-401d-8cd5-91e59afceaf8"). InnerVolumeSpecName "kube-api-access-sqnwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:16:54.443685 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.443660    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-dshm" (OuterVolumeSpecName: "dshm") pod "ad293239-bb62-401d-8cd5-91e59afceaf8" (UID: "ad293239-bb62-401d-8cd5-91e59afceaf8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:16:54.542956 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.542863    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-dshm\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:16:54.542956 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.542905    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad293239-bb62-401d-8cd5-91e59afceaf8-tls-certs\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:16:54.542956 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.542918    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqnwj\" (UniqueName: \"kubernetes.io/projected/ad293239-bb62-401d-8cd5-91e59afceaf8-kube-api-access-sqnwj\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:16:54.542956 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.542928    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad293239-bb62-401d-8cd5-91e59afceaf8-model-cache\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:16:54.641315 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:54.641281    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af07a8e6-f969-4840-8ff5-a6f72a7e6c4c" path="/var/lib/kubelet/pods/af07a8e6-f969-4840-8ff5-a6f72a7e6c4c/volumes"
Jul 30 03:16:55.256902 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:55.256877    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"
Jul 30 03:16:55.256902 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:55.256886    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l" event={"ID":"ad293239-bb62-401d-8cd5-91e59afceaf8","Type":"ContainerDied","Data":"586b4841f84ae29df8776b4e12827886224a2d971f01ee6e4741d8f76bf87eac"}
Jul 30 03:16:55.257430 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:55.256938    2554 scope.go:117] "RemoveContainer" containerID="ac8215094865cb8c5bde762828b0b1a46969e5267068ed62c06e6dccf68e70d8"
Jul 30 03:16:55.276265 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:55.276238    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"]
Jul 30 03:16:55.280779 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:55.280754    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/auth-test-model-f2a805-kserve-bc6f575bc-stj5l"]
Jul 30 03:16:56.641010 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:16:56.640939    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad293239-bb62-401d-8cd5-91e59afceaf8" path="/var/lib/kubelet/pods/ad293239-bb62-401d-8cd5-91e59afceaf8/volumes"
Jul 30 03:17:01.944238 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:01.944204    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"]
Jul 30 03:17:01.944675 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:01.944535    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af07a8e6-f969-4840-8ff5-a6f72a7e6c4c" containerName="main"
Jul 30 03:17:01.944675 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:01.944561    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="af07a8e6-f969-4840-8ff5-a6f72a7e6c4c" containerName="main"
Jul 30 03:17:01.944675 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:01.944594    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad293239-bb62-401d-8cd5-91e59afceaf8" containerName="main"
Jul 30 03:17:01.944675 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:01.944602    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad293239-bb62-401d-8cd5-91e59afceaf8" containerName="main"
Jul 30 03:17:01.944675 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:01.944656    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="af07a8e6-f969-4840-8ff5-a6f72a7e6c4c" containerName="main"
Jul 30 03:17:01.944675 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:01.944666    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad293239-bb62-401d-8cd5-91e59afceaf8" containerName="main"
Jul 30 03:17:01.948837 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:01.948818    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:01.951348 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:01.951323    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-da5459\"/\"kube-root-ca.crt\""
Jul 30 03:17:01.951652 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:01.951638    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-da5459\"/\"openshift-service-ca.crt\""
Jul 30 03:17:01.952467 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:01.952452    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-da5459\"/\"default-dockercfg-n6rlw\""
Jul 30 03:17:01.952529 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:01.952486    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-da5459\"/\"sub-test-model-da5459-kserve-self-signed-certs\""
Jul 30 03:17:01.956050 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:01.956022    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"]
Jul 30 03:17:02.109958 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.109922    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-tmp-dir\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.110131 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.109964    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-dshm\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.110131 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.110029    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-home\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.110131 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.110063    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-model-cache\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.110131 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.110116    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/608902ff-5776-4c1c-835f-5da46c271d79-tls-certs\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.110263 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.110136    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98gjh\" (UniqueName: \"kubernetes.io/projected/608902ff-5776-4c1c-835f-5da46c271d79-kube-api-access-98gjh\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.210960 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.210872    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-tmp-dir\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.210960 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.210925    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-dshm\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.211166 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.210969    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-home\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.211166 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.210992    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-model-cache\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.211166 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.211060    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/608902ff-5776-4c1c-835f-5da46c271d79-tls-certs\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.211166 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.211088    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98gjh\" (UniqueName: \"kubernetes.io/projected/608902ff-5776-4c1c-835f-5da46c271d79-kube-api-access-98gjh\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.211373 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.211349    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-tmp-dir\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.211436 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.211367    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-home\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.211519 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.211493    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-model-cache\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.213360 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.213336    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-dshm\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.213579 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.213562    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/608902ff-5776-4c1c-835f-5da46c271d79-tls-certs\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.219727 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.219706    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98gjh\" (UniqueName: \"kubernetes.io/projected/608902ff-5776-4c1c-835f-5da46c271d79-kube-api-access-98gjh\") pod \"sub-test-model-da5459-kserve-d54956f75-xfjdw\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") " pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.259376 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.259342    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:02.397126 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:02.397098    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"]
Jul 30 03:17:02.399491 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:17:02.399458    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod608902ff_5776_4c1c_835f_5da46c271d79.slice/crio-ed2cc00f349a22c369e22988df8076b6b8b35298da61b63389379b6b6f78503b WatchSource:0}: Error finding container ed2cc00f349a22c369e22988df8076b6b8b35298da61b63389379b6b6f78503b: Status 404 returned error can't find the container with id ed2cc00f349a22c369e22988df8076b6b8b35298da61b63389379b6b6f78503b
Jul 30 03:17:03.297312 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:03.297275    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw" event={"ID":"608902ff-5776-4c1c-835f-5da46c271d79","Type":"ContainerStarted","Data":"a39a5ed8064683c0152bcf5361cb343a7f265850035204ff5be980d7e6d8f166"}
Jul 30 03:17:03.297312 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:03.297316    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw" event={"ID":"608902ff-5776-4c1c-835f-5da46c271d79","Type":"ContainerStarted","Data":"ed2cc00f349a22c369e22988df8076b6b8b35298da61b63389379b6b6f78503b"}
Jul 30 03:17:03.318716 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:03.318667    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw" podStartSLOduration=2.318651519 podStartE2EDuration="2.318651519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:17:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:17:03.316786294 +0000 UTC m=+3059.167099025" watchObservedRunningTime="2026-07-30 03:17:03.318651519 +0000 UTC m=+3059.168964250"
Jul 30 03:17:05.752801 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:05.752768    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:17:12.260248 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:12.260217    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:12.262818 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:12.260261    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:12.272465 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:12.272442    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:12.351188 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:12.351162    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:17:29.614929 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.614892    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"]
Jul 30 03:17:29.618184 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.618166    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.620962 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.620935    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2a805\"/\"default-dockercfg-f492q\""
Jul 30 03:17:29.621110 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.620964    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2a805\"/\"openshift-service-ca.crt\""
Jul 30 03:17:29.621836 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.621818    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2a805\"/\"kube-root-ca.crt\""
Jul 30 03:17:29.621911 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.621841    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2a805\"/\"sub-test-model-f2a805-kserve-self-signed-certs\""
Jul 30 03:17:29.631199 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.631171    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"]
Jul 30 03:17:29.745918 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.745885    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-dshm\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.746112 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.745942    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-tmp-dir\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.746112 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.745968    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8c54\" (UniqueName: \"kubernetes.io/projected/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-kube-api-access-m8c54\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.746112 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.746014    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-home\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.746112 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.746046    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-model-cache\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.746282 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.746124    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-tls-certs\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.846628 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.846579    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-tmp-dir\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.846628 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.846638    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8c54\" (UniqueName: \"kubernetes.io/projected/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-kube-api-access-m8c54\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.846849 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.846660    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-home\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.846849 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.846676    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-model-cache\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.846849 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.846756    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-tls-certs\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.846977 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.846880    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-dshm\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.847070 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.847046    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-tmp-dir\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.847070 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.847063    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-home\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.847185 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.847097    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-model-cache\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.849038 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.849012    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-dshm\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.849351 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.849331    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-tls-certs\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.855076 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.855046    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8c54\" (UniqueName: \"kubernetes.io/projected/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-kube-api-access-m8c54\") pod \"sub-test-model-f2a805-kserve-9cbf7c96c-2knsn\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") " pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:29.928606 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:29.928528    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:30.057809 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:30.057775    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"]
Jul 30 03:17:30.060261 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:17:30.060229    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9eeb3d28_c4e7_4c98_bd01_f76b4f34c2e2.slice/crio-999217d891d57726a28e39db908bac7024cd2dfd13f3cd1751312913555abd4a WatchSource:0}: Error finding container 999217d891d57726a28e39db908bac7024cd2dfd13f3cd1751312913555abd4a: Status 404 returned error can't find the container with id 999217d891d57726a28e39db908bac7024cd2dfd13f3cd1751312913555abd4a
Jul 30 03:17:30.426028 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:30.425986    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn" event={"ID":"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2","Type":"ContainerStarted","Data":"548e8526be882af7693d9d4c4bd642b655017ba49c2a0801c33ceb4858ff6693"}
Jul 30 03:17:30.426203 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:30.426038    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn" event={"ID":"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2","Type":"ContainerStarted","Data":"999217d891d57726a28e39db908bac7024cd2dfd13f3cd1751312913555abd4a"}
Jul 30 03:17:30.443424 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:30.443375    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn" podStartSLOduration=1.44336129 podStartE2EDuration="1.44336129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:17:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:17:30.442366418 +0000 UTC m=+3086.292679149" watchObservedRunningTime="2026-07-30 03:17:30.44336129 +0000 UTC m=+3086.293674022"
Jul 30 03:17:33.535752 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:33.535718    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:17:39.928831 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:39.928791    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:39.929336 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:39.928866    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:39.941421 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:39.941392    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:17:40.483091 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:17:40.483058    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:18:08.050821 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:08.050784    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:18:28.049226 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:28.049149    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:18:34.075347 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:34.075305    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"]
Jul 30 03:18:35.017670 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:35.017639    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"]
Jul 30 03:18:45.517911 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:45.517873    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:18:49.094315 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.094264    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw" podUID="608902ff-5776-4c1c-835f-5da46c271d79" containerName="main" containerID="cri-o://a39a5ed8064683c0152bcf5361cb343a7f265850035204ff5be980d7e6d8f166" gracePeriod=45
Jul 30 03:18:49.343496 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.343474    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:18:49.526772 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.526743    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-home\") pod \"608902ff-5776-4c1c-835f-5da46c271d79\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") "
Jul 30 03:18:49.526936 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.526785    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98gjh\" (UniqueName: \"kubernetes.io/projected/608902ff-5776-4c1c-835f-5da46c271d79-kube-api-access-98gjh\") pod \"608902ff-5776-4c1c-835f-5da46c271d79\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") "
Jul 30 03:18:49.526936 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.526813    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/608902ff-5776-4c1c-835f-5da46c271d79-tls-certs\") pod \"608902ff-5776-4c1c-835f-5da46c271d79\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") "
Jul 30 03:18:49.526936 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.526835    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-model-cache\") pod \"608902ff-5776-4c1c-835f-5da46c271d79\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") "
Jul 30 03:18:49.527095 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.527017    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-tmp-dir\") pod \"608902ff-5776-4c1c-835f-5da46c271d79\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") "
Jul 30 03:18:49.527095 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.527038    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-home" (OuterVolumeSpecName: "home") pod "608902ff-5776-4c1c-835f-5da46c271d79" (UID: "608902ff-5776-4c1c-835f-5da46c271d79"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:18:49.527095 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.527058    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-model-cache" (OuterVolumeSpecName: "model-cache") pod "608902ff-5776-4c1c-835f-5da46c271d79" (UID: "608902ff-5776-4c1c-835f-5da46c271d79"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:18:49.527252 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.527107    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-dshm\") pod \"608902ff-5776-4c1c-835f-5da46c271d79\" (UID: \"608902ff-5776-4c1c-835f-5da46c271d79\") "
Jul 30 03:18:49.527306 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.527261    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "608902ff-5776-4c1c-835f-5da46c271d79" (UID: "608902ff-5776-4c1c-835f-5da46c271d79"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:18:49.527471 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.527449    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-home\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:18:49.527471 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.527471    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-model-cache\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:18:49.527663 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.527482    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-tmp-dir\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:18:49.528882 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.528854    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/608902ff-5776-4c1c-835f-5da46c271d79-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "608902ff-5776-4c1c-835f-5da46c271d79" (UID: "608902ff-5776-4c1c-835f-5da46c271d79"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:18:49.528981 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.528896    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/608902ff-5776-4c1c-835f-5da46c271d79-kube-api-access-98gjh" (OuterVolumeSpecName: "kube-api-access-98gjh") pod "608902ff-5776-4c1c-835f-5da46c271d79" (UID: "608902ff-5776-4c1c-835f-5da46c271d79"). InnerVolumeSpecName "kube-api-access-98gjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:18:49.529052 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.529034    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-dshm" (OuterVolumeSpecName: "dshm") pod "608902ff-5776-4c1c-835f-5da46c271d79" (UID: "608902ff-5776-4c1c-835f-5da46c271d79"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:18:49.629118 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.629085    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98gjh\" (UniqueName: \"kubernetes.io/projected/608902ff-5776-4c1c-835f-5da46c271d79-kube-api-access-98gjh\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:18:49.629262 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.629121    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/608902ff-5776-4c1c-835f-5da46c271d79-tls-certs\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:18:49.629262 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.629138    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/608902ff-5776-4c1c-835f-5da46c271d79-dshm\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:18:49.648071 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.648045    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"]
Jul 30 03:18:49.648449 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.648435    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="608902ff-5776-4c1c-835f-5da46c271d79" containerName="main"
Jul 30 03:18:49.648491 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.648451    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="608902ff-5776-4c1c-835f-5da46c271d79" containerName="main"
Jul 30 03:18:49.648529 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.648518    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="608902ff-5776-4c1c-835f-5da46c271d79" containerName="main"
Jul 30 03:18:49.651463 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.651447    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.653965 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.653941    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-da5459\"/\"rate-test-model-da5459-kserve-self-signed-certs\""
Jul 30 03:18:49.661920 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.661899    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"]
Jul 30 03:18:49.792788 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.792713    2554 generic.go:356] "Generic (PLEG): container finished" podID="608902ff-5776-4c1c-835f-5da46c271d79" containerID="a39a5ed8064683c0152bcf5361cb343a7f265850035204ff5be980d7e6d8f166" exitCode=0
Jul 30 03:18:49.792788 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.792760    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"
Jul 30 03:18:49.792958 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.792761    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw" event={"ID":"608902ff-5776-4c1c-835f-5da46c271d79","Type":"ContainerDied","Data":"a39a5ed8064683c0152bcf5361cb343a7f265850035204ff5be980d7e6d8f166"}
Jul 30 03:18:49.792958 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.792872    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw" event={"ID":"608902ff-5776-4c1c-835f-5da46c271d79","Type":"ContainerDied","Data":"ed2cc00f349a22c369e22988df8076b6b8b35298da61b63389379b6b6f78503b"}
Jul 30 03:18:49.792958 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.792895    2554 scope.go:117] "RemoveContainer" containerID="a39a5ed8064683c0152bcf5361cb343a7f265850035204ff5be980d7e6d8f166"
Jul 30 03:18:49.801524 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.801509    2554 scope.go:117] "RemoveContainer" containerID="a39a5ed8064683c0152bcf5361cb343a7f265850035204ff5be980d7e6d8f166"
Jul 30 03:18:49.801806 ip-10-0-136-75 kubenswrapper[2554]: E0730 03:18:49.801786    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a39a5ed8064683c0152bcf5361cb343a7f265850035204ff5be980d7e6d8f166\": container with ID starting with a39a5ed8064683c0152bcf5361cb343a7f265850035204ff5be980d7e6d8f166 not found: ID does not exist" containerID="a39a5ed8064683c0152bcf5361cb343a7f265850035204ff5be980d7e6d8f166"
Jul 30 03:18:49.801856 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.801814    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a39a5ed8064683c0152bcf5361cb343a7f265850035204ff5be980d7e6d8f166"} err="failed to get container status \"a39a5ed8064683c0152bcf5361cb343a7f265850035204ff5be980d7e6d8f166\": rpc error: code = NotFound desc = could not find container \"a39a5ed8064683c0152bcf5361cb343a7f265850035204ff5be980d7e6d8f166\": container with ID starting with a39a5ed8064683c0152bcf5361cb343a7f265850035204ff5be980d7e6d8f166 not found: ID does not exist"
Jul 30 03:18:49.813685 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.813663    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"]
Jul 30 03:18:49.817867 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.817846    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/sub-test-model-da5459-kserve-d54956f75-xfjdw"]
Jul 30 03:18:49.831573 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.831535    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b569\" (UniqueName: \"kubernetes.io/projected/d9d43212-7628-49e6-9263-19336b16c127-kube-api-access-8b569\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.831675 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.831630    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-dshm\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.831675 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.831662    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9d43212-7628-49e6-9263-19336b16c127-tls-certs\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.831807 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.831789    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-home\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.831863 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.831821    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-tmp-dir\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.831918 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.831862    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-model-cache\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.932850 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.932816    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-home\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.932992 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.932858    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-tmp-dir\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.932992 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.932884    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-model-cache\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.932992 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.932955    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b569\" (UniqueName: \"kubernetes.io/projected/d9d43212-7628-49e6-9263-19336b16c127-kube-api-access-8b569\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.933153 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.932994    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-dshm\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.933153 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.933017    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9d43212-7628-49e6-9263-19336b16c127-tls-certs\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.933296 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.933231    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-home\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.933296 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.933278    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-tmp-dir\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.933409 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.933310    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-model-cache\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.935105 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.935085    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-dshm\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.935386 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.935370    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9d43212-7628-49e6-9263-19336b16c127-tls-certs\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.941153 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.941136    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b569\" (UniqueName: \"kubernetes.io/projected/d9d43212-7628-49e6-9263-19336b16c127-kube-api-access-8b569\") pod \"rate-test-model-da5459-kserve-584b66dcc5-6pcrm\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") " pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:49.961005 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:49.960982    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:50.037196 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.037152    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn" podUID="9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2" containerName="main" containerID="cri-o://548e8526be882af7693d9d4c4bd642b655017ba49c2a0801c33ceb4858ff6693" gracePeriod=45
Jul 30 03:18:50.096651 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.096628    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"]
Jul 30 03:18:50.107611 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:18:50.107584    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9d43212_7628_49e6_9263_19336b16c127.slice/crio-b9e22cee5cea2efc91678d59a8e30ae4ea37c11d59b0f63dbdd2daa3226290ef WatchSource:0}: Error finding container b9e22cee5cea2efc91678d59a8e30ae4ea37c11d59b0f63dbdd2daa3226290ef: Status 404 returned error can't find the container with id b9e22cee5cea2efc91678d59a8e30ae4ea37c11d59b0f63dbdd2daa3226290ef
Jul 30 03:18:50.301429 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.301368    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:18:50.436649 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.436614    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-dshm\") pod \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") "
Jul 30 03:18:50.436649 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.436655    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-model-cache\") pod \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") "
Jul 30 03:18:50.436895 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.436683    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8c54\" (UniqueName: \"kubernetes.io/projected/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-kube-api-access-m8c54\") pod \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") "
Jul 30 03:18:50.436895 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.436700    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-tls-certs\") pod \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") "
Jul 30 03:18:50.436895 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.436744    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-home\") pod \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") "
Jul 30 03:18:50.436895 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.436792    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-tmp-dir\") pod \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\" (UID: \"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2\") "
Jul 30 03:18:50.437120 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.436953    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-model-cache" (OuterVolumeSpecName: "model-cache") pod "9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2" (UID: "9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:18:50.437120 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.437041    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-home" (OuterVolumeSpecName: "home") pod "9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2" (UID: "9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:18:50.437120 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.437075    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2" (UID: "9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:18:50.437279 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.437174    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-model-cache\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:18:50.437279 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.437191    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-home\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:18:50.437279 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.437203    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-tmp-dir\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:18:50.438914 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.438883    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-dshm" (OuterVolumeSpecName: "dshm") pod "9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2" (UID: "9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:18:50.438914 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.438905    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2" (UID: "9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:18:50.439053 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.438934    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-kube-api-access-m8c54" (OuterVolumeSpecName: "kube-api-access-m8c54") pod "9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2" (UID: "9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2"). InnerVolumeSpecName "kube-api-access-m8c54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:18:50.538574 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.538521    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-dshm\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:18:50.538574 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.538573    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8c54\" (UniqueName: \"kubernetes.io/projected/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-kube-api-access-m8c54\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:18:50.538753 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.538586    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2-tls-certs\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:18:50.641260 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.641182    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="608902ff-5776-4c1c-835f-5da46c271d79" path="/var/lib/kubelet/pods/608902ff-5776-4c1c-835f-5da46c271d79/volumes"
Jul 30 03:18:50.800981 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.800943    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm" event={"ID":"d9d43212-7628-49e6-9263-19336b16c127","Type":"ContainerStarted","Data":"9f7ff3597034333bfbd7af28cfa6d0da2364cb93745c29933a8c599cc833a98a"}
Jul 30 03:18:50.801184 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.800991    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm" event={"ID":"d9d43212-7628-49e6-9263-19336b16c127","Type":"ContainerStarted","Data":"b9e22cee5cea2efc91678d59a8e30ae4ea37c11d59b0f63dbdd2daa3226290ef"}
Jul 30 03:18:50.803447 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.803416    2554 generic.go:356] "Generic (PLEG): container finished" podID="9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2" containerID="548e8526be882af7693d9d4c4bd642b655017ba49c2a0801c33ceb4858ff6693" exitCode=0
Jul 30 03:18:50.803599 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.803453    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"
Jul 30 03:18:50.803599 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.803500    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn" event={"ID":"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2","Type":"ContainerDied","Data":"548e8526be882af7693d9d4c4bd642b655017ba49c2a0801c33ceb4858ff6693"}
Jul 30 03:18:50.803599 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.803568    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn" event={"ID":"9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2","Type":"ContainerDied","Data":"999217d891d57726a28e39db908bac7024cd2dfd13f3cd1751312913555abd4a"}
Jul 30 03:18:50.803599 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.803582    2554 scope.go:117] "RemoveContainer" containerID="548e8526be882af7693d9d4c4bd642b655017ba49c2a0801c33ceb4858ff6693"
Jul 30 03:18:50.813415 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.813394    2554 scope.go:117] "RemoveContainer" containerID="548e8526be882af7693d9d4c4bd642b655017ba49c2a0801c33ceb4858ff6693"
Jul 30 03:18:50.813719 ip-10-0-136-75 kubenswrapper[2554]: E0730 03:18:50.813699    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"548e8526be882af7693d9d4c4bd642b655017ba49c2a0801c33ceb4858ff6693\": container with ID starting with 548e8526be882af7693d9d4c4bd642b655017ba49c2a0801c33ceb4858ff6693 not found: ID does not exist" containerID="548e8526be882af7693d9d4c4bd642b655017ba49c2a0801c33ceb4858ff6693"
Jul 30 03:18:50.813809 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.813731    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548e8526be882af7693d9d4c4bd642b655017ba49c2a0801c33ceb4858ff6693"} err="failed to get container status \"548e8526be882af7693d9d4c4bd642b655017ba49c2a0801c33ceb4858ff6693\": rpc error: code = NotFound desc = could not find container \"548e8526be882af7693d9d4c4bd642b655017ba49c2a0801c33ceb4858ff6693\": container with ID starting with 548e8526be882af7693d9d4c4bd642b655017ba49c2a0801c33ceb4858ff6693 not found: ID does not exist"
Jul 30 03:18:50.819259 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.819222    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm" podStartSLOduration=1.819209765 podStartE2EDuration="1.819209765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:18:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:18:50.817323314 +0000 UTC m=+3166.667636048" watchObservedRunningTime="2026-07-30 03:18:50.819209765 +0000 UTC m=+3166.669522495"
Jul 30 03:18:50.830210 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.830184    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"]
Jul 30 03:18:50.834247 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:50.834226    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/sub-test-model-f2a805-kserve-9cbf7c96c-2knsn"]
Jul 30 03:18:52.641621 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:52.641590    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2" path="/var/lib/kubelet/pods/9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2/volumes"
Jul 30 03:18:53.833625 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:53.833591    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:18:59.961089 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:59.961052    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:59.961476 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:59.961112    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:18:59.973357 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:18:59.973329    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:19:00.865408 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:00.865376    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:19:11.929505 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:11.929467    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"]
Jul 30 03:19:11.930064 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:11.930043    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2" containerName="main"
Jul 30 03:19:11.930108 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:11.930069    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2" containerName="main"
Jul 30 03:19:11.930188 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:11.930176    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eeb3d28-c4e7-4c98-bd01-f76b4f34c2e2" containerName="main"
Jul 30 03:19:11.934977 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:11.934957    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:11.938468 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:11.938441    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2a805\"/\"openshift-service-ca.crt\""
Jul 30 03:19:11.938608 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:11.938443    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2a805\"/\"kube-root-ca.crt\""
Jul 30 03:19:11.938608 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:11.938479    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2a805\"/\"rate-test-model-f2a805-kserve-self-signed-certs\""
Jul 30 03:19:11.938608 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:11.938445    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2a805\"/\"default-dockercfg-f492q\""
Jul 30 03:19:11.942912 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:11.942892    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"]
Jul 30 03:19:12.019394 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.019367    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-tls-certs\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.019541 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.019445    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-model-cache\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.019541 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.019472    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-tmp-dir\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.019541 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.019498    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-dshm\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.019702 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.019583    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-home\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.019702 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.019654    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2svtp\" (UniqueName: \"kubernetes.io/projected/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-kube-api-access-2svtp\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.120255 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.120229    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2svtp\" (UniqueName: \"kubernetes.io/projected/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-kube-api-access-2svtp\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.120397 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.120277    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-tls-certs\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.120397 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.120340    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-model-cache\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.120397 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.120364    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-tmp-dir\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.120587 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.120430    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-dshm\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.120587 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.120473    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-home\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.120800 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.120774    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-model-cache\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.120867 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.120847    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-tmp-dir\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.120867 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.120860    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-home\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.122719 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.122698    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-dshm\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.122920 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.122903    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-tls-certs\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.128994 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.128974    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2svtp\" (UniqueName: \"kubernetes.io/projected/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-kube-api-access-2svtp\") pod \"rate-test-model-f2a805-kserve-686f9859c9-mln4q\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") " pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.245174 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.245103    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:12.378012 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.377985    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"]
Jul 30 03:19:12.380165 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:19:12.380135    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b4e67dd_ad80_4b4a_b5cc_c52f50c6ac24.slice/crio-95dd94d609203b6d07eb1bc699339d07bd76f48d4a3e5c7b656819627be12702 WatchSource:0}: Error finding container 95dd94d609203b6d07eb1bc699339d07bd76f48d4a3e5c7b656819627be12702: Status 404 returned error can't find the container with id 95dd94d609203b6d07eb1bc699339d07bd76f48d4a3e5c7b656819627be12702
Jul 30 03:19:12.914772 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.914734    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q" event={"ID":"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24","Type":"ContainerStarted","Data":"adb4f864a87fd5dd596bf7ceb9dfea178cf8450a89e12ef39cbef333ce350adb"}
Jul 30 03:19:12.914772 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.914773    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q" event={"ID":"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24","Type":"ContainerStarted","Data":"95dd94d609203b6d07eb1bc699339d07bd76f48d4a3e5c7b656819627be12702"}
Jul 30 03:19:12.931808 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:12.931760    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q" podStartSLOduration=1.931746325 podStartE2EDuration="1.931746325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:19:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:19:12.93049923 +0000 UTC m=+3188.780812070" watchObservedRunningTime="2026-07-30 03:19:12.931746325 +0000 UTC m=+3188.782059055"
Jul 30 03:19:15.624436 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:15.624402    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:19:22.245595 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:22.245532    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:22.246064 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:22.245612    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:22.257949 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:22.257925    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:22.978739 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:22.978710    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:19:48.631112 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:19:48.631070    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:20:07.631000 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:07.630918    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:20:15.004288 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:15.004255    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"]
Jul 30 03:20:16.034984 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:16.034950    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"]
Jul 30 03:20:22.829096 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:22.829064    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:20:30.023183 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.023117    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm" podUID="d9d43212-7628-49e6-9263-19336b16c127" containerName="main" containerID="cri-o://9f7ff3597034333bfbd7af28cfa6d0da2364cb93745c29933a8c599cc833a98a" gracePeriod=45
Jul 30 03:20:30.265914 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.265887    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:20:30.292595 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.292524    2554 generic.go:356] "Generic (PLEG): container finished" podID="d9d43212-7628-49e6-9263-19336b16c127" containerID="9f7ff3597034333bfbd7af28cfa6d0da2364cb93745c29933a8c599cc833a98a" exitCode=0
Jul 30 03:20:30.292595 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.292578    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm" event={"ID":"d9d43212-7628-49e6-9263-19336b16c127","Type":"ContainerDied","Data":"9f7ff3597034333bfbd7af28cfa6d0da2364cb93745c29933a8c599cc833a98a"}
Jul 30 03:20:30.292744 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.292623    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm" event={"ID":"d9d43212-7628-49e6-9263-19336b16c127","Type":"ContainerDied","Data":"b9e22cee5cea2efc91678d59a8e30ae4ea37c11d59b0f63dbdd2daa3226290ef"}
Jul 30 03:20:30.292744 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.292643    2554 scope.go:117] "RemoveContainer" containerID="9f7ff3597034333bfbd7af28cfa6d0da2364cb93745c29933a8c599cc833a98a"
Jul 30 03:20:30.292744 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.292589    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"
Jul 30 03:20:30.301775 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.301749    2554 scope.go:117] "RemoveContainer" containerID="9f7ff3597034333bfbd7af28cfa6d0da2364cb93745c29933a8c599cc833a98a"
Jul 30 03:20:30.302033 ip-10-0-136-75 kubenswrapper[2554]: E0730 03:20:30.302015    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f7ff3597034333bfbd7af28cfa6d0da2364cb93745c29933a8c599cc833a98a\": container with ID starting with 9f7ff3597034333bfbd7af28cfa6d0da2364cb93745c29933a8c599cc833a98a not found: ID does not exist" containerID="9f7ff3597034333bfbd7af28cfa6d0da2364cb93745c29933a8c599cc833a98a"
Jul 30 03:20:30.302103 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.302047    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f7ff3597034333bfbd7af28cfa6d0da2364cb93745c29933a8c599cc833a98a"} err="failed to get container status \"9f7ff3597034333bfbd7af28cfa6d0da2364cb93745c29933a8c599cc833a98a\": rpc error: code = NotFound desc = could not find container \"9f7ff3597034333bfbd7af28cfa6d0da2364cb93745c29933a8c599cc833a98a\": container with ID starting with 9f7ff3597034333bfbd7af28cfa6d0da2364cb93745c29933a8c599cc833a98a not found: ID does not exist"
Jul 30 03:20:30.396807 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.396758    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-tmp-dir\") pod \"d9d43212-7628-49e6-9263-19336b16c127\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") "
Jul 30 03:20:30.397003 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.396866    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-dshm\") pod \"d9d43212-7628-49e6-9263-19336b16c127\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") "
Jul 30 03:20:30.397003 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.396891    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-model-cache\") pod \"d9d43212-7628-49e6-9263-19336b16c127\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") "
Jul 30 03:20:30.397003 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.396913    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8b569\" (UniqueName: \"kubernetes.io/projected/d9d43212-7628-49e6-9263-19336b16c127-kube-api-access-8b569\") pod \"d9d43212-7628-49e6-9263-19336b16c127\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") "
Jul 30 03:20:30.397003 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.396927    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-home\") pod \"d9d43212-7628-49e6-9263-19336b16c127\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") "
Jul 30 03:20:30.397003 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.396985    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9d43212-7628-49e6-9263-19336b16c127-tls-certs\") pod \"d9d43212-7628-49e6-9263-19336b16c127\" (UID: \"d9d43212-7628-49e6-9263-19336b16c127\") "
Jul 30 03:20:30.397235 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.397044    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d9d43212-7628-49e6-9263-19336b16c127" (UID: "d9d43212-7628-49e6-9263-19336b16c127"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:20:30.397235 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.397167    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-model-cache" (OuterVolumeSpecName: "model-cache") pod "d9d43212-7628-49e6-9263-19336b16c127" (UID: "d9d43212-7628-49e6-9263-19336b16c127"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:20:30.397345 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.397281    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-tmp-dir\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:20:30.397345 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.397301    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-model-cache\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:20:30.397345 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.397313    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-home" (OuterVolumeSpecName: "home") pod "d9d43212-7628-49e6-9263-19336b16c127" (UID: "d9d43212-7628-49e6-9263-19336b16c127"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:20:30.399100 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.399080    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-dshm" (OuterVolumeSpecName: "dshm") pod "d9d43212-7628-49e6-9263-19336b16c127" (UID: "d9d43212-7628-49e6-9263-19336b16c127"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:20:30.399188 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.399112    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d43212-7628-49e6-9263-19336b16c127-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d9d43212-7628-49e6-9263-19336b16c127" (UID: "d9d43212-7628-49e6-9263-19336b16c127"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:20:30.399251 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.399219    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9d43212-7628-49e6-9263-19336b16c127-kube-api-access-8b569" (OuterVolumeSpecName: "kube-api-access-8b569") pod "d9d43212-7628-49e6-9263-19336b16c127" (UID: "d9d43212-7628-49e6-9263-19336b16c127"). InnerVolumeSpecName "kube-api-access-8b569". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:20:30.498245 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.498212    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-dshm\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:20:30.498245 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.498241    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b569\" (UniqueName: \"kubernetes.io/projected/d9d43212-7628-49e6-9263-19336b16c127-kube-api-access-8b569\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:20:30.498245 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.498253    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9d43212-7628-49e6-9263-19336b16c127-home\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:20:30.498495 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.498262    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9d43212-7628-49e6-9263-19336b16c127-tls-certs\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:20:30.614619 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.614580    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"]
Jul 30 03:20:30.618631 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.618603    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-da5459/rate-test-model-da5459-kserve-584b66dcc5-6pcrm"]
Jul 30 03:20:30.641691 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:30.641653    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9d43212-7628-49e6-9263-19336b16c127" path="/var/lib/kubelet/pods/d9d43212-7628-49e6-9263-19336b16c127/volumes"
Jul 30 03:20:31.054047 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.053984    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q" podUID="2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24" containerName="main" containerID="cri-o://adb4f864a87fd5dd596bf7ceb9dfea178cf8450a89e12ef39cbef333ce350adb" gracePeriod=45
Jul 30 03:20:31.299628 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.299605    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:20:31.300092 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.300066    2554 generic.go:356] "Generic (PLEG): container finished" podID="2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24" containerID="adb4f864a87fd5dd596bf7ceb9dfea178cf8450a89e12ef39cbef333ce350adb" exitCode=0
Jul 30 03:20:31.300195 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.300102    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q" event={"ID":"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24","Type":"ContainerDied","Data":"adb4f864a87fd5dd596bf7ceb9dfea178cf8450a89e12ef39cbef333ce350adb"}
Jul 30 03:20:31.300195 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.300137    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q" event={"ID":"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24","Type":"ContainerDied","Data":"95dd94d609203b6d07eb1bc699339d07bd76f48d4a3e5c7b656819627be12702"}
Jul 30 03:20:31.300195 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.300155    2554 scope.go:117] "RemoveContainer" containerID="adb4f864a87fd5dd596bf7ceb9dfea178cf8450a89e12ef39cbef333ce350adb"
Jul 30 03:20:31.308166 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.308144    2554 scope.go:117] "RemoveContainer" containerID="adb4f864a87fd5dd596bf7ceb9dfea178cf8450a89e12ef39cbef333ce350adb"
Jul 30 03:20:31.308464 ip-10-0-136-75 kubenswrapper[2554]: E0730 03:20:31.308443    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adb4f864a87fd5dd596bf7ceb9dfea178cf8450a89e12ef39cbef333ce350adb\": container with ID starting with adb4f864a87fd5dd596bf7ceb9dfea178cf8450a89e12ef39cbef333ce350adb not found: ID does not exist" containerID="adb4f864a87fd5dd596bf7ceb9dfea178cf8450a89e12ef39cbef333ce350adb"
Jul 30 03:20:31.308527 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.308485    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adb4f864a87fd5dd596bf7ceb9dfea178cf8450a89e12ef39cbef333ce350adb"} err="failed to get container status \"adb4f864a87fd5dd596bf7ceb9dfea178cf8450a89e12ef39cbef333ce350adb\": rpc error: code = NotFound desc = could not find container \"adb4f864a87fd5dd596bf7ceb9dfea178cf8450a89e12ef39cbef333ce350adb\": container with ID starting with adb4f864a87fd5dd596bf7ceb9dfea178cf8450a89e12ef39cbef333ce350adb not found: ID does not exist"
Jul 30 03:20:31.406208 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.406169    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-dshm\") pod \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") "
Jul 30 03:20:31.406208 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.406215    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-tmp-dir\") pod \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") "
Jul 30 03:20:31.406447 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.406252    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-model-cache\") pod \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") "
Jul 30 03:20:31.406447 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.406295    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-home\") pod \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") "
Jul 30 03:20:31.406447 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.406354    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2svtp\" (UniqueName: \"kubernetes.io/projected/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-kube-api-access-2svtp\") pod \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") "
Jul 30 03:20:31.406447 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.406381    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-tls-certs\") pod \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\" (UID: \"2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24\") "
Jul 30 03:20:31.406686 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.406521    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24" (UID: "2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:20:31.406686 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.406537    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24" (UID: "2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:20:31.406686 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.406661    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-home" (OuterVolumeSpecName: "home") pod "2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24" (UID: "2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:20:31.406796 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.406709    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-model-cache\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:20:31.408380 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.408359    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-dshm" (OuterVolumeSpecName: "dshm") pod "2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24" (UID: "2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:20:31.408511 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.408492    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-kube-api-access-2svtp" (OuterVolumeSpecName: "kube-api-access-2svtp") pod "2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24" (UID: "2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24"). InnerVolumeSpecName "kube-api-access-2svtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:20:31.408573 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.408495    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24" (UID: "2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:20:31.507311 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.507277    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-dshm\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:20:31.507311 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.507305    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-tmp-dir\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:20:31.507311 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.507316    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-home\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:20:31.507521 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.507328    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2svtp\" (UniqueName: \"kubernetes.io/projected/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-kube-api-access-2svtp\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:20:31.507521 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.507342    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24-tls-certs\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:20:31.866068 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.866027    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7697-140339311367344"]
Jul 30 03:20:31.866483 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.866463    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24" containerName="main"
Jul 30 03:20:31.866590 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.866485    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24" containerName="main"
Jul 30 03:20:31.866590 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.866497    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d43212-7628-49e6-9263-19336b16c127" containerName="main"
Jul 30 03:20:31.866590 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.866505    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d43212-7628-49e6-9263-19336b16c127" containerName="main"
Jul 30 03:20:31.866756 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.866616    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d43212-7628-49e6-9263-19336b16c127" containerName="main"
Jul 30 03:20:31.866756 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.866630    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24" containerName="main"
Jul 30 03:20:31.871051 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.871025    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7697-140339311367344"
Jul 30 03:20:31.873077 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.873038    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7697-140339311367344"]
Jul 30 03:20:31.873335 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:31.873314    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dkgjx\""
Jul 30 03:20:32.011876 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:32.011837    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhlp7\" (UniqueName: \"kubernetes.io/projected/ddac8ef1-c3e9-4b77-a9d1-0025adcf90da-kube-api-access-zhlp7\") pod \"test-curl-7697-140339311367344\" (UID: \"ddac8ef1-c3e9-4b77-a9d1-0025adcf90da\") " pod="opendatahub/test-curl-7697-140339311367344"
Jul 30 03:20:32.112434 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:32.112395    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhlp7\" (UniqueName: \"kubernetes.io/projected/ddac8ef1-c3e9-4b77-a9d1-0025adcf90da-kube-api-access-zhlp7\") pod \"test-curl-7697-140339311367344\" (UID: \"ddac8ef1-c3e9-4b77-a9d1-0025adcf90da\") " pod="opendatahub/test-curl-7697-140339311367344"
Jul 30 03:20:32.121380 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:32.121315    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhlp7\" (UniqueName: \"kubernetes.io/projected/ddac8ef1-c3e9-4b77-a9d1-0025adcf90da-kube-api-access-zhlp7\") pod \"test-curl-7697-140339311367344\" (UID: \"ddac8ef1-c3e9-4b77-a9d1-0025adcf90da\") " pod="opendatahub/test-curl-7697-140339311367344"
Jul 30 03:20:32.180788 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:32.180755    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7697-140339311367344"
Jul 30 03:20:32.306666 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:32.306625    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"
Jul 30 03:20:32.307757 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:32.307735    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7697-140339311367344"]
Jul 30 03:20:32.309776 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:20:32.309746    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddac8ef1_c3e9_4b77_a9d1_0025adcf90da.slice/crio-878225b12807229d9384613fce09393449b6520871989924ab3a075db1375304 WatchSource:0}: Error finding container 878225b12807229d9384613fce09393449b6520871989924ab3a075db1375304: Status 404 returned error can't find the container with id 878225b12807229d9384613fce09393449b6520871989924ab3a075db1375304
Jul 30 03:20:32.311374 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:32.311356    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 03:20:32.330416 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:32.330388    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"]
Jul 30 03:20:32.334380 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:32.334360    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f2a805/rate-test-model-f2a805-kserve-686f9859c9-mln4q"]
Jul 30 03:20:32.644795 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:32.644758    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24" path="/var/lib/kubelet/pods/2b4e67dd-ad80-4b4a-b5cc-c52f50c6ac24/volumes"
Jul 30 03:20:33.313265 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:33.313229    2554 generic.go:356] "Generic (PLEG): container finished" podID="ddac8ef1-c3e9-4b77-a9d1-0025adcf90da" containerID="6995eb0d33fc33f077368cfff5f21ca838d93d26b1f42288f62a7f07bfea5712" exitCode=0
Jul 30 03:20:33.313659 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:33.313281    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7697-140339311367344" event={"ID":"ddac8ef1-c3e9-4b77-a9d1-0025adcf90da","Type":"ContainerDied","Data":"6995eb0d33fc33f077368cfff5f21ca838d93d26b1f42288f62a7f07bfea5712"}
Jul 30 03:20:33.313659 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:33.313312    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7697-140339311367344" event={"ID":"ddac8ef1-c3e9-4b77-a9d1-0025adcf90da","Type":"ContainerStarted","Data":"878225b12807229d9384613fce09393449b6520871989924ab3a075db1375304"}
Jul 30 03:20:34.447636 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:34.447612    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7697-140339311367344"
Jul 30 03:20:34.481525 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:34.481494    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7697-140339311367344_ddac8ef1-c3e9-4b77-a9d1-0025adcf90da/test-curl-7697-140339311367344/0.log"
Jul 30 03:20:34.502204 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:34.502175    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7697-140339311367344"]
Jul 30 03:20:34.505648 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:34.505623    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7697-140339311367344"]
Jul 30 03:20:34.533226 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:34.533204    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhlp7\" (UniqueName: \"kubernetes.io/projected/ddac8ef1-c3e9-4b77-a9d1-0025adcf90da-kube-api-access-zhlp7\") pod \"ddac8ef1-c3e9-4b77-a9d1-0025adcf90da\" (UID: \"ddac8ef1-c3e9-4b77-a9d1-0025adcf90da\") "
Jul 30 03:20:34.535335 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:34.535309    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddac8ef1-c3e9-4b77-a9d1-0025adcf90da-kube-api-access-zhlp7" (OuterVolumeSpecName: "kube-api-access-zhlp7") pod "ddac8ef1-c3e9-4b77-a9d1-0025adcf90da" (UID: "ddac8ef1-c3e9-4b77-a9d1-0025adcf90da"). InnerVolumeSpecName "kube-api-access-zhlp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:20:34.634602 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:34.634527    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhlp7\" (UniqueName: \"kubernetes.io/projected/ddac8ef1-c3e9-4b77-a9d1-0025adcf90da-kube-api-access-zhlp7\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:20:34.642075 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:34.642049    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddac8ef1-c3e9-4b77-a9d1-0025adcf90da" path="/var/lib/kubelet/pods/ddac8ef1-c3e9-4b77-a9d1-0025adcf90da/volumes"
Jul 30 03:20:35.324712 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:35.324683    2554 scope.go:117] "RemoveContainer" containerID="6995eb0d33fc33f077368cfff5f21ca838d93d26b1f42288f62a7f07bfea5712"
Jul 30 03:20:35.324902 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:35.324684    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7697-140339311367344"
Jul 30 03:20:44.484064 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:44.484029    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pmkhm"]
Jul 30 03:20:44.484508 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:44.484404    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddac8ef1-c3e9-4b77-a9d1-0025adcf90da" containerName="test-curl-7697-140339311367344"
Jul 30 03:20:44.484508 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:44.484416    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddac8ef1-c3e9-4b77-a9d1-0025adcf90da" containerName="test-curl-7697-140339311367344"
Jul 30 03:20:44.484508 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:44.484483    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddac8ef1-c3e9-4b77-a9d1-0025adcf90da" containerName="test-curl-7697-140339311367344"
Jul 30 03:20:44.488690 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:44.488652    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pmkhm"
Jul 30 03:20:44.491190 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:44.491168    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-t9nl7\""
Jul 30 03:20:44.495851 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:44.495823    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pmkhm"]
Jul 30 03:20:44.517885 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:44.517860    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk2bb\" (UniqueName: \"kubernetes.io/projected/615ac7bd-5088-445c-9bac-697203e0e50d-kube-api-access-jk2bb\") pod \"kuadrant-operator-catalog-pmkhm\" (UID: \"615ac7bd-5088-445c-9bac-697203e0e50d\") " pod="kuadrant-system/kuadrant-operator-catalog-pmkhm"
Jul 30 03:20:44.618772 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:44.618738    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk2bb\" (UniqueName: \"kubernetes.io/projected/615ac7bd-5088-445c-9bac-697203e0e50d-kube-api-access-jk2bb\") pod \"kuadrant-operator-catalog-pmkhm\" (UID: \"615ac7bd-5088-445c-9bac-697203e0e50d\") " pod="kuadrant-system/kuadrant-operator-catalog-pmkhm"
Jul 30 03:20:44.627106 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:44.627085    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk2bb\" (UniqueName: \"kubernetes.io/projected/615ac7bd-5088-445c-9bac-697203e0e50d-kube-api-access-jk2bb\") pod \"kuadrant-operator-catalog-pmkhm\" (UID: \"615ac7bd-5088-445c-9bac-697203e0e50d\") " pod="kuadrant-system/kuadrant-operator-catalog-pmkhm"
Jul 30 03:20:44.799447 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:44.799412    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pmkhm"
Jul 30 03:20:44.928346 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:44.928302    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pmkhm"]
Jul 30 03:20:44.930742 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:20:44.930718    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod615ac7bd_5088_445c_9bac_697203e0e50d.slice/crio-aa55a555a2ddf390dd7a20e19930954839f1d6cf3adf69d50b40552964786bb1 WatchSource:0}: Error finding container aa55a555a2ddf390dd7a20e19930954839f1d6cf3adf69d50b40552964786bb1: Status 404 returned error can't find the container with id aa55a555a2ddf390dd7a20e19930954839f1d6cf3adf69d50b40552964786bb1
Jul 30 03:20:45.373790 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:45.373741    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pmkhm" event={"ID":"615ac7bd-5088-445c-9bac-697203e0e50d","Type":"ContainerStarted","Data":"aa55a555a2ddf390dd7a20e19930954839f1d6cf3adf69d50b40552964786bb1"}
Jul 30 03:20:47.388879 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:47.388840    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pmkhm" event={"ID":"615ac7bd-5088-445c-9bac-697203e0e50d","Type":"ContainerStarted","Data":"b544cb473cae584726272cf5082eaf98f6950d68c0fe2974acd1955131e30656"}
Jul 30 03:20:47.404863 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:47.404816    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pmkhm" podStartSLOduration=1.5787850049999999 podStartE2EDuration="3.404800924s" totalImagesPullingTime="1.826015919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:20:47.402439631 +0000 UTC m=+3283.252752361" watchObservedRunningTime="2026-07-30 03:20:47.404800924 +0000 UTC m=+3283.255113654"
Jul 30 03:20:47.529357 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:47.529321    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:20:54.800478 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:54.800432    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pmkhm"
Jul 30 03:20:54.800942 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:54.800495    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pmkhm"
Jul 30 03:20:54.821728 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:54.821700    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pmkhm"
Jul 30 03:20:55.446486 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:55.446432    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pmkhm"
Jul 30 03:20:55.484636 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:55.484607    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pmkhm"]
Jul 30 03:20:57.435045 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.435002    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-pmkhm" podUID="615ac7bd-5088-445c-9bac-697203e0e50d" containerName="registry-server" containerID="cri-o://b544cb473cae584726272cf5082eaf98f6950d68c0fe2974acd1955131e30656" gracePeriod=2
Jul 30 03:20:57.679211 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.679188    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pmkhm"
Jul 30 03:20:57.738352 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.738280    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk2bb\" (UniqueName: \"kubernetes.io/projected/615ac7bd-5088-445c-9bac-697203e0e50d-kube-api-access-jk2bb\") pod \"615ac7bd-5088-445c-9bac-697203e0e50d\" (UID: \"615ac7bd-5088-445c-9bac-697203e0e50d\") "
Jul 30 03:20:57.740317 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.740288    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/615ac7bd-5088-445c-9bac-697203e0e50d-kube-api-access-jk2bb" (OuterVolumeSpecName: "kube-api-access-jk2bb") pod "615ac7bd-5088-445c-9bac-697203e0e50d" (UID: "615ac7bd-5088-445c-9bac-697203e0e50d"). InnerVolumeSpecName "kube-api-access-jk2bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:20:57.839810 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.839777    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk2bb\" (UniqueName: \"kubernetes.io/projected/615ac7bd-5088-445c-9bac-697203e0e50d-kube-api-access-jk2bb\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:20:57.876511 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.876477    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"]
Jul 30 03:20:57.877031 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.877010    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="615ac7bd-5088-445c-9bac-697203e0e50d" containerName="registry-server"
Jul 30 03:20:57.877031 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.877031    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="615ac7bd-5088-445c-9bac-697203e0e50d" containerName="registry-server"
Jul 30 03:20:57.877176 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.877115    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="615ac7bd-5088-445c-9bac-697203e0e50d" containerName="registry-server"
Jul 30 03:20:57.880390 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.880370    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:20:57.882830 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.882807    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-f58ab6-serving-cert\""
Jul 30 03:20:57.882935 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.882807    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-v5sbq\""
Jul 30 03:20:57.883164 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.883146    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 03:20:57.883293 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.883271    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 03:20:57.892209 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.892187    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"]
Jul 30 03:20:57.940583 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.940541    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05fb7bf-baa3-4cf5-849a-7b6887e75222-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l\" (UID: \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:20:57.940705 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.940589    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzjd2\" (UniqueName: \"kubernetes.io/projected/d05fb7bf-baa3-4cf5-849a-7b6887e75222-kube-api-access-vzjd2\") pod \"maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l\" (UID: \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:20:57.940705 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:57.940627    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05fb7bf-baa3-4cf5-849a-7b6887e75222-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l\" (UID: \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:20:58.041685 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.041657    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05fb7bf-baa3-4cf5-849a-7b6887e75222-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l\" (UID: \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:20:58.041882 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.041690    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzjd2\" (UniqueName: \"kubernetes.io/projected/d05fb7bf-baa3-4cf5-849a-7b6887e75222-kube-api-access-vzjd2\") pod \"maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l\" (UID: \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:20:58.041882 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.041726    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05fb7bf-baa3-4cf5-849a-7b6887e75222-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l\" (UID: \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:20:58.041882 ip-10-0-136-75 kubenswrapper[2554]: E0730 03:20:58.041825    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-serving-cert: secret "maas-api-e2e-ipp-b-f58ab6-serving-cert" not found
Jul 30 03:20:58.042001 ip-10-0-136-75 kubenswrapper[2554]: E0730 03:20:58.041910    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05fb7bf-baa3-4cf5-849a-7b6887e75222-maas-api-tls podName:d05fb7bf-baa3-4cf5-849a-7b6887e75222 nodeName:}" failed. No retries permitted until 2026-07-30 03:20:58.541890267 +0000 UTC m=+3294.392202979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d05fb7bf-baa3-4cf5-849a-7b6887e75222-maas-api-tls") pod "maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l" (UID: "d05fb7bf-baa3-4cf5-849a-7b6887e75222") : secret "maas-api-e2e-ipp-b-f58ab6-serving-cert" not found
Jul 30 03:20:58.042332 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.042316    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05fb7bf-baa3-4cf5-849a-7b6887e75222-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l\" (UID: \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:20:58.050617 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.050590    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzjd2\" (UniqueName: \"kubernetes.io/projected/d05fb7bf-baa3-4cf5-849a-7b6887e75222-kube-api-access-vzjd2\") pod \"maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l\" (UID: \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:20:58.440605 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.440495    2554 generic.go:356] "Generic (PLEG): container finished" podID="615ac7bd-5088-445c-9bac-697203e0e50d" containerID="b544cb473cae584726272cf5082eaf98f6950d68c0fe2974acd1955131e30656" exitCode=0
Jul 30 03:20:58.440605 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.440539    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pmkhm"
Jul 30 03:20:58.440605 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.440577    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pmkhm" event={"ID":"615ac7bd-5088-445c-9bac-697203e0e50d","Type":"ContainerDied","Data":"b544cb473cae584726272cf5082eaf98f6950d68c0fe2974acd1955131e30656"}
Jul 30 03:20:58.441087 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.440620    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pmkhm" event={"ID":"615ac7bd-5088-445c-9bac-697203e0e50d","Type":"ContainerDied","Data":"aa55a555a2ddf390dd7a20e19930954839f1d6cf3adf69d50b40552964786bb1"}
Jul 30 03:20:58.441087 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.440642    2554 scope.go:117] "RemoveContainer" containerID="b544cb473cae584726272cf5082eaf98f6950d68c0fe2974acd1955131e30656"
Jul 30 03:20:58.449977 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.449956    2554 scope.go:117] "RemoveContainer" containerID="b544cb473cae584726272cf5082eaf98f6950d68c0fe2974acd1955131e30656"
Jul 30 03:20:58.450200 ip-10-0-136-75 kubenswrapper[2554]: E0730 03:20:58.450181    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b544cb473cae584726272cf5082eaf98f6950d68c0fe2974acd1955131e30656\": container with ID starting with b544cb473cae584726272cf5082eaf98f6950d68c0fe2974acd1955131e30656 not found: ID does not exist" containerID="b544cb473cae584726272cf5082eaf98f6950d68c0fe2974acd1955131e30656"
Jul 30 03:20:58.450246 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.450210    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b544cb473cae584726272cf5082eaf98f6950d68c0fe2974acd1955131e30656"} err="failed to get container status \"b544cb473cae584726272cf5082eaf98f6950d68c0fe2974acd1955131e30656\": rpc error: code = NotFound desc = could not find container \"b544cb473cae584726272cf5082eaf98f6950d68c0fe2974acd1955131e30656\": container with ID starting with b544cb473cae584726272cf5082eaf98f6950d68c0fe2974acd1955131e30656 not found: ID does not exist"
Jul 30 03:20:58.468763 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.468737    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pmkhm"]
Jul 30 03:20:58.475219 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.475198    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pmkhm"]
Jul 30 03:20:58.546186 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.546148    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05fb7bf-baa3-4cf5-849a-7b6887e75222-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l\" (UID: \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:20:58.548500 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.548474    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05fb7bf-baa3-4cf5-849a-7b6887e75222-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l\" (UID: \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:20:58.642116 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.642081    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="615ac7bd-5088-445c-9bac-697203e0e50d" path="/var/lib/kubelet/pods/615ac7bd-5088-445c-9bac-697203e0e50d/volumes"
Jul 30 03:20:58.794572 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:58.794513    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:20:59.143070 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:59.143044    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"]
Jul 30 03:20:59.145718 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:20:59.145689    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd05fb7bf_baa3_4cf5_849a_7b6887e75222.slice/crio-b38b4e9e45d5925687e603c38dc582f03364450dea3e19334dbaba9e555a8099 WatchSource:0}: Error finding container b38b4e9e45d5925687e603c38dc582f03364450dea3e19334dbaba9e555a8099: Status 404 returned error can't find the container with id b38b4e9e45d5925687e603c38dc582f03364450dea3e19334dbaba9e555a8099
Jul 30 03:20:59.446947 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:20:59.446855    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l" event={"ID":"d05fb7bf-baa3-4cf5-849a-7b6887e75222","Type":"ContainerStarted","Data":"b38b4e9e45d5925687e603c38dc582f03364450dea3e19334dbaba9e555a8099"}
Jul 30 03:21:01.458807 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:01.458776    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l" event={"ID":"d05fb7bf-baa3-4cf5-849a-7b6887e75222","Type":"ContainerStarted","Data":"b152be9a20b5fad9f9661b482a3dca60508db8ad2a06cbc1ad29653f48b8bd89"}
Jul 30 03:21:01.459199 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:01.458869    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:21:01.490483 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:01.490431    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l" podStartSLOduration=2.314181129 podStartE2EDuration="4.490416559s" totalImagesPullingTime="2.17623543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:21:01.487758204 +0000 UTC m=+3297.338070935" watchObservedRunningTime="2026-07-30 03:21:01.490416559 +0000 UTC m=+3297.340729291"
Jul 30 03:21:01.838797 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:01.838765    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:21:04.795692 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:04.795664    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 03:21:04.799972 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:04.799949    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 03:21:04.807771 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:04.807753    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 03:21:04.811196 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:04.811180    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 03:21:07.468737 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:07.468708    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:21:38.243842 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.243809    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"]
Jul 30 03:21:38.248325 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.248304    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.251043 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.251021    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-2cad57\"/\"openshift-service-ca.crt\""
Jul 30 03:21:38.252056 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.252037    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-2cad57\"/\"kube-root-ca.crt\""
Jul 30 03:21:38.252115 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.252061    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-2cad57\"/\"ipp-route-2cad57-kserve-self-signed-certs\""
Jul 30 03:21:38.252115 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.252047    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-2cad57\"/\"default-dockercfg-jhr2z\""
Jul 30 03:21:38.258437 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.258411    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"]
Jul 30 03:21:38.281107 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.281081    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-tmp-dir\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.281228 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.281114    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bde9270-ca56-430c-87e4-693eb5f92082-tls-certs\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.281228 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.281133    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msfg4\" (UniqueName: \"kubernetes.io/projected/6bde9270-ca56-430c-87e4-693eb5f92082-kube-api-access-msfg4\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.281228 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.281219    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-home\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.281412 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.281276    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-dshm\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.281412 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.281309    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-model-cache\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.382624 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.382592    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-tmp-dir\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.382780 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.382641    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bde9270-ca56-430c-87e4-693eb5f92082-tls-certs\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.382780 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.382686    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msfg4\" (UniqueName: \"kubernetes.io/projected/6bde9270-ca56-430c-87e4-693eb5f92082-kube-api-access-msfg4\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.382780 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.382752    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-home\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.382888 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.382794    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-dshm\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.382888 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.382819    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-model-cache\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.383178 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.383154    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-home\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.383259 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.383192    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-model-cache\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.383259 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.383241    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-tmp-dir\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.385027 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.385007    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-dshm\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.385208 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.385191    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bde9270-ca56-430c-87e4-693eb5f92082-tls-certs\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.390476 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.390454    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msfg4\" (UniqueName: \"kubernetes.io/projected/6bde9270-ca56-430c-87e4-693eb5f92082-kube-api-access-msfg4\") pod \"ipp-route-2cad57-kserve-5d754cb94c-pjbz9\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") " pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.558024 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.557993    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:38.689882 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:38.689856    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"]
Jul 30 03:21:38.692022 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:21:38.691993    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bde9270_ca56_430c_87e4_693eb5f92082.slice/crio-037b0300e5318552d85b375ea5efe6ab75e1c09599763e726fb7987cfa1d8219 WatchSource:0}: Error finding container 037b0300e5318552d85b375ea5efe6ab75e1c09599763e726fb7987cfa1d8219: Status 404 returned error can't find the container with id 037b0300e5318552d85b375ea5efe6ab75e1c09599763e726fb7987cfa1d8219
Jul 30 03:21:39.638605 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:39.638571    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9" event={"ID":"6bde9270-ca56-430c-87e4-693eb5f92082","Type":"ContainerStarted","Data":"643024689ca60de5c0207314b5f98dd8dba4dab8ee0fa92d916dbd6ca2a0859f"}
Jul 30 03:21:39.639009 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:39.638612    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9" event={"ID":"6bde9270-ca56-430c-87e4-693eb5f92082","Type":"ContainerStarted","Data":"037b0300e5318552d85b375ea5efe6ab75e1c09599763e726fb7987cfa1d8219"}
Jul 30 03:21:39.656485 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:39.656437    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9" podStartSLOduration=1.656421866 podStartE2EDuration="1.656421866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:21:39.655093097 +0000 UTC m=+3335.505405953" watchObservedRunningTime="2026-07-30 03:21:39.656421866 +0000 UTC m=+3335.506734598"
Jul 30 03:21:41.740284 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:41.740236    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:21:48.558835 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:48.558807    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:48.559237 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:48.558850    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:48.571127 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:48.571098    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:21:48.690002 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:21:48.689972    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:22:14.728403 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:14.728364    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:22:28.366226 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:28.366186    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"]
Jul 30 03:22:28.369377 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:28.369349    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:28.371942 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:28.371920    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-64f2f8-serving-cert\""
Jul 30 03:22:28.379457 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:28.379436    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"]
Jul 30 03:22:28.514463 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:28.514429    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44092c5b-c111-4b32-821c-2c7e71be0e0f-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6\" (UID: \"44092c5b-c111-4b32-821c-2c7e71be0e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:28.514463 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:28.514464    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7242\" (UniqueName: \"kubernetes.io/projected/44092c5b-c111-4b32-821c-2c7e71be0e0f-kube-api-access-d7242\") pod \"maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6\" (UID: \"44092c5b-c111-4b32-821c-2c7e71be0e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:28.514687 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:28.514483    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44092c5b-c111-4b32-821c-2c7e71be0e0f-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6\" (UID: \"44092c5b-c111-4b32-821c-2c7e71be0e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:28.615386 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:28.615359    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44092c5b-c111-4b32-821c-2c7e71be0e0f-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6\" (UID: \"44092c5b-c111-4b32-821c-2c7e71be0e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:28.615539 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:28.615391    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7242\" (UniqueName: \"kubernetes.io/projected/44092c5b-c111-4b32-821c-2c7e71be0e0f-kube-api-access-d7242\") pod \"maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6\" (UID: \"44092c5b-c111-4b32-821c-2c7e71be0e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:28.615539 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:28.615412    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44092c5b-c111-4b32-821c-2c7e71be0e0f-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6\" (UID: \"44092c5b-c111-4b32-821c-2c7e71be0e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:28.616078 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:28.616057    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44092c5b-c111-4b32-821c-2c7e71be0e0f-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6\" (UID: \"44092c5b-c111-4b32-821c-2c7e71be0e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:28.617823 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:28.617781    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44092c5b-c111-4b32-821c-2c7e71be0e0f-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6\" (UID: \"44092c5b-c111-4b32-821c-2c7e71be0e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:28.623302 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:28.623283    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7242\" (UniqueName: \"kubernetes.io/projected/44092c5b-c111-4b32-821c-2c7e71be0e0f-kube-api-access-d7242\") pod \"maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6\" (UID: \"44092c5b-c111-4b32-821c-2c7e71be0e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:28.680719 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:28.680693    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:29.014675 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:29.014646    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"]
Jul 30 03:22:29.017385 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:22:29.017358    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44092c5b_c111_4b32_821c_2c7e71be0e0f.slice/crio-95fc8fa5d9640266b50b46fcd7e94a690dd773564b3be261eb4d5df929036be8 WatchSource:0}: Error finding container 95fc8fa5d9640266b50b46fcd7e94a690dd773564b3be261eb4d5df929036be8: Status 404 returned error can't find the container with id 95fc8fa5d9640266b50b46fcd7e94a690dd773564b3be261eb4d5df929036be8
Jul 30 03:22:29.871028 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:29.870992    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6" event={"ID":"44092c5b-c111-4b32-821c-2c7e71be0e0f","Type":"ContainerStarted","Data":"22bbfd880ab19badfa08e8432cad6a88503df34e9f2c22e626864e58001fbf62"}
Jul 30 03:22:29.871419 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:29.871046    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6" event={"ID":"44092c5b-c111-4b32-821c-2c7e71be0e0f","Type":"ContainerStarted","Data":"95fc8fa5d9640266b50b46fcd7e94a690dd773564b3be261eb4d5df929036be8"}
Jul 30 03:22:29.871419 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:29.871130    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:29.891176 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:29.891132    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6" podStartSLOduration=1.414394403 podStartE2EDuration="1.891119644s" totalImagesPullingTime="476.725241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:22:29.890327307 +0000 UTC m=+3385.740640038" watchObservedRunningTime="2026-07-30 03:22:29.891119644 +0000 UTC m=+3385.741432375"
Jul 30 03:22:33.927835 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:33.927799    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:22:35.883508 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:35.883481    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:43.657958 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:43.657923    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6"]
Jul 30 03:22:43.661134 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:43.661112    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6"
Jul 30 03:22:43.663677 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:43.663652    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2npk7\""
Jul 30 03:22:43.668491 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:43.668463    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6"]
Jul 30 03:22:43.739066 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:43.739038    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f874ac0-fd33-4138-9a8e-87d6a8e6eca9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6\" (UID: \"1f874ac0-fd33-4138-9a8e-87d6a8e6eca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6"
Jul 30 03:22:43.840323 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:43.840291    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f874ac0-fd33-4138-9a8e-87d6a8e6eca9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6\" (UID: \"1f874ac0-fd33-4138-9a8e-87d6a8e6eca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6"
Jul 30 03:22:43.840903 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:43.840886    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f874ac0-fd33-4138-9a8e-87d6a8e6eca9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6\" (UID: \"1f874ac0-fd33-4138-9a8e-87d6a8e6eca9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6"
Jul 30 03:22:43.972401 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:43.972334    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6"
Jul 30 03:22:44.097435 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:44.097411    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6"]
Jul 30 03:22:44.099235 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:22:44.099209    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f874ac0_fd33_4138_9a8e_87d6a8e6eca9.slice/crio-d403a4f5d617cecaad4756995d88fbd94b2f638fda4c03419ee00a19e46d1111 WatchSource:0}: Error finding container d403a4f5d617cecaad4756995d88fbd94b2f638fda4c03419ee00a19e46d1111: Status 404 returned error can't find the container with id d403a4f5d617cecaad4756995d88fbd94b2f638fda4c03419ee00a19e46d1111
Jul 30 03:22:44.947904 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:44.947856    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6" event={"ID":"1f874ac0-fd33-4138-9a8e-87d6a8e6eca9","Type":"ContainerStarted","Data":"d403a4f5d617cecaad4756995d88fbd94b2f638fda4c03419ee00a19e46d1111"}
Jul 30 03:22:46.959758 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:46.959728    2554 generic.go:356] "Generic (PLEG): container finished" podID="1f874ac0-fd33-4138-9a8e-87d6a8e6eca9" containerID="3b2978ace2f8e2bec0e5b8dc9dd560d6c7657e8f9c95c0ed8123efe8082fc083" exitCode=0
Jul 30 03:22:46.960160 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:46.959802    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6" event={"ID":"1f874ac0-fd33-4138-9a8e-87d6a8e6eca9","Type":"ContainerDied","Data":"3b2978ace2f8e2bec0e5b8dc9dd560d6c7657e8f9c95c0ed8123efe8082fc083"}
Jul 30 03:22:48.094146 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:48.094119    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6"
Jul 30 03:22:48.184289 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:48.184251    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f874ac0-fd33-4138-9a8e-87d6a8e6eca9-maas-api-service-ca\") pod \"1f874ac0-fd33-4138-9a8e-87d6a8e6eca9\" (UID: \"1f874ac0-fd33-4138-9a8e-87d6a8e6eca9\") "
Jul 30 03:22:48.184663 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:48.184640    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f874ac0-fd33-4138-9a8e-87d6a8e6eca9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1f874ac0-fd33-4138-9a8e-87d6a8e6eca9" (UID: "1f874ac0-fd33-4138-9a8e-87d6a8e6eca9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 03:22:48.285179 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:48.285150    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f874ac0-fd33-4138-9a8e-87d6a8e6eca9-maas-api-service-ca\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:22:48.969024 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:48.968923    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6" event={"ID":"1f874ac0-fd33-4138-9a8e-87d6a8e6eca9","Type":"ContainerDied","Data":"d403a4f5d617cecaad4756995d88fbd94b2f638fda4c03419ee00a19e46d1111"}
Jul 30 03:22:48.969024 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:48.968982    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d403a4f5d617cecaad4756995d88fbd94b2f638fda4c03419ee00a19e46d1111"
Jul 30 03:22:48.969024 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:48.968938    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6"
Jul 30 03:22:54.033177 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.033136    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"]
Jul 30 03:22:54.033663 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.033356    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6" podUID="44092c5b-c111-4b32-821c-2c7e71be0e0f" containerName="maas-api" containerID="cri-o://22bbfd880ab19badfa08e8432cad6a88503df34e9f2c22e626864e58001fbf62" gracePeriod=30
Jul 30 03:22:54.279976 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.279951    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:54.336721 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.336650    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44092c5b-c111-4b32-821c-2c7e71be0e0f-maas-api-tls\") pod \"44092c5b-c111-4b32-821c-2c7e71be0e0f\" (UID: \"44092c5b-c111-4b32-821c-2c7e71be0e0f\") "
Jul 30 03:22:54.336721 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.336703    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44092c5b-c111-4b32-821c-2c7e71be0e0f-openshift-service-ca\") pod \"44092c5b-c111-4b32-821c-2c7e71be0e0f\" (UID: \"44092c5b-c111-4b32-821c-2c7e71be0e0f\") "
Jul 30 03:22:54.336915 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.336768    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7242\" (UniqueName: \"kubernetes.io/projected/44092c5b-c111-4b32-821c-2c7e71be0e0f-kube-api-access-d7242\") pod \"44092c5b-c111-4b32-821c-2c7e71be0e0f\" (UID: \"44092c5b-c111-4b32-821c-2c7e71be0e0f\") "
Jul 30 03:22:54.337141 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.337119    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44092c5b-c111-4b32-821c-2c7e71be0e0f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "44092c5b-c111-4b32-821c-2c7e71be0e0f" (UID: "44092c5b-c111-4b32-821c-2c7e71be0e0f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 03:22:54.338885 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.338845    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44092c5b-c111-4b32-821c-2c7e71be0e0f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "44092c5b-c111-4b32-821c-2c7e71be0e0f" (UID: "44092c5b-c111-4b32-821c-2c7e71be0e0f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:22:54.339039 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.339018    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44092c5b-c111-4b32-821c-2c7e71be0e0f-kube-api-access-d7242" (OuterVolumeSpecName: "kube-api-access-d7242") pod "44092c5b-c111-4b32-821c-2c7e71be0e0f" (UID: "44092c5b-c111-4b32-821c-2c7e71be0e0f"). InnerVolumeSpecName "kube-api-access-d7242". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:22:54.438295 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.438259    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44092c5b-c111-4b32-821c-2c7e71be0e0f-maas-api-tls\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:22:54.438295 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.438294    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44092c5b-c111-4b32-821c-2c7e71be0e0f-openshift-service-ca\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:22:54.438295 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.438305    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7242\" (UniqueName: \"kubernetes.io/projected/44092c5b-c111-4b32-821c-2c7e71be0e0f-kube-api-access-d7242\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:22:54.999117 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.999089    2554 generic.go:356] "Generic (PLEG): container finished" podID="44092c5b-c111-4b32-821c-2c7e71be0e0f" containerID="22bbfd880ab19badfa08e8432cad6a88503df34e9f2c22e626864e58001fbf62" exitCode=0
Jul 30 03:22:54.999270 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.999129    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"
Jul 30 03:22:54.999270 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.999215    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6" event={"ID":"44092c5b-c111-4b32-821c-2c7e71be0e0f","Type":"ContainerDied","Data":"22bbfd880ab19badfa08e8432cad6a88503df34e9f2c22e626864e58001fbf62"}
Jul 30 03:22:54.999270 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.999258    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6" event={"ID":"44092c5b-c111-4b32-821c-2c7e71be0e0f","Type":"ContainerDied","Data":"95fc8fa5d9640266b50b46fcd7e94a690dd773564b3be261eb4d5df929036be8"}
Jul 30 03:22:54.999391 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:54.999279    2554 scope.go:117] "RemoveContainer" containerID="22bbfd880ab19badfa08e8432cad6a88503df34e9f2c22e626864e58001fbf62"
Jul 30 03:22:55.008192 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:55.008170    2554 scope.go:117] "RemoveContainer" containerID="22bbfd880ab19badfa08e8432cad6a88503df34e9f2c22e626864e58001fbf62"
Jul 30 03:22:55.008445 ip-10-0-136-75 kubenswrapper[2554]: E0730 03:22:55.008429    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22bbfd880ab19badfa08e8432cad6a88503df34e9f2c22e626864e58001fbf62\": container with ID starting with 22bbfd880ab19badfa08e8432cad6a88503df34e9f2c22e626864e58001fbf62 not found: ID does not exist" containerID="22bbfd880ab19badfa08e8432cad6a88503df34e9f2c22e626864e58001fbf62"
Jul 30 03:22:55.008502 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:55.008451    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22bbfd880ab19badfa08e8432cad6a88503df34e9f2c22e626864e58001fbf62"} err="failed to get container status \"22bbfd880ab19badfa08e8432cad6a88503df34e9f2c22e626864e58001fbf62\": rpc error: code = NotFound desc = could not find container \"22bbfd880ab19badfa08e8432cad6a88503df34e9f2c22e626864e58001fbf62\": container with ID starting with 22bbfd880ab19badfa08e8432cad6a88503df34e9f2c22e626864e58001fbf62 not found: ID does not exist"
Jul 30 03:22:55.018100 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:55.018079    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"]
Jul 30 03:22:55.025036 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:55.025013    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-64f2f8-5874d587cb-gvnl6"]
Jul 30 03:22:56.640564 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:56.640487    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44092c5b-c111-4b32-821c-2c7e71be0e0f" path="/var/lib/kubelet/pods/44092c5b-c111-4b32-821c-2c7e71be0e0f/volumes"
Jul 30 03:22:58.625882 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:58.625849    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:22:58.723874 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:58.723844    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6"]
Jul 30 03:22:58.727991 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:22:58.727964    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-64f2f8-9bxh6"]
Jul 30 03:23:00.641859 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:00.641826    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f874ac0-fd33-4138-9a8e-87d6a8e6eca9" path="/var/lib/kubelet/pods/1f874ac0-fd33-4138-9a8e-87d6a8e6eca9/volumes"
Jul 30 03:23:08.620080 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:08.620043    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8"]
Jul 30 03:23:08.620527 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:08.620502    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44092c5b-c111-4b32-821c-2c7e71be0e0f" containerName="maas-api"
Jul 30 03:23:08.620527 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:08.620517    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="44092c5b-c111-4b32-821c-2c7e71be0e0f" containerName="maas-api"
Jul 30 03:23:08.620619 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:08.620532    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f874ac0-fd33-4138-9a8e-87d6a8e6eca9" containerName="revoke-keys"
Jul 30 03:23:08.620619 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:08.620537    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f874ac0-fd33-4138-9a8e-87d6a8e6eca9" containerName="revoke-keys"
Jul 30 03:23:08.620684 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:08.620620    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f874ac0-fd33-4138-9a8e-87d6a8e6eca9" containerName="revoke-keys"
Jul 30 03:23:08.620684 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:08.620630    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="44092c5b-c111-4b32-821c-2c7e71be0e0f" containerName="maas-api"
Jul 30 03:23:08.623701 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:08.623686    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8"
Jul 30 03:23:08.626158 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:08.626139    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2npk7\""
Jul 30 03:23:08.631966 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:08.631943    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8"]
Jul 30 03:23:08.759842 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:08.759795    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/acb589e1-a780-4efe-83f3-93cc5f22e7cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8\" (UID: \"acb589e1-a780-4efe-83f3-93cc5f22e7cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8"
Jul 30 03:23:08.860673 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:08.860644    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/acb589e1-a780-4efe-83f3-93cc5f22e7cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8\" (UID: \"acb589e1-a780-4efe-83f3-93cc5f22e7cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8"
Jul 30 03:23:08.861201 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:08.861182    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/acb589e1-a780-4efe-83f3-93cc5f22e7cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8\" (UID: \"acb589e1-a780-4efe-83f3-93cc5f22e7cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8"
Jul 30 03:23:08.934780 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:08.934713    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8"
Jul 30 03:23:09.064921 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:09.064892    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8"]
Jul 30 03:23:09.066698 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:23:09.066661    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb589e1_a780_4efe_83f3_93cc5f22e7cd.slice/crio-9a0e055b6a7f1a6ff3c445d3ea2d1a05f5f24a10dc147f50859662c400fdbc1d WatchSource:0}: Error finding container 9a0e055b6a7f1a6ff3c445d3ea2d1a05f5f24a10dc147f50859662c400fdbc1d: Status 404 returned error can't find the container with id 9a0e055b6a7f1a6ff3c445d3ea2d1a05f5f24a10dc147f50859662c400fdbc1d
Jul 30 03:23:10.070795 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:10.070765    2554 generic.go:356] "Generic (PLEG): container finished" podID="acb589e1-a780-4efe-83f3-93cc5f22e7cd" containerID="4ed1c0f3ff34727f40b8d5e81f985b1acc26145b0a4119d1c6323f52590fa8d2" exitCode=0
Jul 30 03:23:10.071187 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:10.070861    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8" event={"ID":"acb589e1-a780-4efe-83f3-93cc5f22e7cd","Type":"ContainerDied","Data":"4ed1c0f3ff34727f40b8d5e81f985b1acc26145b0a4119d1c6323f52590fa8d2"}
Jul 30 03:23:10.071187 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:10.070926    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8" event={"ID":"acb589e1-a780-4efe-83f3-93cc5f22e7cd","Type":"ContainerStarted","Data":"9a0e055b6a7f1a6ff3c445d3ea2d1a05f5f24a10dc147f50859662c400fdbc1d"}
Jul 30 03:23:11.207912 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:11.207887    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8"
Jul 30 03:23:11.381656 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:11.381584    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/acb589e1-a780-4efe-83f3-93cc5f22e7cd-maas-api-service-ca\") pod \"acb589e1-a780-4efe-83f3-93cc5f22e7cd\" (UID: \"acb589e1-a780-4efe-83f3-93cc5f22e7cd\") "
Jul 30 03:23:11.381929 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:11.381908    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acb589e1-a780-4efe-83f3-93cc5f22e7cd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "acb589e1-a780-4efe-83f3-93cc5f22e7cd" (UID: "acb589e1-a780-4efe-83f3-93cc5f22e7cd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 03:23:11.482842 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:11.482808    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/acb589e1-a780-4efe-83f3-93cc5f22e7cd-maas-api-service-ca\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:23:12.082121 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:12.082083    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8" event={"ID":"acb589e1-a780-4efe-83f3-93cc5f22e7cd","Type":"ContainerDied","Data":"9a0e055b6a7f1a6ff3c445d3ea2d1a05f5f24a10dc147f50859662c400fdbc1d"}
Jul 30 03:23:12.082283 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:12.082142    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a0e055b6a7f1a6ff3c445d3ea2d1a05f5f24a10dc147f50859662c400fdbc1d"
Jul 30 03:23:12.082283 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:12.082095    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8"
Jul 30 03:23:22.725892 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:22.725855    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:23:28.691798 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:28.691758    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8"]
Jul 30 03:23:28.693822 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:28.693800    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-2cad57-fb5l8"]
Jul 30 03:23:30.641473 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:30.641431    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acb589e1-a780-4efe-83f3-93cc5f22e7cd" path="/var/lib/kubelet/pods/acb589e1-a780-4efe-83f3-93cc5f22e7cd/volumes"
Jul 30 03:23:34.043015 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:34.042983    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"]
Jul 30 03:23:34.126447 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:34.126414    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:23:49.061619 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.061571    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9" podUID="6bde9270-ca56-430c-87e4-693eb5f92082" containerName="main" containerID="cri-o://643024689ca60de5c0207314b5f98dd8dba4dab8ee0fa92d916dbd6ca2a0859f" gracePeriod=45
Jul 30 03:23:49.258118 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.258084    2554 generic.go:356] "Generic (PLEG): container finished" podID="6bde9270-ca56-430c-87e4-693eb5f92082" containerID="643024689ca60de5c0207314b5f98dd8dba4dab8ee0fa92d916dbd6ca2a0859f" exitCode=0
Jul 30 03:23:49.258266 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.258158    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9" event={"ID":"6bde9270-ca56-430c-87e4-693eb5f92082","Type":"ContainerDied","Data":"643024689ca60de5c0207314b5f98dd8dba4dab8ee0fa92d916dbd6ca2a0859f"}
Jul 30 03:23:49.309637 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.309614    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:23:49.414987 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.414902    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-dshm\") pod \"6bde9270-ca56-430c-87e4-693eb5f92082\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") "
Jul 30 03:23:49.415143 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.414988    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msfg4\" (UniqueName: \"kubernetes.io/projected/6bde9270-ca56-430c-87e4-693eb5f92082-kube-api-access-msfg4\") pod \"6bde9270-ca56-430c-87e4-693eb5f92082\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") "
Jul 30 03:23:49.415143 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.415020    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-home\") pod \"6bde9270-ca56-430c-87e4-693eb5f92082\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") "
Jul 30 03:23:49.415143 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.415071    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-tmp-dir\") pod \"6bde9270-ca56-430c-87e4-693eb5f92082\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") "
Jul 30 03:23:49.415143 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.415102    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-model-cache\") pod \"6bde9270-ca56-430c-87e4-693eb5f92082\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") "
Jul 30 03:23:49.415143 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.415140    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bde9270-ca56-430c-87e4-693eb5f92082-tls-certs\") pod \"6bde9270-ca56-430c-87e4-693eb5f92082\" (UID: \"6bde9270-ca56-430c-87e4-693eb5f92082\") "
Jul 30 03:23:49.415385 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.415338    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-home" (OuterVolumeSpecName: "home") pod "6bde9270-ca56-430c-87e4-693eb5f92082" (UID: "6bde9270-ca56-430c-87e4-693eb5f92082"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:23:49.415385 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.415349    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-model-cache" (OuterVolumeSpecName: "model-cache") pod "6bde9270-ca56-430c-87e4-693eb5f92082" (UID: "6bde9270-ca56-430c-87e4-693eb5f92082"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:23:49.415385 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.415365    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6bde9270-ca56-430c-87e4-693eb5f92082" (UID: "6bde9270-ca56-430c-87e4-693eb5f92082"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:23:49.415503 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.415485    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-model-cache\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:23:49.415503 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.415499    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-home\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:23:49.415638 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.415511    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-tmp-dir\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:23:49.417164 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.417135    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-dshm" (OuterVolumeSpecName: "dshm") pod "6bde9270-ca56-430c-87e4-693eb5f92082" (UID: "6bde9270-ca56-430c-87e4-693eb5f92082"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:23:49.417273 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.417177    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bde9270-ca56-430c-87e4-693eb5f92082-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6bde9270-ca56-430c-87e4-693eb5f92082" (UID: "6bde9270-ca56-430c-87e4-693eb5f92082"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:23:49.417273 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.417249    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bde9270-ca56-430c-87e4-693eb5f92082-kube-api-access-msfg4" (OuterVolumeSpecName: "kube-api-access-msfg4") pod "6bde9270-ca56-430c-87e4-693eb5f92082" (UID: "6bde9270-ca56-430c-87e4-693eb5f92082"). InnerVolumeSpecName "kube-api-access-msfg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:23:49.516262 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.516235    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msfg4\" (UniqueName: \"kubernetes.io/projected/6bde9270-ca56-430c-87e4-693eb5f92082-kube-api-access-msfg4\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:23:49.516262 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.516259    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bde9270-ca56-430c-87e4-693eb5f92082-tls-certs\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:23:49.516415 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:49.516269    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bde9270-ca56-430c-87e4-693eb5f92082-dshm\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:23:50.265341 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:50.265305    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9" event={"ID":"6bde9270-ca56-430c-87e4-693eb5f92082","Type":"ContainerDied","Data":"037b0300e5318552d85b375ea5efe6ab75e1c09599763e726fb7987cfa1d8219"}
Jul 30 03:23:50.265341 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:50.265325    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"
Jul 30 03:23:50.265832 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:50.265356    2554 scope.go:117] "RemoveContainer" containerID="643024689ca60de5c0207314b5f98dd8dba4dab8ee0fa92d916dbd6ca2a0859f"
Jul 30 03:23:50.285706 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:50.285683    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"]
Jul 30 03:23:50.290423 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:50.290397    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-2cad57/ipp-route-2cad57-kserve-5d754cb94c-pjbz9"]
Jul 30 03:23:50.640715 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:23:50.640644    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bde9270-ca56-430c-87e4-693eb5f92082" path="/var/lib/kubelet/pods/6bde9270-ca56-430c-87e4-693eb5f92082/volumes"
Jul 30 03:24:17.584286 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:17.584246    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5"]
Jul 30 03:24:17.584707 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:17.584619    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bde9270-ca56-430c-87e4-693eb5f92082" containerName="main"
Jul 30 03:24:17.584707 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:17.584632    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bde9270-ca56-430c-87e4-693eb5f92082" containerName="main"
Jul 30 03:24:17.584707 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:17.584640    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acb589e1-a780-4efe-83f3-93cc5f22e7cd" containerName="revoke-keys"
Jul 30 03:24:17.584707 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:17.584646    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="acb589e1-a780-4efe-83f3-93cc5f22e7cd" containerName="revoke-keys"
Jul 30 03:24:17.584707 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:17.584710    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="acb589e1-a780-4efe-83f3-93cc5f22e7cd" containerName="revoke-keys"
Jul 30 03:24:17.584895 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:17.584718    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bde9270-ca56-430c-87e4-693eb5f92082" containerName="main"
Jul 30 03:24:17.588990 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:17.588970    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5"
Jul 30 03:24:17.591327 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:17.591306    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2npk7\""
Jul 30 03:24:17.594780 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:17.594757    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5"]
Jul 30 03:24:17.635958 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:17.635921    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c41879c6-fd17-4bd1-b3a6-ff0269eb34c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5\" (UID: \"c41879c6-fd17-4bd1-b3a6-ff0269eb34c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5"
Jul 30 03:24:17.736750 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:17.736718    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c41879c6-fd17-4bd1-b3a6-ff0269eb34c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5\" (UID: \"c41879c6-fd17-4bd1-b3a6-ff0269eb34c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5"
Jul 30 03:24:17.737476 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:17.737450    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c41879c6-fd17-4bd1-b3a6-ff0269eb34c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5\" (UID: \"c41879c6-fd17-4bd1-b3a6-ff0269eb34c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5"
Jul 30 03:24:17.901220 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:17.901150    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5"
Jul 30 03:24:18.034109 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:18.034081    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5"]
Jul 30 03:24:18.036078 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:24:18.036050    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc41879c6_fd17_4bd1_b3a6_ff0269eb34c7.slice/crio-f45c1d16e44f61071d7252ae4dea9e21a0f39d6d962ba76571fae264d4b06325 WatchSource:0}: Error finding container f45c1d16e44f61071d7252ae4dea9e21a0f39d6d962ba76571fae264d4b06325: Status 404 returned error can't find the container with id f45c1d16e44f61071d7252ae4dea9e21a0f39d6d962ba76571fae264d4b06325
Jul 30 03:24:18.402603 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:18.402568    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5" event={"ID":"c41879c6-fd17-4bd1-b3a6-ff0269eb34c7","Type":"ContainerStarted","Data":"2b007b527ef4b4c349e4c3a78c085112933a34b1c9980fa3f990614dbcf32acc"}
Jul 30 03:24:18.402750 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:18.402630    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5" event={"ID":"c41879c6-fd17-4bd1-b3a6-ff0269eb34c7","Type":"ContainerStarted","Data":"f45c1d16e44f61071d7252ae4dea9e21a0f39d6d962ba76571fae264d4b06325"}
Jul 30 03:24:18.423813 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:18.423771    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5" podStartSLOduration=1.423757685 podStartE2EDuration="1.423757685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:24:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:24:18.422641917 +0000 UTC m=+3494.272954647" watchObservedRunningTime="2026-07-30 03:24:18.423757685 +0000 UTC m=+3494.274070416"
Jul 30 03:24:19.408674 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:19.408641    2554 generic.go:356] "Generic (PLEG): container finished" podID="c41879c6-fd17-4bd1-b3a6-ff0269eb34c7" containerID="2b007b527ef4b4c349e4c3a78c085112933a34b1c9980fa3f990614dbcf32acc" exitCode=0
Jul 30 03:24:19.409055 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:19.408688    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5" event={"ID":"c41879c6-fd17-4bd1-b3a6-ff0269eb34c7","Type":"ContainerDied","Data":"2b007b527ef4b4c349e4c3a78c085112933a34b1c9980fa3f990614dbcf32acc"}
Jul 30 03:24:20.545938 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:20.545914    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5"
Jul 30 03:24:20.661062 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:20.661035    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c41879c6-fd17-4bd1-b3a6-ff0269eb34c7-maas-api-service-ca\") pod \"c41879c6-fd17-4bd1-b3a6-ff0269eb34c7\" (UID: \"c41879c6-fd17-4bd1-b3a6-ff0269eb34c7\") "
Jul 30 03:24:20.661363 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:20.661343    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c41879c6-fd17-4bd1-b3a6-ff0269eb34c7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c41879c6-fd17-4bd1-b3a6-ff0269eb34c7" (UID: "c41879c6-fd17-4bd1-b3a6-ff0269eb34c7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 03:24:20.762539 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:20.762514    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c41879c6-fd17-4bd1-b3a6-ff0269eb34c7-maas-api-service-ca\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:24:21.418627 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:21.418595    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5"
Jul 30 03:24:21.418627 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:21.418607    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5" event={"ID":"c41879c6-fd17-4bd1-b3a6-ff0269eb34c7","Type":"ContainerDied","Data":"f45c1d16e44f61071d7252ae4dea9e21a0f39d6d962ba76571fae264d4b06325"}
Jul 30 03:24:21.418826 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:21.418658    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f45c1d16e44f61071d7252ae4dea9e21a0f39d6d962ba76571fae264d4b06325"
Jul 30 03:24:27.968978 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:27.968888    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"]
Jul 30 03:24:27.969371 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:27.969133    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l" podUID="d05fb7bf-baa3-4cf5-849a-7b6887e75222" containerName="maas-api" containerID="cri-o://b152be9a20b5fad9f9661b482a3dca60508db8ad2a06cbc1ad29653f48b8bd89" gracePeriod=30
Jul 30 03:24:28.211910 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.211881    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:24:28.323960 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.323933    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05fb7bf-baa3-4cf5-849a-7b6887e75222-openshift-service-ca\") pod \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\" (UID: \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\") "
Jul 30 03:24:28.324104 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.323984    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05fb7bf-baa3-4cf5-849a-7b6887e75222-maas-api-tls\") pod \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\" (UID: \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\") "
Jul 30 03:24:28.324104 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.324007    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzjd2\" (UniqueName: \"kubernetes.io/projected/d05fb7bf-baa3-4cf5-849a-7b6887e75222-kube-api-access-vzjd2\") pod \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\" (UID: \"d05fb7bf-baa3-4cf5-849a-7b6887e75222\") "
Jul 30 03:24:28.324298 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.324278    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d05fb7bf-baa3-4cf5-849a-7b6887e75222-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d05fb7bf-baa3-4cf5-849a-7b6887e75222" (UID: "d05fb7bf-baa3-4cf5-849a-7b6887e75222"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 03:24:28.326071 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.326047    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d05fb7bf-baa3-4cf5-849a-7b6887e75222-kube-api-access-vzjd2" (OuterVolumeSpecName: "kube-api-access-vzjd2") pod "d05fb7bf-baa3-4cf5-849a-7b6887e75222" (UID: "d05fb7bf-baa3-4cf5-849a-7b6887e75222"). InnerVolumeSpecName "kube-api-access-vzjd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:24:28.326169 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.326119    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d05fb7bf-baa3-4cf5-849a-7b6887e75222-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d05fb7bf-baa3-4cf5-849a-7b6887e75222" (UID: "d05fb7bf-baa3-4cf5-849a-7b6887e75222"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:24:28.425021 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.424993    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d05fb7bf-baa3-4cf5-849a-7b6887e75222-openshift-service-ca\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:24:28.425021 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.425020    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d05fb7bf-baa3-4cf5-849a-7b6887e75222-maas-api-tls\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:24:28.425169 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.425035    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzjd2\" (UniqueName: \"kubernetes.io/projected/d05fb7bf-baa3-4cf5-849a-7b6887e75222-kube-api-access-vzjd2\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:24:28.451916 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.451884    2554 generic.go:356] "Generic (PLEG): container finished" podID="d05fb7bf-baa3-4cf5-849a-7b6887e75222" containerID="b152be9a20b5fad9f9661b482a3dca60508db8ad2a06cbc1ad29653f48b8bd89" exitCode=0
Jul 30 03:24:28.452041 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.451930    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"
Jul 30 03:24:28.452041 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.451972    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l" event={"ID":"d05fb7bf-baa3-4cf5-849a-7b6887e75222","Type":"ContainerDied","Data":"b152be9a20b5fad9f9661b482a3dca60508db8ad2a06cbc1ad29653f48b8bd89"}
Jul 30 03:24:28.452041 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.452025    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l" event={"ID":"d05fb7bf-baa3-4cf5-849a-7b6887e75222","Type":"ContainerDied","Data":"b38b4e9e45d5925687e603c38dc582f03364450dea3e19334dbaba9e555a8099"}
Jul 30 03:24:28.452154 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.452051    2554 scope.go:117] "RemoveContainer" containerID="b152be9a20b5fad9f9661b482a3dca60508db8ad2a06cbc1ad29653f48b8bd89"
Jul 30 03:24:28.461039 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.461020    2554 scope.go:117] "RemoveContainer" containerID="b152be9a20b5fad9f9661b482a3dca60508db8ad2a06cbc1ad29653f48b8bd89"
Jul 30 03:24:28.461298 ip-10-0-136-75 kubenswrapper[2554]: E0730 03:24:28.461281    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b152be9a20b5fad9f9661b482a3dca60508db8ad2a06cbc1ad29653f48b8bd89\": container with ID starting with b152be9a20b5fad9f9661b482a3dca60508db8ad2a06cbc1ad29653f48b8bd89 not found: ID does not exist" containerID="b152be9a20b5fad9f9661b482a3dca60508db8ad2a06cbc1ad29653f48b8bd89"
Jul 30 03:24:28.461345 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.461306    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b152be9a20b5fad9f9661b482a3dca60508db8ad2a06cbc1ad29653f48b8bd89"} err="failed to get container status \"b152be9a20b5fad9f9661b482a3dca60508db8ad2a06cbc1ad29653f48b8bd89\": rpc error: code = NotFound desc = could not find container \"b152be9a20b5fad9f9661b482a3dca60508db8ad2a06cbc1ad29653f48b8bd89\": container with ID starting with b152be9a20b5fad9f9661b482a3dca60508db8ad2a06cbc1ad29653f48b8bd89 not found: ID does not exist"
Jul 30 03:24:28.475841 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.475821    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"]
Jul 30 03:24:28.480646 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.480627    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f58ab6-5c876cd8b4-6h78l"]
Jul 30 03:24:28.645985 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:28.645916    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d05fb7bf-baa3-4cf5-849a-7b6887e75222" path="/var/lib/kubelet/pods/d05fb7bf-baa3-4cf5-849a-7b6887e75222/volumes"
Jul 30 03:24:31.241008 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:31.240974    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:24:32.653096 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:32.653064    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5"]
Jul 30 03:24:32.655753 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:32.655718    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f58ab6-rchl5"]
Jul 30 03:24:34.647249 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:34.647212    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c41879c6-fd17-4bd1-b3a6-ff0269eb34c7" path="/var/lib/kubelet/pods/c41879c6-fd17-4bd1-b3a6-ff0269eb34c7/volumes"
Jul 30 03:24:39.484756 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.484714    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr"]
Jul 30 03:24:39.485349 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.485195    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d05fb7bf-baa3-4cf5-849a-7b6887e75222" containerName="maas-api"
Jul 30 03:24:39.485349 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.485217    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d05fb7bf-baa3-4cf5-849a-7b6887e75222" containerName="maas-api"
Jul 30 03:24:39.485349 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.485228    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c41879c6-fd17-4bd1-b3a6-ff0269eb34c7" containerName="revoke-keys"
Jul 30 03:24:39.485349 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.485238    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c41879c6-fd17-4bd1-b3a6-ff0269eb34c7" containerName="revoke-keys"
Jul 30 03:24:39.485590 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.485375    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c41879c6-fd17-4bd1-b3a6-ff0269eb34c7" containerName="revoke-keys"
Jul 30 03:24:39.485590 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.485397    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d05fb7bf-baa3-4cf5-849a-7b6887e75222" containerName="maas-api"
Jul 30 03:24:39.490079 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.490058    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr"
Jul 30 03:24:39.492938 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.492863    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 03:24:39.494417 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.494395    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2npk7\""
Jul 30 03:24:39.496335 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.496295    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr"]
Jul 30 03:24:39.619026 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.618992    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a3e6c1b-db00-4645-93fb-56c357b4786c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-da5459-dggsr\" (UID: \"6a3e6c1b-db00-4645-93fb-56c357b4786c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr"
Jul 30 03:24:39.720345 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.720312    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a3e6c1b-db00-4645-93fb-56c357b4786c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-da5459-dggsr\" (UID: \"6a3e6c1b-db00-4645-93fb-56c357b4786c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr"
Jul 30 03:24:39.720957 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.720937    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a3e6c1b-db00-4645-93fb-56c357b4786c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-da5459-dggsr\" (UID: \"6a3e6c1b-db00-4645-93fb-56c357b4786c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr"
Jul 30 03:24:39.802155 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:39.802125    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr"
Jul 30 03:24:40.137892 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:40.137867    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr"]
Jul 30 03:24:40.140453 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:24:40.140418    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3e6c1b_db00_4645_93fb_56c357b4786c.slice/crio-db2e701f7f86769dd616071e93e18e2060b01cd672ba03ac06c7551686e85caf WatchSource:0}: Error finding container db2e701f7f86769dd616071e93e18e2060b01cd672ba03ac06c7551686e85caf: Status 404 returned error can't find the container with id db2e701f7f86769dd616071e93e18e2060b01cd672ba03ac06c7551686e85caf
Jul 30 03:24:40.510527 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:40.510496    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr" event={"ID":"6a3e6c1b-db00-4645-93fb-56c357b4786c","Type":"ContainerStarted","Data":"46fde0a3b33a9eef9b25f66f4ad8441f2daa6eb46a5362a9812c14b3734a8223"}
Jul 30 03:24:40.510941 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:40.510558    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr" event={"ID":"6a3e6c1b-db00-4645-93fb-56c357b4786c","Type":"ContainerStarted","Data":"db2e701f7f86769dd616071e93e18e2060b01cd672ba03ac06c7551686e85caf"}
Jul 30 03:24:40.537355 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:40.537307    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr" podStartSLOduration=1.537293344 podStartE2EDuration="1.537293344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:24:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:24:40.536175724 +0000 UTC m=+3516.386488454" watchObservedRunningTime="2026-07-30 03:24:40.537293344 +0000 UTC m=+3516.387606074"
Jul 30 03:24:41.516758 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:41.516725    2554 generic.go:356] "Generic (PLEG): container finished" podID="6a3e6c1b-db00-4645-93fb-56c357b4786c" containerID="46fde0a3b33a9eef9b25f66f4ad8441f2daa6eb46a5362a9812c14b3734a8223" exitCode=0
Jul 30 03:24:41.517192 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:41.516776    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr" event={"ID":"6a3e6c1b-db00-4645-93fb-56c357b4786c","Type":"ContainerDied","Data":"46fde0a3b33a9eef9b25f66f4ad8441f2daa6eb46a5362a9812c14b3734a8223"}
Jul 30 03:24:42.657713 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:42.657691    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr"
Jul 30 03:24:42.745215 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:42.745182    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a3e6c1b-db00-4645-93fb-56c357b4786c-maas-api-service-ca\") pod \"6a3e6c1b-db00-4645-93fb-56c357b4786c\" (UID: \"6a3e6c1b-db00-4645-93fb-56c357b4786c\") "
Jul 30 03:24:42.750572 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:42.746005    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a3e6c1b-db00-4645-93fb-56c357b4786c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6a3e6c1b-db00-4645-93fb-56c357b4786c" (UID: "6a3e6c1b-db00-4645-93fb-56c357b4786c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 03:24:42.846901 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:42.846839    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a3e6c1b-db00-4645-93fb-56c357b4786c-maas-api-service-ca\") on node \"ip-10-0-136-75.ec2.internal\" DevicePath \"\""
Jul 30 03:24:43.527555 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:43.527523    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr" event={"ID":"6a3e6c1b-db00-4645-93fb-56c357b4786c","Type":"ContainerDied","Data":"db2e701f7f86769dd616071e93e18e2060b01cd672ba03ac06c7551686e85caf"}
Jul 30 03:24:43.527726 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:43.527586    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr"
Jul 30 03:24:43.527726 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:43.527616    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db2e701f7f86769dd616071e93e18e2060b01cd672ba03ac06c7551686e85caf"
Jul 30 03:24:53.022782 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:53.022746    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:24:54.562312 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:54.562279    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr"]
Jul 30 03:24:54.564635 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:54.564613    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-da5459-dggsr"]
Jul 30 03:24:54.640297 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:24:54.640265    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a3e6c1b-db00-4645-93fb-56c357b4786c" path="/var/lib/kubelet/pods/6a3e6c1b-db00-4645-93fb-56c357b4786c/volumes"
Jul 30 03:25:15.230461 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:15.230425    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xd9gs"]
Jul 30 03:25:23.579679 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:23.579644    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84f55fffc7-mxgtx_6c75e8c7-52c4-4f11-acf7-d7238b052a73/authorino/0.log"
Jul 30 03:25:29.123007 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:29.122977    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-c66vm_ede6547b-21cf-4d73-8619-c302908a218b/server/0.log"
Jul 30 03:25:29.240678 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:29.240647    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8rftp_98e683a6-5e03-452e-b653-c2362c0de009/manager/0.log"
Jul 30 03:25:29.462973 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:29.462893    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684d7c5d99-kvgk6_93abe02a-54f1-4adf-bee4-f10aad7e1f03/copy-manifests/0.log"
Jul 30 03:25:29.474594 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:29.474533    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684d7c5d99-kvgk6_93abe02a-54f1-4adf-bee4-f10aad7e1f03/manager/0.log"
Jul 30 03:25:31.589386 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:31.589347    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84f55fffc7-mxgtx_6c75e8c7-52c4-4f11-acf7-d7238b052a73/authorino/0.log"
Jul 30 03:25:32.256657 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:32.256624    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xd9gs_40ba0db8-c960-4b37-a78c-bbc4c938852f/limitador/0.log"
Jul 30 03:25:32.936880 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:32.936855    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b44668b45-f7p6g_f6ae05d0-fed1-4e53-9311-dd5fa0bde918/kube-auth-proxy/0.log"
Jul 30 03:25:33.503072 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:33.503042    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7499746c59-kn6df_0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48/router/0.log"
Jul 30 03:25:34.052159 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:34.052130    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-l6scg_f1ad2305-6ad0-4fd8-b5b4-c218914d8f4b/main/0.log"
Jul 30 03:25:34.390720 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:34.390642    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-xzqz9_7f9ffb4e-bc64-4f1c-8b59-542c3ba51c0a/main/0.log"
Jul 30 03:25:42.788345 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:42.788314    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8bthc_73225a1c-d6ba-4d8b-a7d7-65187d4b51b6/global-pull-secret-syncer/0.log"
Jul 30 03:25:42.987139 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:42.987108    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jtxnn_834558a0-77d5-4868-b66e-27e265159b28/konnectivity-agent/0.log"
Jul 30 03:25:43.051575 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:43.051485    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-75.ec2.internal_4856b1a7fc480724b4b36024a45631a3/haproxy/0.log"
Jul 30 03:25:47.494639 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:47.494606    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84f55fffc7-mxgtx_6c75e8c7-52c4-4f11-acf7-d7238b052a73/authorino/0.log"
Jul 30 03:25:47.767492 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:47.767466    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xd9gs_40ba0db8-c960-4b37-a78c-bbc4c938852f/limitador/0.log"
Jul 30 03:25:49.811439 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:49.811410    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-4whwq_228f5777-e4d6-44d3-8b93-44d57ba23858/monitoring-plugin/0.log"
Jul 30 03:25:49.846987 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:49.846960    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2x69c_a35e99f1-3655-4b75-8e99-2b2586a5067c/node-exporter/0.log"
Jul 30 03:25:49.868003 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:49.867983    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2x69c_a35e99f1-3655-4b75-8e99-2b2586a5067c/kube-rbac-proxy/0.log"
Jul 30 03:25:49.896593 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:49.896569    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2x69c_a35e99f1-3655-4b75-8e99-2b2586a5067c/init-textfile/0.log"
Jul 30 03:25:50.472858 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:50.472826    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57cd66d666-zc8n6_4d172ada-9f9f-42ed-aae6-72f940f3c832/telemeter-client/0.log"
Jul 30 03:25:50.504429 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:50.504406    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57cd66d666-zc8n6_4d172ada-9f9f-42ed-aae6-72f940f3c832/reload/0.log"
Jul 30 03:25:50.524218 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:50.524196    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57cd66d666-zc8n6_4d172ada-9f9f-42ed-aae6-72f940f3c832/kube-rbac-proxy/0.log"
Jul 30 03:25:50.565110 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:50.565079    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f7bdcbd6f-6pz8l_81350d98-0997-440e-81cf-76ee7bd63f0c/thanos-query/0.log"
Jul 30 03:25:50.584968 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:50.584943    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f7bdcbd6f-6pz8l_81350d98-0997-440e-81cf-76ee7bd63f0c/kube-rbac-proxy-web/0.log"
Jul 30 03:25:50.607098 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:50.607079    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f7bdcbd6f-6pz8l_81350d98-0997-440e-81cf-76ee7bd63f0c/kube-rbac-proxy/0.log"
Jul 30 03:25:50.625378 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:50.625351    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f7bdcbd6f-6pz8l_81350d98-0997-440e-81cf-76ee7bd63f0c/prom-label-proxy/0.log"
Jul 30 03:25:50.647880 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:50.647862    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f7bdcbd6f-6pz8l_81350d98-0997-440e-81cf-76ee7bd63f0c/kube-rbac-proxy-rules/0.log"
Jul 30 03:25:50.666395 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:50.666374    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f7bdcbd6f-6pz8l_81350d98-0997-440e-81cf-76ee7bd63f0c/kube-rbac-proxy-metrics/0.log"
Jul 30 03:25:52.570179 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:52.570147    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 03:25:52.574341 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:52.574316    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/3.log"
Jul 30 03:25:53.109982 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.109952    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7457c6fd6d-ww869_ac0906ff-d838-41a9-973c-82e199c59d75/console/0.log"
Jul 30 03:25:53.511407 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.511372    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"]
Jul 30 03:25:53.511774 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.511760    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a3e6c1b-db00-4645-93fb-56c357b4786c" containerName="revoke-keys"
Jul 30 03:25:53.511826 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.511776    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a3e6c1b-db00-4645-93fb-56c357b4786c" containerName="revoke-keys"
Jul 30 03:25:53.511862 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.511844    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a3e6c1b-db00-4645-93fb-56c357b4786c" containerName="revoke-keys"
Jul 30 03:25:53.514981 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.514966    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.517199 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.517176    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-trtdw\"/\"default-dockercfg-6rs4c\""
Jul 30 03:25:53.517325 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.517241    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-trtdw\"/\"kube-root-ca.crt\""
Jul 30 03:25:53.518136 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.518107    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-trtdw\"/\"openshift-service-ca.crt\""
Jul 30 03:25:53.524268 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.524248    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"]
Jul 30 03:25:53.533628 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.533605    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2301629-60c7-4b89-a038-df737ced5933-lib-modules\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.533712 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.533646    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp9qd\" (UniqueName: \"kubernetes.io/projected/c2301629-60c7-4b89-a038-df737ced5933-kube-api-access-vp9qd\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.533712 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.533676    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2301629-60c7-4b89-a038-df737ced5933-proc\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.533712 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.533694    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2301629-60c7-4b89-a038-df737ced5933-podres\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.533825 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.533730    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2301629-60c7-4b89-a038-df737ced5933-sys\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.634234 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.634190    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2301629-60c7-4b89-a038-df737ced5933-lib-modules\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.634718 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.634252    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp9qd\" (UniqueName: \"kubernetes.io/projected/c2301629-60c7-4b89-a038-df737ced5933-kube-api-access-vp9qd\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.634718 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.634287    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2301629-60c7-4b89-a038-df737ced5933-proc\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.634718 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.634304    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2301629-60c7-4b89-a038-df737ced5933-podres\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.634718 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.634343    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2301629-60c7-4b89-a038-df737ced5933-sys\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.634718 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.634373    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2301629-60c7-4b89-a038-df737ced5933-lib-modules\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.634718 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.634407    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2301629-60c7-4b89-a038-df737ced5933-proc\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.634718 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.634429    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2301629-60c7-4b89-a038-df737ced5933-sys\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.634718 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.634445    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2301629-60c7-4b89-a038-df737ced5933-podres\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.642113 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.642083    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp9qd\" (UniqueName: \"kubernetes.io/projected/c2301629-60c7-4b89-a038-df737ced5933-kube-api-access-vp9qd\") pod \"perf-node-gather-daemonset-bcgjs\" (UID: \"c2301629-60c7-4b89-a038-df737ced5933\") " pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.824747 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.824679    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:53.953572 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:53.953512    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"]
Jul 30 03:25:53.956883 ip-10-0-136-75 kubenswrapper[2554]: W0730 03:25:53.956844    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc2301629_60c7_4b89_a038_df737ced5933.slice/crio-d41884ad286467c165f84fa50893b3b3c3a4dcd2612b1d3550181e3c7be99d95 WatchSource:0}: Error finding container d41884ad286467c165f84fa50893b3b3c3a4dcd2612b1d3550181e3c7be99d95: Status 404 returned error can't find the container with id d41884ad286467c165f84fa50893b3b3c3a4dcd2612b1d3550181e3c7be99d95
Jul 30 03:25:54.865590 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:54.865532    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs" event={"ID":"c2301629-60c7-4b89-a038-df737ced5933","Type":"ContainerStarted","Data":"f6f2f6f0e3179f0db700107110c26d26c700e4c802f4ad8a22a291910ff54701"}
Jul 30 03:25:54.865989 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:54.865630    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs" event={"ID":"c2301629-60c7-4b89-a038-df737ced5933","Type":"ContainerStarted","Data":"d41884ad286467c165f84fa50893b3b3c3a4dcd2612b1d3550181e3c7be99d95"}
Jul 30 03:25:54.865989 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:54.865675    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:25:54.881473 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:54.881434    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs" podStartSLOduration=1.881420085 podStartE2EDuration="1.881420085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 03:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:25:54.879847951 +0000 UTC m=+3590.730160683" watchObservedRunningTime="2026-07-30 03:25:54.881420085 +0000 UTC m=+3590.731732849"
Jul 30 03:25:54.925377 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:54.925355    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5bkd9_9cc11f4f-f101-4b6b-a00f-01cce5a1b057/dns/0.log"
Jul 30 03:25:54.947179 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:54.947160    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5bkd9_9cc11f4f-f101-4b6b-a00f-01cce5a1b057/kube-rbac-proxy/0.log"
Jul 30 03:25:55.093699 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:55.093666    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sv8rz_751d0197-5c04-418f-a656-a9396612d072/dns-node-resolver/0.log"
Jul 30 03:25:55.641218 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:55.641189    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2qsc5_df95b109-705c-4fb3-9605-4d96ed3fa417/node-ca/0.log"
Jul 30 03:25:56.768809 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:56.768736    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b44668b45-f7p6g_f6ae05d0-fed1-4e53-9311-dd5fa0bde918/kube-auth-proxy/0.log"
Jul 30 03:25:56.938151 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:56.938122    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7499746c59-kn6df_0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48/router/0.log"
Jul 30 03:25:57.735800 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:57.735768    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4ls5q_dd7f642f-aeeb-4c64-90a8-2ada86bc0964/serve-healthcheck-canary/0.log"
Jul 30 03:25:58.223571 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:58.223522    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-97nvg_c3c7b535-3fd2-482e-a3db-63789390305b/insights-operator/0.log"
Jul 30 03:25:58.224873 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:58.224853    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-97nvg_c3c7b535-3fd2-482e-a3db-63789390305b/insights-operator/1.log"
Jul 30 03:25:58.382990 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:58.382961    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rl96w_6fd23782-eaf7-4f93-aebb-20cc56cd9d75/kube-rbac-proxy/0.log"
Jul 30 03:25:58.402439 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:58.402412    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rl96w_6fd23782-eaf7-4f93-aebb-20cc56cd9d75/exporter/0.log"
Jul 30 03:25:58.422185 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:25:58.422146    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rl96w_6fd23782-eaf7-4f93-aebb-20cc56cd9d75/extractor/0.log"
Jul 30 03:26:00.879955 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:00.879922    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-trtdw/perf-node-gather-daemonset-bcgjs"
Jul 30 03:26:00.969776 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:00.969740    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-c66vm_ede6547b-21cf-4d73-8619-c302908a218b/server/0.log"
Jul 30 03:26:01.041175 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:01.041145    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8rftp_98e683a6-5e03-452e-b653-c2362c0de009/manager/0.log"
Jul 30 03:26:01.195795 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:01.195716    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684d7c5d99-kvgk6_93abe02a-54f1-4adf-bee4-f10aad7e1f03/manager/0.log"
Jul 30 03:26:01.217373 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:01.217355    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684d7c5d99-kvgk6_93abe02a-54f1-4adf-bee4-f10aad7e1f03/copy-manifests/0.log"
Jul 30 03:26:02.614599 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:02.614564    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5bb854bdc9-k9tcr_44f8a3f5-8065-4d0f-bfc5-b438b92d2b4a/manager/0.log"
Jul 30 03:26:04.046818 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:04.046789    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b44668b45-f7p6g_f6ae05d0-fed1-4e53-9311-dd5fa0bde918/kube-auth-proxy/0.log"
Jul 30 03:26:04.175224 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:04.175195    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7499746c59-kn6df_0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48/router/0.log"
Jul 30 03:26:04.826238 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:04.826212    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 03:26:04.830643 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:04.830616    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 03:26:04.838423 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:04.838401    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-fh26s_7e89ced1-b07c-438c-83dd-15333c24ea83/console-operator/2.log"
Jul 30 03:26:04.842049 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:04.842029    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7f7z_887de7b2-9547-4b64-aa63-cb5e79cd1a5a/ovn-acl-logging/0.log"
Jul 30 03:26:05.861134 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:05.861103    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b44668b45-f7p6g_f6ae05d0-fed1-4e53-9311-dd5fa0bde918/kube-auth-proxy/0.log"
Jul 30 03:26:05.999739 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:05.999707    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7499746c59-kn6df_0d3d8b42-5b4f-4c4d-acfb-9d35a1da9e48/router/0.log"
Jul 30 03:26:08.307496 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:08.307460    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d_28485e56-40a8-40bf-9497-53bf67edbc96/kube-storage-version-migrator-operator/1.log"
Jul 30 03:26:08.308385 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:08.308364    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-n7n2d_28485e56-40a8-40bf-9497-53bf67edbc96/kube-storage-version-migrator-operator/0.log"
Jul 30 03:26:09.306841 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:09.306810    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8nlws_c75033ab-a299-4583-86d9-ea212ccb4598/kube-multus/0.log"
Jul 30 03:26:09.473908 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:09.473827    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j8cv_c9c4aa7a-b3b2-46af-a41b-c4d68170377c/kube-multus-additional-cni-plugins/0.log"
Jul 30 03:26:09.493601 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:09.493571    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j8cv_c9c4aa7a-b3b2-46af-a41b-c4d68170377c/egress-router-binary-copy/0.log"
Jul 30 03:26:09.511847 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:09.511818    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j8cv_c9c4aa7a-b3b2-46af-a41b-c4d68170377c/cni-plugins/0.log"
Jul 30 03:26:09.529485 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:09.529468    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j8cv_c9c4aa7a-b3b2-46af-a41b-c4d68170377c/bond-cni-plugin/0.log"
Jul 30 03:26:09.549559 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:09.549528    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j8cv_c9c4aa7a-b3b2-46af-a41b-c4d68170377c/routeoverride-cni/0.log"
Jul 30 03:26:09.567584 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:09.567537    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j8cv_c9c4aa7a-b3b2-46af-a41b-c4d68170377c/whereabouts-cni-bincopy/0.log"
Jul 30 03:26:09.586671 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:09.586650    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j8cv_c9c4aa7a-b3b2-46af-a41b-c4d68170377c/whereabouts-cni/0.log"
Jul 30 03:26:09.775569 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:09.775528    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5jft6_e8d68db5-cc2c-417c-9027-b71ea9c67cee/network-metrics-daemon/0.log"
Jul 30 03:26:09.790464 ip-10-0-136-75 kubenswrapper[2554]: I0730 03:26:09.790444    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5jft6_e8d68db5-cc2c-417c-9027-b71ea9c67cee/kube-rbac-proxy/0.log"